-- Logs begin at Sun 2022-09-18 05:44:01 UTC, end at Sun 2022-09-18 06:48:16 UTC. -- Sep 18 06:09:57.133405 dv-cinder-855359-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 18 06:09:57.141161 dv-cinder-855359-3-smb devstack@keystone.service[81371]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 18 06:09:57.143172 dv-cinder-855359-3-smb devstack@keystone.service[81371]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 18 06:09:57 2022] *** Sep 18 06:09:57.143172 dv-cinder-855359-3-smb devstack@keystone.service[81371]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 18 06:09:57.143172 dv-cinder-855359-3-smb devstack@keystone.service[81371]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 18 06:09:57.143172 dv-cinder-855359-3-smb devstack@keystone.service[81371]: nodename: dv-cinder-855359-3-smb Sep 18 06:09:57.143172 dv-cinder-855359-3-smb devstack@keystone.service[81371]: machine: x86_64 Sep 18 06:09:57.143172 dv-cinder-855359-3-smb devstack@keystone.service[81371]: clock source: unix Sep 18 06:09:57.143172 dv-cinder-855359-3-smb devstack@keystone.service[81371]: pcre jit disabled Sep 18 06:09:57.143566 dv-cinder-855359-3-smb devstack@keystone.service[81371]: detected number of CPU cores: 4 Sep 18 06:09:57.143566 dv-cinder-855359-3-smb devstack@keystone.service[81371]: current working directory: / Sep 18 06:09:57.143566 dv-cinder-855359-3-smb devstack@keystone.service[81371]: detected binary path: /usr/bin/uwsgi-core Sep 18 06:09:57.143566 dv-cinder-855359-3-smb devstack@keystone.service[81371]: your processes number limit is 47680 Sep 18 06:09:57.143566 dv-cinder-855359-3-smb devstack@keystone.service[81371]: your memory page size is 4096 bytes Sep 18 06:09:57.143566 dv-cinder-855359-3-smb devstack@keystone.service[81371]: detected max file descriptor number: 2048 Sep 18 06:09:57.143566 dv-cinder-855359-3-smb devstack@keystone.service[81371]: lock engine: pthread robust mutexes Sep 18 06:09:57.143566 dv-cinder-855359-3-smb devstack@keystone.service[81371]: thunder lock: enabled Sep 18 06:09:57.143566 dv-cinder-855359-3-smb devstack@keystone.service[81371]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 18 06:09:57.144041 dv-cinder-855359-3-smb devstack@keystone.service[81371]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 18 06:09:57.184362 dv-cinder-855359-3-smb devstack@keystone.service[81371]: Python main interpreter initialized at 0x563f003a59c0 Sep 18 06:09:57.184362 dv-cinder-855359-3-smb devstack@keystone.service[81371]: python threads support enabled Sep 18 06:09:57.184362 dv-cinder-855359-3-smb devstack@keystone.service[81371]: your server socket listen backlog is limited to 100 connections Sep 18 06:09:57.184362 dv-cinder-855359-3-smb devstack@keystone.service[81371]: your mercy for graceful operations on workers is 90 seconds Sep 18 06:09:57.184753 dv-cinder-855359-3-smb devstack@keystone.service[81371]: mapped 403077 bytes (393 KB) for 2 cores Sep 18 06:09:57.184832 dv-cinder-855359-3-smb devstack@keystone.service[81371]: *** Operational MODE: preforking *** Sep 18 06:09:57.185086 dv-cinder-855359-3-smb devstack@keystone.service[81371]: *** uWSGI is running in multiple interpreter mode *** Sep 18 06:09:57.185086 dv-cinder-855359-3-smb devstack@keystone.service[81371]: spawned uWSGI master process (pid: 81371) Sep 18 06:09:57.185286 dv-cinder-855359-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 18 06:09:57.186448 dv-cinder-855359-3-smb devstack@keystone.service[81371]: spawned uWSGI worker 1 (pid: 81384, cores: 1) Sep 18 06:09:57.186448 dv-cinder-855359-3-smb devstack@keystone.service[81371]: spawned uWSGI worker 2 (pid: 81385, cores: 1) Sep 18 06:09:57.186448 dv-cinder-855359-3-smb devstack@keystone.service[81371]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 18 06:10:01.489086 dv-cinder-855359-3-smb devstack@keystone.service[81384]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 06:10:01.489086 dv-cinder-855359-3-smb devstack@keystone.service[81384]: from cryptography.utils import int_from_bytes Sep 18 06:10:01.489887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 06:10:01.489887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: from cryptography.utils import int_from_bytes Sep 18 06:10:01.490011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 06:10:01.490011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: from cryptography.utils import int_from_bytes Sep 18 06:10:01.490011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 06:10:01.490011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: from cryptography.utils import int_from_bytes Sep 18 06:10:01.540806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 06:10:01.540979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 06:10:01.541140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] command line args: [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 06:10:01.541408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 06:10:01.541616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ================================================================================ {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 06:10:01.541847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] admin_token = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.542089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] config_dir = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.542421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.542608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] config_source = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.542700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 06:10:01.542812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] debug = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.542897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 06:10:01.542972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.543257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] command line args: [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 06:10:01.543323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.543388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 06:10:01.543452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.543522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ================================================================================ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 06:10:01.543588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.543653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] admin_token = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.543873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.543997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_dir = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.544061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.544126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.544185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] config_source = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.544247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_config_append = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.544433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] debug = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.544522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.544595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.544687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_dir = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.544752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_file = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.544815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.545001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.545081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.545401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.545516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.545606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.545684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.545757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.545836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.545922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_config_append = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.546003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.546094 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.546172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.546245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_dir = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.546320 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.546393 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.546469 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.546547 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.546694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.546795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.546992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.547174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.547253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.547314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.547373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.547551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.547624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.547776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.547846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.548021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.548154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.548250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.548434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.548812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.548932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.549008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] publish_errors = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.549109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.549233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.549317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.549394 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.549455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.549521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.549600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.549688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.549921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.550040 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.550151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] standard_threads = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.550501 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.550670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.550670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] publish_errors = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.550817 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.550817 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.551104 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.551237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] use_journal = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.551374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.551486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] use_json = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.551688 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.551838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] use_stderr = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.551838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] use_syslog = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.552115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.552196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.552256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.552444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.552575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] standard_threads = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.552575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.552862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.552997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.553078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.553250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.553410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.553555 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_journal = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.554313 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.554398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_json = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.554398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_stderr = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.554626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.554756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] use_syslog = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.554890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.554995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 06:10:01.555113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.555191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.555349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.555489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.555577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.555577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.555689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.555884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.556013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.556159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.556298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.556441 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.556521 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.556589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.556657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.556813 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.556881 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.557068 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.557231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.557317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.557388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.557459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.557618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.557714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.557856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.558009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.558103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.558166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.558229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.558350 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.558522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.558648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.558877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.559024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.559107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.559168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.559225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.559355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.559547 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.559701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.559847 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.559997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.560085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.560159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.560225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.560376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.560481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.560628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.560776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.560867 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.560930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.561069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.561158 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.561279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.561456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.561596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.561728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.561900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562707 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.562987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.563055 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.563132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.563204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.563358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.563437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.563593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.563670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.563819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.563894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.564084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.564163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.564327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.564404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.564556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.564633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.564786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.564862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.565019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.565101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.565257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.565335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.565485 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.565568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.565718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.565801 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.565948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.566034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.566181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.566258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.566412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.566489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.566657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.566734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.566884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.567027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.567134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.567240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.567345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.567448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.567553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.567650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.567788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.567979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.568088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.568169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.568288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.568364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.568480 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.568565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.568706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.568797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.568940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.569068 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.569171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.569301 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.569555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.569640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.569797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.569975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.570063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.570219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.570339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.570462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.570549 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.570703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.570782 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.570957 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.571038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.571199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.571280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.571437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.571517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.571680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.571797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.571965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.572084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.572193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.572269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.572405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.572481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.572625 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.572705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.572863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.572939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.573099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.573180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.573339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.573418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.573573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.573651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.573817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.573906 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.574051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.574130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.574281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.574359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.574514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.574591 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.574748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.574827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.574981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.575065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.575239 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.575323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.575468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.575542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.575710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.575788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.575967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.576063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.576205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.576295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.576447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.576525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.576682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.576760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.576917 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.577002 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.577149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.577226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.577377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.577454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.577602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.577694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.577830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.577909 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.578062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.578140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.external = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.578288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.578378 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.578526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.578633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.578759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.578870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.579002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.579090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.password = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.579234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.579322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] auth.token = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.579486 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.579572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.579739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.579818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.579997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.580095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.580225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.external = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.580304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.580452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.580531 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.580744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.580832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.580974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.581053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.581203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.password = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.581282 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.581431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] auth.token = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.581517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.581665 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.581744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.581897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.581983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.582139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.582226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.582365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.582444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.582609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.582687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.582876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.582969 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.583086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.583165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.583318 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.583403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.583561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.583651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.583805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.583884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.584071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.584165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.584311 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.584398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.584550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.584638 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.584780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.584910 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.585181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.585274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.585426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.585613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.585692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.585859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.585944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.586117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.586198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.586380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.586458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.586622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.586700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.586881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.586966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.587122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.587201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.587377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.587462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.587615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.587694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.587853 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.587974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.588119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.588209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.588365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.588443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.588597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.588675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.588843 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.588989 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.589071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.589189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.589316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.589395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.589549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.589703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.589779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.589848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.590029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.590143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.590279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.590382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.590505 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.590585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.590739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.590816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.590975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.591061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.591206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.591284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.591438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.591517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.591681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.591772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.591925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.592020 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.592163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.592242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.592410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.592497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.592656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.592734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.592888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.592966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.593117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.593204 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.593343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.593460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.593583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.593663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.593827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.593913 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.594066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.594143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.594309 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.594386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.594550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.594639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.594785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.594863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.595037 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.595115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.595269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.595355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.595495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.595574 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.595728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.595805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.595975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.596071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.596208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.596288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.596444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.596522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.596680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.596760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.596920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.596997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.597145 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.597232 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.597388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.597468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.597627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.597705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.597857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.597934 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.598099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.598178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.598340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.598464 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.598569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.598704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.598792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.598942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.599021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.599198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.599276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.599459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.599545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.599692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.599770 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.599943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.600037 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.600179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.600267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.600414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.601034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.601201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.601314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.601462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.601717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.601799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.601986 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.602064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.602288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.602366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.602543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.602623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.602786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.602865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.603023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.603102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.603265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.603351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.603495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.603573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.603735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.603813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.603994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.604078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.604236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.604313 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.604484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.604563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.604732 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.604812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.604979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.605058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.605213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.605292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.605444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.605523 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.605678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.605757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.605912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.605990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.606146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.606227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.606374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.606453 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.606611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.606690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.606853 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.606933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.607098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.607177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.607337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.607415 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.607577 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.607656 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.607806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.607885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.608075 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.608155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.608309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.608391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.608543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.608621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.608776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.608855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.609008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.609088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.609249 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.609328 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.609482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.609560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.609715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.609794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.609963 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.610041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.610190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.610268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.610433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.610513 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.610667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.610746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.610899 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.610978 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.611134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.611214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.611377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.611456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.611615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.611694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.611846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.611939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.612106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.612195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.612345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] role.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.612423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.612591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.612670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] role.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.612824 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.612902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.613056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.613205 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.613307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.613386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.613553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.613631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.613784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.613873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.614026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.614104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.614258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.614337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.614494 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.614580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.614725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.614804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.614969 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.615045 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.615194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.615279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.615438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.615517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.615683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.615761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.615961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.616057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.616741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.617073 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.617187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.617334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.617573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.617661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.617829 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.617908 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.618081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.618204 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.618304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.618412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.618554 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.618632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.618802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.618880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.619049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.619136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.619297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.619375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.619536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.619694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.619786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.619960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.620041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.620213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.620292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.620462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.620553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.620711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.620791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.620957 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.621035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.621189 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.621275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.621433 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.621511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.621675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.621753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.621910 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.622042 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.622142 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.622222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.622372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.622451 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.622601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.622688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.622850 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.622929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.623097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.623174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.623345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.623431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.623578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.623655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.623813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.623891 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.624066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.624158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.624300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.624379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.624537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.624615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.624780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.624866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.625014 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.625092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.625266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.625343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.625511 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.625597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.625743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.625822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.625984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.626063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.connection = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.626224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.626302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.626468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.626548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.626701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.626779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.626935 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.627012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.627166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.627246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.627409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.627487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.627647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.627724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.627888 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.627987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.628150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.628239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.628389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.628513 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.628638 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.628718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.628878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.628958 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.629119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.629197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.629354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.629433 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.629592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.629672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.629825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.629904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.630058 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.630137 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.630289 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.630369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.630441 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 06:10:01.630512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.630749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.630982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.631221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.631452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.631712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.632098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.632464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.632700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.632941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.633179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 06:10:01.633348 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 06:10:01.660205 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.660439 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.660670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.661648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.661877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.662098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.669697 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.671128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.698443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.698679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.699780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.700045 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.752656 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.752956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.801956 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.802193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.802659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.802895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.957343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.957573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.957801 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.958023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.958201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.958291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.958431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.958516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.958653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.958872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.959088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.959301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.982156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.982287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.982369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.982464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.982616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.982734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.982818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.982894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.983032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.983117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.983260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.983344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.983478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.983618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.995515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:01.995621 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.008410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.008597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.008683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.008828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.008912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.009049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.009131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.009271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.009363 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.009489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.009572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.009702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.009785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.009915 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 06:10:02.027337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.027552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 18 06:10:02.027644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.027852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 18 06:10:02.027959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.028120 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 18 06:10:02.028204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.028399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.028482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 18 06:10:02.028667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.028761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.028929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.029010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.029188 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.029269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.029447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.038996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.039280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.039363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.039557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.039640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.039846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.040023 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.040264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.046841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.047146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.049779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.050042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.050125 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.050328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.050410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.050611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.050705 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.050894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.050976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.051157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.051237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.051422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.051504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.051693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.051776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.051992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.052087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.052266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.052345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.052534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.052618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.052801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.075588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.076257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.077077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.077367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.077718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.078004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.082124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.082415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.082617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.082700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.082899 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.083175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.089562 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.089852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.090357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.090644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.095467 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.095763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.096080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.096204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.096375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.096498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.096660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.096783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.096940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.097071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.097213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.097349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.097484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.097622 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.097893 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.098159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.113021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.113300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.113789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.114066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.117195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.118175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.120440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.120749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.121360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.121656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.124962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.125749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.128157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.128803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.131376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.132205 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.132503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.132639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.132789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.133070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.133175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.133354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.133438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.133661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.133940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.134217 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.149525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.149816 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.150087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.150353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.150435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.150663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.150935 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.151201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.157183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.157963 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.158724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.159480 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.160275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.160557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.161012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.161287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.163736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.164118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.164337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.164623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.164764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.165017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.165104 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.165330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.165649 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.166072 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.176105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.176394 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.176679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.176965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.177047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.177313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.177395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.177590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.177673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.177869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.177960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.178247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.178584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.179005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.193430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.194865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.197202 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.198066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.200123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.200940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.201569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.202356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.203052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.203338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.203751 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.203833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.204104 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.204506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.210178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.211094 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.211636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.212573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.214548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.214948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.215239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.215416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.215580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.215810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.216124 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.216402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.223305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.223597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.223881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.224105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.224395 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.224685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.231409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.231698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.232008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.232291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.232394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 06:10:02.232577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.232660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.232858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.232940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.233134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.233216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.233401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.233491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.233670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.233759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.233943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.234034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.234222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.234302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.234486 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.234566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.234752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.234833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.235017 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.235097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.235298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.235560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.235814 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 06:10:02.269768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563f003a59c0 pid: 81384 (default app) Sep 18 06:10:02.270513 dv-cinder-855359-3-smb devstack@keystone.service[81385]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563f003a59c0 pid: 81385 (default app) Sep 18 06:10:02.273216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c59a-2fc7-4cfd-be28-f22499279373 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:02.273507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c59a-2fc7-4cfd-be28-f22499279373 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:02.273786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c59a-2fc7-4cfd-be28-f22499279373 None None] PATH_INFO: `/v3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:02.277991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Sun Sep 18 06:10:02 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:09.070067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19c5db-3d1a-4524-b92b-44694655e7d0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:09.070569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19c5db-3d1a-4524-b92b-44694655e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:09.070679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19c5db-3d1a-4524-b92b-44694655e7d0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:09.074871 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:10:09.080210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f76fc-e4c9-4767-890e-ab35c7db1a02 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:09.080605 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f76fc-e4c9-4767-890e-ab35c7db1a02 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:09.080740 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f76fc-e4c9-4767-890e-ab35c7db1a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:09.150783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: INFO dbcounter [None req-269f76fc-e4c9-4767-890e-ab35c7db1a02 None None] Registered counter for database keystone Sep 18 06:10:09.170379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG oslo_db.sqlalchemy.engines [None req-269f76fc-e4c9-4767-890e-ab35c7db1a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 06:10:09.176457 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writer thread running {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 06:10:09.370813 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG passlib.handlers.bcrypt [None req-269f76fc-e4c9-4767-890e-ab35c7db1a02 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81384) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 18 06:10:09.371123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG passlib.handlers.bcrypt [None req-269f76fc-e4c9-4767-890e-ab35c7db1a02 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81384) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 18 06:10:09.429025 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-269f76fc-e4c9-4767-890e-ab35c7db1a02 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:09.430601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-269f76fc-e4c9-4767-890e-ab35c7db1a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:09.565066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 18 06:10:10.030012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19c5db-3d1a-4524-b92b-44694655e7d0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:10.099254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: INFO dbcounter [None req-8b19c5db-3d1a-4524-b92b-44694655e7d0 None None] Registered counter for database keystone Sep 18 06:10:10.120808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG oslo_db.sqlalchemy.engines [None req-8b19c5db-3d1a-4524-b92b-44694655e7d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 06:10:10.126991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writer thread running {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 06:10:10.246896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19c5db-3d1a-4524-b92b-44694655e7d0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:10.251179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1400c-a52f-46da-b99e-bb151dd5b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:10.251803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1400c-a52f-46da-b99e-bb151dd5b810 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:10.252113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1400c-a52f-46da-b99e-bb151dd5b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:10.252389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1400c-a52f-46da-b99e-bb151dd5b810 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:10.260818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1400c-a52f-46da-b99e-bb151dd5b810 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:10.312171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4bf1400c-a52f-46da-b99e-bb151dd5b810 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 18 06:10:10.312516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1400c-a52f-46da-b99e-bb151dd5b810 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:10.322017 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Sun Sep 18 06:10:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 18 06:10:10.328042 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f76fc-e4c9-4767-890e-ab35c7db1a02 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:10.345358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f76fc-e4c9-4767-890e-ab35c7db1a02 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:10.349787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8910652-8c82-4203-bc5c-6f7e8c1066a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:10.351445 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8910652-8c82-4203-bc5c-6f7e8c1066a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:10.351720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8910652-8c82-4203-bc5c-6f7e8c1066a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:10.352022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8910652-8c82-4203-bc5c-6f7e8c1066a1 admin admin] PATH_INFO: `/v3/projects/51a6b33098764a2dacc62af886817c55` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:10.353573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8910652-8c82-4203-bc5c-6f7e8c1066a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=51a6b33098764a2dacc62af886817c55)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:10.407109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d8910652-8c82-4203-bc5c-6f7e8c1066a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 18 06:10:10.407446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8910652-8c82-4203-bc5c-6f7e8c1066a1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:10.411988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Sun Sep 18 06:10:10 2022] GET /identity/v3/projects/51a6b33098764a2dacc62af886817c55 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:12.538151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb02861-2549-427b-a042-080b649dcf94 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:12.538721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb02861-2549-427b-a042-080b649dcf94 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:12.538721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb02861-2549-427b-a042-080b649dcf94 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:12.543425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:12.548882 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6239ce-bc53-4ada-b291-6c599287fffb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:12.549302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6239ce-bc53-4ada-b291-6c599287fffb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:12.549427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6239ce-bc53-4ada-b291-6c599287fffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:12.569199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8b6239ce-bc53-4ada-b291-6c599287fffb None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:12.570685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8b6239ce-bc53-4ada-b291-6c599287fffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:12.578352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 18 06:10:12.846859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb02861-2549-427b-a042-080b649dcf94 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:12.859358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb02861-2549-427b-a042-080b649dcf94 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:12.863543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb11c4e-f13d-4e5d-9e5c-6b2c33e8e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:12.864161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb11c4e-f13d-4e5d-9e5c-6b2c33e8e259 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:12.864442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb11c4e-f13d-4e5d-9e5c-6b2c33e8e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:12.864717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb11c4e-f13d-4e5d-9e5c-6b2c33e8e259 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:12.872361 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb11c4e-f13d-4e5d-9e5c-6b2c33e8e259 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:12.874129 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb11c4e-f13d-4e5d-9e5c-6b2c33e8e259 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:12.883211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Sun Sep 18 06:10:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:10:12.888798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6239ce-bc53-4ada-b291-6c599287fffb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:12.898627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6239ce-bc53-4ada-b291-6c599287fffb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:12.902996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe09eb7-b0e3-4728-b8a2-2e8fd7bfbdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:12.903618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe09eb7-b0e3-4728-b8a2-2e8fd7bfbdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:12.903916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe09eb7-b0e3-4728-b8a2-2e8fd7bfbdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:12.904207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe09eb7-b0e3-4728-b8a2-2e8fd7bfbdb7 admin admin] PATH_INFO: `/v3/users/1346a82e96a54c0884b956d4511e0c94` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:12.905510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe09eb7-b0e3-4728-b8a2-2e8fd7bfbdb7 admin admin] RBAC: Authorizing `identity:get_user(user_id=1346a82e96a54c0884b956d4511e0c94)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:12.907342 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe09eb7-b0e3-4728-b8a2-2e8fd7bfbdb7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:12.908895 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Sun Sep 18 06:10:12 2022] GET /identity/v3/users/1346a82e96a54c0884b956d4511e0c94 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:15.106344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba571d-0159-46ae-89bd-9fbea1106cd4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:15.106828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba571d-0159-46ae-89bd-9fbea1106cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:15.106828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba571d-0159-46ae-89bd-9fbea1106cd4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:15.108184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:15.113396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c024b1-5b6c-45d2-a357-52d7abc4b6f6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:15.113810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c024b1-5b6c-45d2-a357-52d7abc4b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:15.113949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c024b1-5b6c-45d2-a357-52d7abc4b6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:15.132641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-19c024b1-5b6c-45d2-a357-52d7abc4b6f6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:15.133822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-19c024b1-5b6c-45d2-a357-52d7abc4b6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:15.156593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033377f8-123c-44f5-8dd8-1266cac8789a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:15.156875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033377f8-123c-44f5-8dd8-1266cac8789a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:15.157148 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033377f8-123c-44f5-8dd8-1266cac8789a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:15.158500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:10:15.164329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09756f-3249-4df3-8115-83a367a74e13 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:15.164608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09756f-3249-4df3-8115-83a367a74e13 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:15.164880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09756f-3249-4df3-8115-83a367a74e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:15.206451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG passlib.handlers.bcrypt [None req-6e09756f-3249-4df3-8115-83a367a74e13 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81385) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 18 06:10:15.206829 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG passlib.handlers.bcrypt [None req-6e09756f-3249-4df3-8115-83a367a74e13 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81385) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 18 06:10:15.216162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:15.256543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6e09756f-3249-4df3-8115-83a367a74e13 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:15.258136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6e09756f-3249-4df3-8115-83a367a74e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:15.357448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:15.483117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c024b1-5b6c-45d2-a357-52d7abc4b6f6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:15.506701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:15.586649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c024b1-5b6c-45d2-a357-52d7abc4b6f6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:15.619215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cd9ea-8cb5-493b-8c95-946770912c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:15.619775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cd9ea-8cb5-493b-8c95-946770912c98 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:15.620081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cd9ea-8cb5-493b-8c95-946770912c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:15.620354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cd9ea-8cb5-493b-8c95-946770912c98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:15.629375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09756f-3249-4df3-8115-83a367a74e13 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:15.633066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cd9ea-8cb5-493b-8c95-946770912c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-f89cd9ea-8cb5-493b-8c95-946770912c98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:15.642111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:15.643032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:15.643880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:10:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:15.649636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cd9ea-8cb5-493b-8c95-946770912c98 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:15.728587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:15.729818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09756f-3249-4df3-8115-83a367a74e13 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:15.732146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:15.747739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cd9ea-8cb5-493b-8c95-946770912c98 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:15.768327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c6f64-f2c0-4755-90d8-f2e5719ea718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:15.769180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6f64-f2c0-4755-90d8-f2e5719ea718 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:15.769460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6f64-f2c0-4755-90d8-f2e5719ea718 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:15.769734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6f64-f2c0-4755-90d8-f2e5719ea718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:15.782367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1c6d-0ee3-4703-832f-5c5537bb8a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:15.782961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1c6d-0ee3-4703-832f-5c5537bb8a9d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:15.783235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1c6d-0ee3-4703-832f-5c5537bb8a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:15.783504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1c6d-0ee3-4703-832f-5c5537bb8a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:15.784192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a1c6d-0ee3-4703-832f-5c5537bb8a9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:15.784491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a1c6d-0ee3-4703-832f-5c5537bb8a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:15.785884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a1c6d-0ee3-4703-832f-5c5537bb8a9d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:15.797384 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:15.803072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1c6d-0ee3-4703-832f-5c5537bb8a9d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:15.839627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c6f64-f2c0-4755-90d8-f2e5719ea718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:15.841266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c6f64-f2c0-4755-90d8-f2e5719ea718 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:15.901093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1c6d-0ee3-4703-832f-5c5537bb8a9d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:15.934446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dcd6e-2434-4843-b948-a14ccfe72e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:15.935085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dcd6e-2434-4843-b948-a14ccfe72e39 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:15.935366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dcd6e-2434-4843-b948-a14ccfe72e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:15.935640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dcd6e-2434-4843-b948-a14ccfe72e39 None admin] PATH_INFO: `/v3/users/1346a82e96a54c0884b956d4511e0c94` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:15.936818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dcd6e-2434-4843-b948-a14ccfe72e39 None admin] RBAC: Authorizing `identity:get_user(user_id=1346a82e96a54c0884b956d4511e0c94)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:15.937144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 18 06:10:15.938289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dcd6e-2434-4843-b948-a14ccfe72e39 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:15.939873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:15 2022] GET /identity/v3/users/1346a82e96a54c0884b956d4511e0c94 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:15.942858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c6f64-f2c0-4755-90d8-f2e5719ea718 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:15.945146 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dcd6e-2434-4843-b948-a14ccfe72e39 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:15.946133 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:15.960050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:16.041760 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c6f64-f2c0-4755-90d8-f2e5719ea718 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:16.044710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dcd6e-2434-4843-b948-a14ccfe72e39 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:16.074757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3939963-4ec2-42fc-be99-b408accc0813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:16.075612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3939963-4ec2-42fc-be99-b408accc0813 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:16.075893 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3939963-4ec2-42fc-be99-b408accc0813 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:16.076190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3939963-4ec2-42fc-be99-b408accc0813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:16.078855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaea98-fb25-40a7-8d5e-be976e42cd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:16.079474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaea98-fb25-40a7-8d5e-be976e42cd02 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:16.079752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaea98-fb25-40a7-8d5e-be976e42cd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:16.080063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaea98-fb25-40a7-8d5e-be976e42cd02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:16.081169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adaea98-fb25-40a7-8d5e-be976e42cd02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:16.082611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adaea98-fb25-40a7-8d5e-be976e42cd02 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:16.084713 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:16.090635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaea98-fb25-40a7-8d5e-be976e42cd02 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:16.095097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3939963-4ec2-42fc-be99-b408accc0813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:16.096600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3939963-4ec2-42fc-be99-b408accc0813 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a3939963-4ec2-42fc-be99-b408accc0813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:10:16.114680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:16.116854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:10:16.117857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:10:16.117857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:10:16.117857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:16.117857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:16.122344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3939963-4ec2-42fc-be99-b408accc0813 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:16.174564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:16.178143 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:16.195684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaea98-fb25-40a7-8d5e-be976e42cd02 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:16.224021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3939963-4ec2-42fc-be99-b408accc0813 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:16.229171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19ea2d-c997-4120-a612-8f615974e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:16.229775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19ea2d-c997-4120-a612-8f615974e130 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:16.230057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19ea2d-c997-4120-a612-8f615974e130 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:16.230336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19ea2d-c997-4120-a612-8f615974e130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:16.231060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19ea2d-c997-4120-a612-8f615974e130 None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.domain.id=default, user.id=1346a82e96a54c0884b956d4511e0c94) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:16.231365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19ea2d-c997-4120-a612-8f615974e130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:16.232859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19ea2d-c997-4120-a612-8f615974e130 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:16.239343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Sun Sep 18 06:10:16 2022] GET /identity/v3/role_assignments?user.id=1346a82e96a54c0884b956d4511e0c94&scope.domain.id=default&role.id=4494ba66c3f649febc69511a47e27b67 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:16.258814 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e29255-9fe5-4e7d-ac49-341824b7cc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:16.259449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29255-9fe5-4e7d-ac49-341824b7cc26 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:16.260021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29255-9fe5-4e7d-ac49-341824b7cc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:16.260299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29255-9fe5-4e7d-ac49-341824b7cc26 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:16.260965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e29255-9fe5-4e7d-ac49-341824b7cc26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:16.261272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e29255-9fe5-4e7d-ac49-341824b7cc26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:16.262720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e29255-9fe5-4e7d-ac49-341824b7cc26 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:16.284355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:18.645061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c628b7-1e61-4f2c-bb4c-b663e76e7e4f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:18.646080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c628b7-1e61-4f2c-bb4c-b663e76e7e4f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:18.646757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c628b7-1e61-4f2c-bb4c-b663e76e7e4f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:18.648326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:18.653694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30ea5-1c43-445d-bda9-aa882f868823 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:18.654563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30ea5-1c43-445d-bda9-aa882f868823 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:18.655052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30ea5-1c43-445d-bda9-aa882f868823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:18.681973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f7c30ea5-1c43-445d-bda9-aa882f868823 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:18.683144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f7c30ea5-1c43-445d-bda9-aa882f868823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:18.757589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:18.857571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b78496-34d8-47e1-924d-a5039e6bd2ab None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:18.858068 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b78496-34d8-47e1-924d-a5039e6bd2ab None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:18.858486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b78496-34d8-47e1-924d-a5039e6bd2ab None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:18.860290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:18.865632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994c86-9f08-46bd-b7a8-21cbd933d571 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:18.865917 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994c86-9f08-46bd-b7a8-21cbd933d571 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:18.866191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994c86-9f08-46bd-b7a8-21cbd933d571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:18.886331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-38994c86-9f08-46bd-b7a8-21cbd933d571 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:18.887533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-38994c86-9f08-46bd-b7a8-21cbd933d571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:18.939349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:18.967283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:19.128703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2934-f7f3-4194-9170-75e8c49b6960 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:19.129336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2934-f7f3-4194-9170-75e8c49b6960 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:19.129814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2934-f7f3-4194-9170-75e8c49b6960 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:19.132102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 14/26] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:19.145266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119a018-3e35-42cc-ac35-3aae7165dc42 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:19.145811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119a018-3e35-42cc-ac35-3aae7165dc42 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:19.146973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119a018-3e35-42cc-ac35-3aae7165dc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:19.168900 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f119a018-3e35-42cc-ac35-3aae7165dc42 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:19.170369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f119a018-3e35-42cc-ac35-3aae7165dc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:19.221794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d2934-f7f3-4194-9170-75e8c49b6960 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:19.287763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:19.377458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d2934-f7f3-4194-9170-75e8c49b6960 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:19.390157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119a018-3e35-42cc-ac35-3aae7165dc42 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:19.426545 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0957e9d-9ea3-4e23-97eb-d4f3ffc7a443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:19.427171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0957e9d-9ea3-4e23-97eb-d4f3ffc7a443 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:19.427644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0957e9d-9ea3-4e23-97eb-d4f3ffc7a443 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:19.427943 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0957e9d-9ea3-4e23-97eb-d4f3ffc7a443 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:19.448013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0957e9d-9ea3-4e23-97eb-d4f3ffc7a443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-a0957e9d-9ea3-4e23-97eb-d4f3ffc7a443 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:19.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:19.454533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:19.455293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:19.457357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 15/28] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:10:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:10:19.465346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0957e9d-9ea3-4e23-97eb-d4f3ffc7a443 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:19.470670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:19.538951 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119a018-3e35-42cc-ac35-3aae7165dc42 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:19.558690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:19.600646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0957e9d-9ea3-4e23-97eb-d4f3ffc7a443 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:19.605476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661541d-c5d5-4b80-b3e8-52f8eccf5892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:19.606138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661541d-c5d5-4b80-b3e8-52f8eccf5892 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:19.606401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661541d-c5d5-4b80-b3e8-52f8eccf5892 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:19.606678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661541d-c5d5-4b80-b3e8-52f8eccf5892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:19.622002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661541d-c5d5-4b80-b3e8-52f8eccf5892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:19.623500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661541d-c5d5-4b80-b3e8-52f8eccf5892 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:19.637885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72230632-9c56-4132-86d8-d83d7eb7f9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:19.638795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230632-9c56-4132-86d8-d83d7eb7f9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:19.639281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230632-9c56-4132-86d8-d83d7eb7f9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:19.639693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72230632-9c56-4132-86d8-d83d7eb7f9e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:19.640576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72230632-9c56-4132-86d8-d83d7eb7f9e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:19.641013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72230632-9c56-4132-86d8-d83d7eb7f9e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:19.642539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72230632-9c56-4132-86d8-d83d7eb7f9e3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:19.653325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 16/29] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:19.660829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72230632-9c56-4132-86d8-d83d7eb7f9e3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b661541d-c5d5-4b80-b3e8-52f8eccf5892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:10:19.664545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:19.665681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:10:19.666470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:10:19.666470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:10:19.666470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:19.666470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 14/30] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:10:19.678951 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661541d-c5d5-4b80-b3e8-52f8eccf5892 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:19.769819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:19.807172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72230632-9c56-4132-86d8-d83d7eb7f9e3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:19.838790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661541d-c5d5-4b80-b3e8-52f8eccf5892 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:19.846636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eccf90-a7b7-49cd-8667-188ec0b94318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:19.847432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eccf90-a7b7-49cd-8667-188ec0b94318 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:19.847852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eccf90-a7b7-49cd-8667-188ec0b94318 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:19.848286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eccf90-a7b7-49cd-8667-188ec0b94318 None admin] PATH_INFO: `/v3/users/1346a82e96a54c0884b956d4511e0c94` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:19.849793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eccf90-a7b7-49cd-8667-188ec0b94318 None admin] RBAC: Authorizing `identity:get_user(user_id=1346a82e96a54c0884b956d4511e0c94)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:19.851578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eccf90-a7b7-49cd-8667-188ec0b94318 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:19.853408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 17/31] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:19 2022] GET /identity/v3/users/1346a82e96a54c0884b956d4511e0c94 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:19.854293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eccf90-a7b7-49cd-8667-188ec0b94318 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:19.879996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7ccba-b6eb-4cc6-88ca-4d1a90d220ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:19.881298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ccba-b6eb-4cc6-88ca-4d1a90d220ee None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:19.881687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ccba-b6eb-4cc6-88ca-4d1a90d220ee None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:19.882289 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7ccba-b6eb-4cc6-88ca-4d1a90d220ee None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:19.882999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7ccba-b6eb-4cc6-88ca-4d1a90d220ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:19.883373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7ccba-b6eb-4cc6-88ca-4d1a90d220ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:19.885328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7ccba-b6eb-4cc6-88ca-4d1a90d220ee None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:19.898685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 15/32] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:19.900083 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a823a6-de3d-48e7-a7a2-99c0ba4b029a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:19.900495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a823a6-de3d-48e7-a7a2-99c0ba4b029a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:19.900925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a823a6-de3d-48e7-a7a2-99c0ba4b029a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:19.902389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:19.903232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a823a6-de3d-48e7-a7a2-99c0ba4b029a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:19.926439 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:19.964764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eccf90-a7b7-49cd-8667-188ec0b94318 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:20.004825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fbb9a-f450-4813-b2a5-2ada6823cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:20.006476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fbb9a-f450-4813-b2a5-2ada6823cebe None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:20.007046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fbb9a-f450-4813-b2a5-2ada6823cebe None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:20.007562 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fbb9a-f450-4813-b2a5-2ada6823cebe None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:20.008517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fbb9a-f450-4813-b2a5-2ada6823cebe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:20.010393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fbb9a-f450-4813-b2a5-2ada6823cebe None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:20.014633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:20.033042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a823a6-de3d-48e7-a7a2-99c0ba4b029a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:20.069818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb969acd-25c5-4653-b764-b193bff998ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:20.070401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb969acd-25c5-4653-b764-b193bff998ee None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:20.070681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb969acd-25c5-4653-b764-b193bff998ee None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:20.070956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb969acd-25c5-4653-b764-b193bff998ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:20.072314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb969acd-25c5-4653-b764-b193bff998ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:20.073744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb969acd-25c5-4653-b764-b193bff998ee None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:20.075303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 17/34] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:20.076125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb969acd-25c5-4653-b764-b193bff998ee None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:20.152832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 18/35] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 18 06:10:19 2022] POST /identity/v3/roles => generated 219 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:10:20.154651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18afad-08ef-4192-aef5-09ff55a22d73 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:20.155198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18afad-08ef-4192-aef5-09ff55a22d73 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:20.155670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18afad-08ef-4192-aef5-09ff55a22d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:20.191119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:20.196694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1e18afad-08ef-4192-aef5-09ff55a22d73 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:20.200449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1e18afad-08ef-4192-aef5-09ff55a22d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:20.236593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb969acd-25c5-4653-b764-b193bff998ee None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:20.326579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c463c-506b-4818-800f-6b6d100a2958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:20.328601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c463c-506b-4818-800f-6b6d100a2958 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:20.330734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c463c-506b-4818-800f-6b6d100a2958 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:20.331249 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c463c-506b-4818-800f-6b6d100a2958 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:20.333305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c463c-506b-4818-800f-6b6d100a2958 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:20.338946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c463c-506b-4818-800f-6b6d100a2958 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:20.363109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 19/36] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:20.363995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18afad-08ef-4192-aef5-09ff55a22d73 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:20.477300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18afad-08ef-4192-aef5-09ff55a22d73 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:20.503162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:20.517513 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4e095-14cc-411a-b098-b2913e0d1257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:20.518594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4e095-14cc-411a-b098-b2913e0d1257 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:20.519070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4e095-14cc-411a-b098-b2913e0d1257 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:20.519543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4e095-14cc-411a-b098-b2913e0d1257 None admin] PATH_INFO: `/v3/domains/default/users/1346a82e96a54c0884b956d4511e0c94/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:20.522279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4e095-14cc-411a-b098-b2913e0d1257 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1346a82e96a54c0884b956d4511e0c94, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:20.524154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4e095-14cc-411a-b098-b2913e0d1257 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:20.552227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 20/37] 10.222.0.16 () {58 vars in 1361 bytes} [Sun Sep 18 06:10:20 2022] PUT /identity/v3/domains/default/users/1346a82e96a54c0884b956d4511e0c94/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:10:20.559529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 18/38] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:10:20 2022] POST /identity/v3/projects => generated 301 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:10:20.669860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4e095-14cc-411a-b098-b2913e0d1257 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:20.746959 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb063-6078-4269-9822-55a77c4b800a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:20.747492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb063-6078-4269-9822-55a77c4b800a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:20.747492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb063-6078-4269-9822-55a77c4b800a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:20.750492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 19/39] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:10:20.755579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecfcc7-47a7-4bbc-832d-57e7cae38b3b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:20.756009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecfcc7-47a7-4bbc-832d-57e7cae38b3b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:20.756608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecfcc7-47a7-4bbc-832d-57e7cae38b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:20.779404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-eeecfcc7-47a7-4bbc-832d-57e7cae38b3b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:20.780515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eeecfcc7-47a7-4bbc-832d-57e7cae38b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:20.817256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4e095-14cc-411a-b098-b2913e0d1257 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:20.867287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e59ee0-f216-432b-b4b6-abec19cd264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:20.867951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e59ee0-f216-432b-b4b6-abec19cd264a None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:20.868219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e59ee0-f216-432b-b4b6-abec19cd264a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:20.868497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e59ee0-f216-432b-b4b6-abec19cd264a None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:20.869173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e59ee0-f216-432b-b4b6-abec19cd264a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:20.870598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e59ee0-f216-432b-b4b6-abec19cd264a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:20.874033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 20/40] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:20.875525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd9dac-ba79-4cbf-834b-566c759d48f6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:20.876046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd9dac-ba79-4cbf-834b-566c759d48f6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:20.876652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd9dac-ba79-4cbf-834b-566c759d48f6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:20.878471 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 21/41] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:20.886238 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2410ee4-9d60-48d4-84e7-87d2d1986df0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:20.887229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2410ee4-9d60-48d4-84e7-87d2d1986df0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:20.887705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2410ee4-9d60-48d4-84e7-87d2d1986df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:20.892157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 18 06:10:20 2022] POST /identity/v3/roles => generated 225 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:10:20.909226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d2410ee4-9d60-48d4-84e7-87d2d1986df0 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:20.910950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d2410ee4-9d60-48d4-84e7-87d2d1986df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:20.988973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:20.993322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:21.153253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e59ee0-f216-432b-b4b6-abec19cd264a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:21.201245 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:21.261232 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e59ee0-f216-432b-b4b6-abec19cd264a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:21.263557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2410ee4-9d60-48d4-84e7-87d2d1986df0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:21.298251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86c30d-bb49-40e6-a62a-da688fbe95a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:21.298886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c30d-bb49-40e6-a62a-da688fbe95a2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:21.299167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c30d-bb49-40e6-a62a-da688fbe95a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:21.299445 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c30d-bb49-40e6-a62a-da688fbe95a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:21.300570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86c30d-bb49-40e6-a62a-da688fbe95a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:21.302027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86c30d-bb49-40e6-a62a-da688fbe95a2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:21.303869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 22/44] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:21.309387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86c30d-bb49-40e6-a62a-da688fbe95a2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:21.372481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2410ee4-9d60-48d4-84e7-87d2d1986df0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:21.410838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5017bd9-ceef-4586-96fb-9f631611bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:21.412525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5017bd9-ceef-4586-96fb-9f631611bbf3 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:21.412992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5017bd9-ceef-4586-96fb-9f631611bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:21.413473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5017bd9-ceef-4586-96fb-9f631611bbf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:21.414400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5017bd9-ceef-4586-96fb-9f631611bbf3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:21.416149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5017bd9-ceef-4586-96fb-9f631611bbf3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:21.433606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 18 06:10:21 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:10:21.531170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86c30d-bb49-40e6-a62a-da688fbe95a2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:21.546114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:21.569932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837be981-11ea-46c2-9464-3372b0d3abc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:21.570560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837be981-11ea-46c2-9464-3372b0d3abc4 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:21.570845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837be981-11ea-46c2-9464-3372b0d3abc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:21.571123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837be981-11ea-46c2-9464-3372b0d3abc4 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:21.571796 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837be981-11ea-46c2-9464-3372b0d3abc4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:21.573317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837be981-11ea-46c2-9464-3372b0d3abc4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:21.607427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:10:21 2022] POST /identity/v3/projects => generated 312 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:10:22.886474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b6f90-5940-48c7-ae6c-2ed84850fecf None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:22.887003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b6f90-5940-48c7-ae6c-2ed84850fecf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:22.887003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b6f90-5940-48c7-ae6c-2ed84850fecf None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:22.888373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:22.893497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff038b0-d969-4e6b-8251-a52821beb740 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:22.893940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff038b0-d969-4e6b-8251-a52821beb740 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:22.894122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff038b0-d969-4e6b-8251-a52821beb740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:22.913461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5ff038b0-d969-4e6b-8251-a52821beb740 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:22.914640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5ff038b0-d969-4e6b-8251-a52821beb740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:22.978824 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:23.254267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b6f90-5940-48c7-ae6c-2ed84850fecf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:23.314789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:23.358086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b6f90-5940-48c7-ae6c-2ed84850fecf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:23.392132 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f38e04-ee64-4b3e-a959-9ee78a20e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:23.392765 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f38e04-ee64-4b3e-a959-9ee78a20e899 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:23.393046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f38e04-ee64-4b3e-a959-9ee78a20e899 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:23.393324 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f38e04-ee64-4b3e-a959-9ee78a20e899 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:23.405500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f38e04-ee64-4b3e-a959-9ee78a20e899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-87f38e04-ee64-4b3e-a959-9ee78a20e899 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:23.411447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:23.412611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:23.413423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:23.416053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:23.418348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff038b0-d969-4e6b-8251-a52821beb740 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:23.508440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:23.516496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff038b0-d969-4e6b-8251-a52821beb740 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:23.548509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ee184-765e-4c22-af10-e3f8ce4e379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:23.549107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee184-765e-4c22-af10-e3f8ce4e379d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:23.549386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee184-765e-4c22-af10-e3f8ce4e379d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:23.549660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee184-765e-4c22-af10-e3f8ce4e379d None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:23.550315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ee184-765e-4c22-af10-e3f8ce4e379d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:23.550614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ee184-765e-4c22-af10-e3f8ce4e379d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:23.552554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ee184-765e-4c22-af10-e3f8ce4e379d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:23.560455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 25/50] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:23.566099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f38e04-ee64-4b3e-a959-9ee78a20e899 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:23.671067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f38e04-ee64-4b3e-a959-9ee78a20e899 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:23.688626 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:23.706607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b4961-52e0-4bbd-aea9-5ad74c40c59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:23.707251 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4961-52e0-4bbd-aea9-5ad74c40c59d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:23.707530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4961-52e0-4bbd-aea9-5ad74c40c59d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:23.707806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b4961-52e0-4bbd-aea9-5ad74c40c59d None admin] PATH_INFO: `/v3/users/1346a82e96a54c0884b956d4511e0c94` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:23.709851 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b4961-52e0-4bbd-aea9-5ad74c40c59d None admin] RBAC: Authorizing `identity:get_user(user_id=1346a82e96a54c0884b956d4511e0c94)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:23.711277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b4961-52e0-4bbd-aea9-5ad74c40c59d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:23.712873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 26/51] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:23 2022] GET /identity/v3/users/1346a82e96a54c0884b956d4511e0c94 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:23.718347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ee184-765e-4c22-af10-e3f8ce4e379d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:23.764438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4333-8250-4ff9-8c0d-e6ab356eee3a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:23.764648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4333-8250-4ff9-8c0d-e6ab356eee3a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:23.764926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4333-8250-4ff9-8c0d-e6ab356eee3a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:23.766278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 27/52] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:10:23.772002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cc26-319e-4a12-83ec-0cba0b66c8d5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:23.772309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cc26-319e-4a12-83ec-0cba0b66c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:23.772585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7cc26-319e-4a12-83ec-0cba0b66c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:23.790738 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e0b7cc26-319e-4a12-83ec-0cba0b66c8d5 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:23.791961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e0b7cc26-319e-4a12-83ec-0cba0b66c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:23.817932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ee184-765e-4c22-af10-e3f8ce4e379d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:23.856522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c1843-bfc3-4a37-96ba-cb71e257f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:23.857148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c1843-bfc3-4a37-96ba-cb71e257f021 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:23.857425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c1843-bfc3-4a37-96ba-cb71e257f021 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:23.857695 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c1843-bfc3-4a37-96ba-cb71e257f021 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:23.858790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c1843-bfc3-4a37-96ba-cb71e257f021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:23.860265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c1843-bfc3-4a37-96ba-cb71e257f021 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:23.860395 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 28/53] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:23.861825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 26/54] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:23.867622 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7cc26-319e-4a12-83ec-0cba0b66c8d5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:23.964081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7cc26-319e-4a12-83ec-0cba0b66c8d5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:24.084345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:24.102166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c1fe2-0d5f-4765-bda0-2b9e7e0c7e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:24.102764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c1fe2-0d5f-4765-bda0-2b9e7e0c7e32 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:24.103042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c1fe2-0d5f-4765-bda0-2b9e7e0c7e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:24.103315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c1fe2-0d5f-4765-bda0-2b9e7e0c7e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:24.104052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c1fe2-0d5f-4765-bda0-2b9e7e0c7e32 None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.domain.id=default, user.id=1346a82e96a54c0884b956d4511e0c94) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:24.104358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c1fe2-0d5f-4765-bda0-2b9e7e0c7e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:24.105782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c1fe2-0d5f-4765-bda0-2b9e7e0c7e32 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:24.114127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 29/55] 10.222.0.16 () {56 vars in 1322 bytes} [Sun Sep 18 06:10:23 2022] GET /identity/v3/role_assignments?user.id=1346a82e96a54c0884b956d4511e0c94&scope.domain.id=default&role.id=4494ba66c3f649febc69511a47e27b67 => generated 530 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:24.127499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c1843-bfc3-4a37-96ba-cb71e257f021 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:24.156463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:24.234601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c1843-bfc3-4a37-96ba-cb71e257f021 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:24.270945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a917fc-c789-43db-be11-e7be43fdc5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:24.271671 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a917fc-c789-43db-be11-e7be43fdc5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:24.271974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a917fc-c789-43db-be11-e7be43fdc5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:24.272254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a917fc-c789-43db-be11-e7be43fdc5e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:24.273398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a917fc-c789-43db-be11-e7be43fdc5e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:24.274880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a917fc-c789-43db-be11-e7be43fdc5e8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:24.276497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 27/56] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:24.282210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c1fe2-0d5f-4765-bda0-2b9e7e0c7e32 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:24.390419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c1fe2-0d5f-4765-bda0-2b9e7e0c7e32 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:24.422644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d6897-747c-4773-b551-6a63170b47a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:24.423240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d6897-747c-4773-b551-6a63170b47a5 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:24.423519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d6897-747c-4773-b551-6a63170b47a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:24.423793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d6897-747c-4773-b551-6a63170b47a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:24.424472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d6897-747c-4773-b551-6a63170b47a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:24.425900 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d6897-747c-4773-b551-6a63170b47a5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:24.452695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 30/57] 10.222.0.16 () {60 vars in 1140 bytes} [Sun Sep 18 06:10:24 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:10:26.591100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab1161-d780-4f55-9a24-be45ef3bfc6c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:26.591640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab1161-d780-4f55-9a24-be45ef3bfc6c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:26.591640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab1161-d780-4f55-9a24-be45ef3bfc6c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:26.593012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 28/58] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:26.598144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3a7d3-82ee-45a6-a435-048b6a2673af None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:26.598553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3a7d3-82ee-45a6-a435-048b6a2673af None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:26.598689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3a7d3-82ee-45a6-a435-048b6a2673af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:26.617291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-83e3a7d3-82ee-45a6-a435-048b6a2673af None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:26.618518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-83e3a7d3-82ee-45a6-a435-048b6a2673af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:26.643335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:26.685219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 31/59] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:26.956081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab1161-d780-4f55-9a24-be45ef3bfc6c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:27.045999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:27.055804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab1161-d780-4f55-9a24-be45ef3bfc6c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:27.088117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c774656-975a-4686-84b3-e1e2ca311636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:27.088727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c774656-975a-4686-84b3-e1e2ca311636 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:27.089010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c774656-975a-4686-84b3-e1e2ca311636 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:27.089281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c774656-975a-4686-84b3-e1e2ca311636 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:27.090376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c774656-975a-4686-84b3-e1e2ca311636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:27.091819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c774656-975a-4686-84b3-e1e2ca311636 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:27.093370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 29/60] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:27.098779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3a7d3-82ee-45a6-a435-048b6a2673af None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:27.193290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3a7d3-82ee-45a6-a435-048b6a2673af None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:27.226223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ac65-7431-4ed2-abbe-bf6574febe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:27.226765 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ac65-7431-4ed2-abbe-bf6574febe55 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:27.227047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ac65-7431-4ed2-abbe-bf6574febe55 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:27.227346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ac65-7431-4ed2-abbe-bf6574febe55 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:27.228028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ac65-7431-4ed2-abbe-bf6574febe55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:27.229475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ac65-7431-4ed2-abbe-bf6574febe55 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:27.256605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 32/61] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:10:27 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:10:30.465361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8314-b880-40a4-a3fc-a9401844e61e None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:30.465868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8314-b880-40a4-a3fc-a9401844e61e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:30.465868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8314-b880-40a4-a3fc-a9401844e61e None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:30.467227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 30/62] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:30.474560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55def3-4af2-4318-a7bf-a406dc12741f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:30.475008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55def3-4af2-4318-a7bf-a406dc12741f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:30.475185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55def3-4af2-4318-a7bf-a406dc12741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:30.501102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4e55def3-4af2-4318-a7bf-a406dc12741f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:30.502312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4e55def3-4af2-4318-a7bf-a406dc12741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:30.522878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:30.601373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 33/63] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:30.814642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702cf89-7c1e-4256-80a1-8870b15aa83c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:30.815336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702cf89-7c1e-4256-80a1-8870b15aa83c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:30.815831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702cf89-7c1e-4256-80a1-8870b15aa83c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:30.818153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 31/64] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:30.829871 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedcce4-1082-46d2-a58f-507ed604f420 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:30.830081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedcce4-1082-46d2-a58f-507ed604f420 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:30.830537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedcce4-1082-46d2-a58f-507ed604f420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:30.859358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fbedcce4-1082-46d2-a58f-507ed604f420 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:30.864371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fbedcce4-1082-46d2-a58f-507ed604f420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:30.929682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a1bcd-c13b-4c78-a91a-ec6de4f68113 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:30.930305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a1bcd-c13b-4c78-a91a-ec6de4f68113 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:30.930809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a1bcd-c13b-4c78-a91a-ec6de4f68113 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:30.932422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 32/65] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:30.937639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c38f-be7a-4400-92dd-ee69f1ea488a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:30.938150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c38f-be7a-4400-92dd-ee69f1ea488a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:30.938622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759c38f-be7a-4400-92dd-ee69f1ea488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:30.957373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 34/66] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:30.965030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0759c38f-be7a-4400-92dd-ee69f1ea488a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:30.966450 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0759c38f-be7a-4400-92dd-ee69f1ea488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:31.001504 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedcce4-1082-46d2-a58f-507ed604f420 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:31.101370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 33/67] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:31.136086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:31.160575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedcce4-1082-46d2-a58f-507ed604f420 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:31.195857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82627f9-16d9-4b0b-b8c7-19a2817f0fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:31.196739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82627f9-16d9-4b0b-b8c7-19a2817f0fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.197158 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82627f9-16d9-4b0b-b8c7-19a2817f0fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.197602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82627f9-16d9-4b0b-b8c7-19a2817f0fe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:31.208932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82627f9-16d9-4b0b-b8c7-19a2817f0fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:31.211717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aea01-db81-48df-aa79-8e825c2663d9 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.212036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aea01-db81-48df-aa79-8e825c2663d9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.212319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aea01-db81-48df-aa79-8e825c2663d9 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:31.213800 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 34/68] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a82627f9-16d9-4b0b-b8c7-19a2817f0fe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:31.215242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:31.216234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:31.217180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:31.219101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:10:31.225570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae40bc-6129-4b70-b680-661eb6e98871 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.225863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae40bc-6129-4b70-b680-661eb6e98871 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.226146 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae40bc-6129-4b70-b680-661eb6e98871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:31.226859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82627f9-16d9-4b0b-b8c7-19a2817f0fe5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:31.252612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8fae40bc-6129-4b70-b680-661eb6e98871 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:31.253819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8fae40bc-6129-4b70-b680-661eb6e98871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:31.327129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 35/70] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:31.328518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6e29-651b-45a8-b7f0-dc19a23938de None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.328808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6e29-651b-45a8-b7f0-dc19a23938de None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.329087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6e29-651b-45a8-b7f0-dc19a23938de None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:31.330325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 36/71] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:31.331028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6e29-651b-45a8-b7f0-dc19a23938de None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:31.357361 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82627f9-16d9-4b0b-b8c7-19a2817f0fe5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:31.367056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:31.397354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837dd8d-e88e-430a-861f-9cf5ae42c5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:31.398322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837dd8d-e88e-430a-861f-9cf5ae42c5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.398777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837dd8d-e88e-430a-861f-9cf5ae42c5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.399366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837dd8d-e88e-430a-861f-9cf5ae42c5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:31.400339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837dd8d-e88e-430a-861f-9cf5ae42c5e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:31.400870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837dd8d-e88e-430a-861f-9cf5ae42c5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:31.402512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837dd8d-e88e-430a-861f-9cf5ae42c5e7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:31.417037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:31.417312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:31.419202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64b0ee-8b15-474b-8fce-7a8dfaacd4ec None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.419688 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64b0ee-8b15-474b-8fce-7a8dfaacd4ec None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.420317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64b0ee-8b15-474b-8fce-7a8dfaacd4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:31.440783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1b64b0ee-8b15-474b-8fce-7a8dfaacd4ec None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:31.441987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1b64b0ee-8b15-474b-8fce-7a8dfaacd4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:31.454195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6e29-651b-45a8-b7f0-dc19a23938de None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:31.489873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcdf3a-8f71-4005-aeae-1eb7b0b573cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:31.491156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcdf3a-8f71-4005-aeae-1eb7b0b573cc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.491587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcdf3a-8f71-4005-aeae-1eb7b0b573cc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.491858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcdf3a-8f71-4005-aeae-1eb7b0b573cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:31.502446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcdf3a-8f71-4005-aeae-1eb7b0b573cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0fbcdf3a-8f71-4005-aeae-1eb7b0b573cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:31.507958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:31.508832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:31.512812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcdf3a-8f71-4005-aeae-1eb7b0b573cc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:31.518722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 37/74] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:31.520463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64b0ee-8b15-474b-8fce-7a8dfaacd4ec None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:31.613507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:31.635235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcdf3a-8f71-4005-aeae-1eb7b0b573cc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:31.635573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64b0ee-8b15-474b-8fce-7a8dfaacd4ec None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:31.667074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:31.672269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9d1c8-d6cf-4f17-9012-14d66548f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:31.672903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d1c8-d6cf-4f17-9012-14d66548f217 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.673186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d1c8-d6cf-4f17-9012-14d66548f217 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.673462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d1c8-d6cf-4f17-9012-14d66548f217 None admin] PATH_INFO: `/v3/users/1346a82e96a54c0884b956d4511e0c94` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:31.673990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae1eef-60e6-4837-b40a-de7a02878e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:31.674602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9d1c8-d6cf-4f17-9012-14d66548f217 None admin] RBAC: Authorizing `identity:get_user(user_id=1346a82e96a54c0884b956d4511e0c94)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:31.674698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae1eef-60e6-4837-b40a-de7a02878e16 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.674884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae1eef-60e6-4837-b40a-de7a02878e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.675157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae1eef-60e6-4837-b40a-de7a02878e16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:31.676092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9d1c8-d6cf-4f17-9012-14d66548f217 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:31.680019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:31 2022] GET /identity/v3/users/1346a82e96a54c0884b956d4511e0c94 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:31.680019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9d1c8-d6cf-4f17-9012-14d66548f217 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:31.691677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae1eef-60e6-4837-b40a-de7a02878e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-00ae1eef-60e6-4837-b40a-de7a02878e16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:31.697734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:31.698567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:31.699722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 38/76] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:31.704417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae1eef-60e6-4837-b40a-de7a02878e16 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:31.782316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9d1c8-d6cf-4f17-9012-14d66548f217 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:31.813256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae1eef-60e6-4837-b40a-de7a02878e16 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:31.818763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae121bbb-2734-4bdf-a0cb-9a9ce1d51564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:31.819370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae121bbb-2734-4bdf-a0cb-9a9ce1d51564 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.819651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae121bbb-2734-4bdf-a0cb-9a9ce1d51564 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.819948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae121bbb-2734-4bdf-a0cb-9a9ce1d51564 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:31.820609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae121bbb-2734-4bdf-a0cb-9a9ce1d51564 None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:31.820913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae121bbb-2734-4bdf-a0cb-9a9ce1d51564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:31.822305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae121bbb-2734-4bdf-a0cb-9a9ce1d51564 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:31.832572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 39/77] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:31.838353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae121bbb-2734-4bdf-a0cb-9a9ce1d51564 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:31.846306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:31.852013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a993e-2c01-4a39-97f5-491939ae49d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:31.852644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a993e-2c01-4a39-97f5-491939ae49d3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.852923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a993e-2c01-4a39-97f5-491939ae49d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.853203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a993e-2c01-4a39-97f5-491939ae49d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:31.863374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a993e-2c01-4a39-97f5-491939ae49d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-770a993e-2c01-4a39-97f5-491939ae49d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:31.868885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:31.869907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 39/78] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:10:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:31.870862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a993e-2c01-4a39-97f5-491939ae49d3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:31.921385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:31.937226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae121bbb-2734-4bdf-a0cb-9a9ce1d51564 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:31.970659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff3921-cfdb-4c0a-be1b-33808b0ee9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:31.971081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a993e-2c01-4a39-97f5-491939ae49d3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:31.971262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff3921-cfdb-4c0a-be1b-33808b0ee9cc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:31.971539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff3921-cfdb-4c0a-be1b-33808b0ee9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:31.971815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff3921-cfdb-4c0a-be1b-33808b0ee9cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.004140 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a0ea4-52a5-48c9-a5c5-ac8360bdcb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:32.005312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0ea4-52a5-48c9-a5c5-ac8360bdcb29 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:32.005590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0ea4-52a5-48c9-a5c5-ac8360bdcb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:32.005865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0ea4-52a5-48c9-a5c5-ac8360bdcb29 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.006522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a0ea4-52a5-48c9-a5c5-ac8360bdcb29 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:32.006882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a0ea4-52a5-48c9-a5c5-ac8360bdcb29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:32.008334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a0ea4-52a5-48c9-a5c5-ac8360bdcb29 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:32.016573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:32.017183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a0ea4-52a5-48c9-a5c5-ac8360bdcb29 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:32.042087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff3921-cfdb-4c0a-be1b-33808b0ee9cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:32.043557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff3921-cfdb-4c0a-be1b-33808b0ee9cc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:32.054862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:32.115216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a0ea4-52a5-48c9-a5c5-ac8360bdcb29 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:32.127531 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:32.141268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 40/80] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:32.145273 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff3921-cfdb-4c0a-be1b-33808b0ee9cc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:32.150007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d06fe7-aba0-4d61-aeb3-e5dbf6dce83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:32.150636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d06fe7-aba0-4d61-aeb3-e5dbf6dce83c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:32.150917 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d06fe7-aba0-4d61-aeb3-e5dbf6dce83c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:32.151195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d06fe7-aba0-4d61-aeb3-e5dbf6dce83c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.152338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d06fe7-aba0-4d61-aeb3-e5dbf6dce83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:32.153793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d06fe7-aba0-4d61-aeb3-e5dbf6dce83c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:32.155585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 41/81] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:32.156129 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d06fe7-aba0-4d61-aeb3-e5dbf6dce83c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:32.242928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff3921-cfdb-4c0a-be1b-33808b0ee9cc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:32.253076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:32.255047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d06fe7-aba0-4d61-aeb3-e5dbf6dce83c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:32.276311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714c8c-2c43-4628-b406-c814b47bf34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:32.276937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714c8c-2c43-4628-b406-c814b47bf34e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:32.277217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714c8c-2c43-4628-b406-c814b47bf34e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:32.277498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c714c8c-2c43-4628-b406-c814b47bf34e None admin] PATH_INFO: `/v3/users/157f75ac057d4058925eb8b5162a75ee` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.288031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd7ee7-915e-45ec-a534-4b4aa766bf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:32.288633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7ee7-915e-45ec-a534-4b4aa766bf40 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:32.288922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7ee7-915e-45ec-a534-4b4aa766bf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:32.289199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7ee7-915e-45ec-a534-4b4aa766bf40 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.289858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd7ee7-915e-45ec-a534-4b4aa766bf40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:32.290167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd7ee7-915e-45ec-a534-4b4aa766bf40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:32.291370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c714c8c-2c43-4628-b406-c814b47bf34e None admin] RBAC: Authorizing `identity:get_user(user_id=157f75ac057d4058925eb8b5162a75ee)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:32.291548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd7ee7-915e-45ec-a534-4b4aa766bf40 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:32.292830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c714c8c-2c43-4628-b406-c814b47bf34e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:32.294427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 41/82] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:32 2022] GET /identity/v3/users/157f75ac057d4058925eb8b5162a75ee => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:32.295183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714c8c-2c43-4628-b406-c814b47bf34e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:32.304284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 42/83] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:10:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:32.304284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd7ee7-915e-45ec-a534-4b4aa766bf40 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:32.346051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:32.399032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c714c8c-2c43-4628-b406-c814b47bf34e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:32.401964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd7ee7-915e-45ec-a534-4b4aa766bf40 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:32.432358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed547c4-9090-419b-8b2b-819041caef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:32.432985 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed547c4-9090-419b-8b2b-819041caef96 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:32.433268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed547c4-9090-419b-8b2b-819041caef96 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:32.433545 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed547c4-9090-419b-8b2b-819041caef96 None admin] PATH_INFO: `/v3/users/157f75ac057d4058925eb8b5162a75ee` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.434722 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed547c4-9090-419b-8b2b-819041caef96 None admin] RBAC: Authorizing `identity:get_user(user_id=157f75ac057d4058925eb8b5162a75ee)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:32.434961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2e82b-db5d-4837-867f-965c192dad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:32.435588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2e82b-db5d-4837-867f-965c192dad2b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:32.435872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2e82b-db5d-4837-867f-965c192dad2b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:32.436184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2e82b-db5d-4837-867f-965c192dad2b None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.436277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed547c4-9090-419b-8b2b-819041caef96 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:32.437300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2e82b-db5d-4837-867f-965c192dad2b None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:32.437809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 42/84] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:32 2022] GET /identity/v3/users/157f75ac057d4058925eb8b5162a75ee => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:32.438547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed547c4-9090-419b-8b2b-819041caef96 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:32.438758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2e82b-db5d-4837-867f-965c192dad2b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:32.445687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 43/85] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:32 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:32.445687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2e82b-db5d-4837-867f-965c192dad2b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:32.473196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:32.537898 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed547c4-9090-419b-8b2b-819041caef96 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:32.548167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2e82b-db5d-4837-867f-965c192dad2b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:32.558444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:32.572331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2be69-541b-4ccc-9bd2-cdc75ff62f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:32.572943 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2be69-541b-4ccc-9bd2-cdc75ff62f79 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:32.573221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2be69-541b-4ccc-9bd2-cdc75ff62f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:32.573502 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2be69-541b-4ccc-9bd2-cdc75ff62f79 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.574152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2be69-541b-4ccc-9bd2-cdc75ff62f79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:32.575611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2be69-541b-4ccc-9bd2-cdc75ff62f79 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:32.581586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292867fa-ae79-43a3-ac50-3dbd472f6d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:32.582181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292867fa-ae79-43a3-ac50-3dbd472f6d9f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:32.582458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292867fa-ae79-43a3-ac50-3dbd472f6d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:32.583325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292867fa-ae79-43a3-ac50-3dbd472f6d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.602374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 43/86] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:10:32 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:10:32.604845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2be69-541b-4ccc-9bd2-cdc75ff62f79 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:32.659021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292867fa-ae79-43a3-ac50-3dbd472f6d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:32.660576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292867fa-ae79-43a3-ac50-3dbd472f6d9f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:32.714582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:32.725031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2be69-541b-4ccc-9bd2-cdc75ff62f79 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:32.765822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3101b3-a7d5-428e-8d68-e491ff6c0e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:32.766474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3101b3-a7d5-428e-8d68-e491ff6c0e76 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:32.766866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3101b3-a7d5-428e-8d68-e491ff6c0e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:32.767141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3101b3-a7d5-428e-8d68-e491ff6c0e76 None admin] PATH_INFO: `/v3/users/157f75ac057d4058925eb8b5162a75ee` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.768636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3101b3-a7d5-428e-8d68-e491ff6c0e76 None admin] RBAC: Authorizing `identity:get_user(user_id=157f75ac057d4058925eb8b5162a75ee)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:32.770307 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3101b3-a7d5-428e-8d68-e491ff6c0e76 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:32.771994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 44/87] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:32 2022] GET /identity/v3/users/157f75ac057d4058925eb8b5162a75ee => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:32.776646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3101b3-a7d5-428e-8d68-e491ff6c0e76 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:32.776743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 44/88] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:32.776743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292867fa-ae79-43a3-ac50-3dbd472f6d9f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:32.793042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:32.909020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292867fa-ae79-43a3-ac50-3dbd472f6d9f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:32.911304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3101b3-a7d5-428e-8d68-e491ff6c0e76 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:32.952436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8880e-140c-4f70-a178-95ddc33e1e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:32.952637 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d264f-a192-4f1d-b5f9-bbb73fc248f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:32.953042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8880e-140c-4f70-a178-95ddc33e1e5f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:32.953143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d264f-a192-4f1d-b5f9-bbb73fc248f7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:32.953310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d264f-a192-4f1d-b5f9-bbb73fc248f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:32.953399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8880e-140c-4f70-a178-95ddc33e1e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:32.953584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d264f-a192-4f1d-b5f9-bbb73fc248f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.953677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8880e-140c-4f70-a178-95ddc33e1e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:32.954342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8880e-140c-4f70-a178-95ddc33e1e5f None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385, user.id=1346a82e96a54c0884b956d4511e0c94) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:32.954651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8880e-140c-4f70-a178-95ddc33e1e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:32.956185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8880e-140c-4f70-a178-95ddc33e1e5f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:32.963448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 45/89] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:32 2022] GET /identity/v3/role_assignments?user.id=1346a82e96a54c0884b956d4511e0c94&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=4494ba66c3f649febc69511a47e27b67 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:32.964411 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8880e-140c-4f70-a178-95ddc33e1e5f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:32.985134 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:33.035194 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d264f-a192-4f1d-b5f9-bbb73fc248f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:33.037551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d264f-a192-4f1d-b5f9-bbb73fc248f7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:33.059627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:33.090856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8880e-140c-4f70-a178-95ddc33e1e5f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:33.132692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee0f51-3b3b-4111-b6fb-a0ea1e9c7688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:33.133687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee0f51-3b3b-4111-b6fb-a0ea1e9c7688 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:33.134400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee0f51-3b3b-4111-b6fb-a0ea1e9c7688 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:33.134818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee0f51-3b3b-4111-b6fb-a0ea1e9c7688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:33.172429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 45/90] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:33.172429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d264f-a192-4f1d-b5f9-bbb73fc248f7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:33.228240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee0f51-3b3b-4111-b6fb-a0ea1e9c7688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:33.230349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee0f51-3b3b-4111-b6fb-a0ea1e9c7688 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:33.244306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:33.310256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d264f-a192-4f1d-b5f9-bbb73fc248f7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:33.353477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18afb0-99eb-426d-9f65-f5e952d80dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:33.354151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18afb0-99eb-426d-9f65-f5e952d80dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:33.354436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18afb0-99eb-426d-9f65-f5e952d80dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:33.354710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18afb0-99eb-426d-9f65-f5e952d80dc2 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:33.355850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18afb0-99eb-426d-9f65-f5e952d80dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:33.357343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18afb0-99eb-426d-9f65-f5e952d80dc2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:33.364358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 46/91] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:33 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:33.364358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18afb0-99eb-426d-9f65-f5e952d80dc2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:33.376303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:33.422260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 46/92] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:33.425500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee0f51-3b3b-4111-b6fb-a0ea1e9c7688 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:33.532572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18afb0-99eb-426d-9f65-f5e952d80dc2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:33.563614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:33.572999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a87aa8-bbc0-41a0-a787-d85c5478332c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:33.573959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a87aa8-bbc0-41a0-a787-d85c5478332c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:33.574460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a87aa8-bbc0-41a0-a787-d85c5478332c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:33.575127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a87aa8-bbc0-41a0-a787-d85c5478332c None admin] PATH_INFO: `/v3/projects/6f68c623cbf447d785d67e05742dbd95` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:33.576488 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a87aa8-bbc0-41a0-a787-d85c5478332c None admin] RBAC: Authorizing `identity:get_project(project_id=6f68c623cbf447d785d67e05742dbd95)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:33.579217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a87aa8-bbc0-41a0-a787-d85c5478332c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:33.581791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 47/93] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:33 2022] GET /identity/v3/projects/6f68c623cbf447d785d67e05742dbd95 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:33.588312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a87aa8-bbc0-41a0-a787-d85c5478332c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:33.646379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee0f51-3b3b-4111-b6fb-a0ea1e9c7688 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:33.727852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc1b91-9a5d-4844-8bfc-5695260c5116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:33.728849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc1b91-9a5d-4844-8bfc-5695260c5116 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:33.729321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc1b91-9a5d-4844-8bfc-5695260c5116 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:33.729785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc1b91-9a5d-4844-8bfc-5695260c5116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:33.730770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc1b91-9a5d-4844-8bfc-5695260c5116 None admin] RBAC: Adding query filter params (role.id=3009ebffeb104922b00cd072c83920c0, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385, user.id=157f75ac057d4058925eb8b5162a75ee) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:33.731271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc1b91-9a5d-4844-8bfc-5695260c5116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:33.733665 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc1b91-9a5d-4844-8bfc-5695260c5116 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:33.744532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 47/94] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:33 2022] GET /identity/v3/role_assignments?user.id=157f75ac057d4058925eb8b5162a75ee&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=3009ebffeb104922b00cd072c83920c0 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:33.745812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc1b91-9a5d-4844-8bfc-5695260c5116 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:33.747862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a87aa8-bbc0-41a0-a787-d85c5478332c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:33.814912 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb59403-7e20-409f-82f0-d399ce163ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:33.815570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb59403-7e20-409f-82f0-d399ce163ccd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:33.815771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:33.815870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb59403-7e20-409f-82f0-d399ce163ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:33.816141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb59403-7e20-409f-82f0-d399ce163ccd None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:33.818039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb59403-7e20-409f-82f0-d399ce163ccd None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:33.819883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb59403-7e20-409f-82f0-d399ce163ccd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:33.824150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 48/95] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:33 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:33.832357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb59403-7e20-409f-82f0-d399ce163ccd None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:33.921625 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc1b91-9a5d-4844-8bfc-5695260c5116 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:33.940771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:33.987103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa00a5-7742-4606-8a64-a9e265cdc7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:33.987642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa00a5-7742-4606-8a64-a9e265cdc7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:33.987937 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa00a5-7742-4606-8a64-a9e265cdc7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:33.988220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa00a5-7742-4606-8a64-a9e265cdc7f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:33.989502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa00a5-7742-4606-8a64-a9e265cdc7f4 None admin] RBAC: Adding query filter params (role.id=3009ebffeb104922b00cd072c83920c0, scope.project.id=6f68c623cbf447d785d67e05742dbd95, user.id=157f75ac057d4058925eb8b5162a75ee) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:33.989816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa00a5-7742-4606-8a64-a9e265cdc7f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:33.992033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa00a5-7742-4606-8a64-a9e265cdc7f4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:34.016788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 48/96] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:33 2022] GET /identity/v3/role_assignments?user.id=157f75ac057d4058925eb8b5162a75ee&scope.project.id=6f68c623cbf447d785d67e05742dbd95&role.id=3009ebffeb104922b00cd072c83920c0 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:34.036954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb59403-7e20-409f-82f0-d399ce163ccd None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:34.089128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbba266-c83c-43f1-9ce3-2cd9063a9e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:34.089745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbba266-c83c-43f1-9ce3-2cd9063a9e65 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:34.090024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbba266-c83c-43f1-9ce3-2cd9063a9e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:34.090299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbba266-c83c-43f1-9ce3-2cd9063a9e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:34.091041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbba266-c83c-43f1-9ce3-2cd9063a9e65 None admin] RBAC: Adding query filter params (role.id=fbc3d149dd894c219e21c220b192281a, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385, user.id=157f75ac057d4058925eb8b5162a75ee) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:34.091352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbba266-c83c-43f1-9ce3-2cd9063a9e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:34.092853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbba266-c83c-43f1-9ce3-2cd9063a9e65 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:34.104658 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 49/97] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:33 2022] GET /identity/v3/role_assignments?user.id=157f75ac057d4058925eb8b5162a75ee&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=fbc3d149dd894c219e21c220b192281a => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:35.734015 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01993f08-b980-4da2-a117-266de37aafed None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:35.735075 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01993f08-b980-4da2-a117-266de37aafed None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:35.735554 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01993f08-b980-4da2-a117-266de37aafed None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:35.737123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 49/98] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:35.743536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63855887-57e8-4d38-8751-e1de3be5ff1d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:35.744407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63855887-57e8-4d38-8751-e1de3be5ff1d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:35.744874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63855887-57e8-4d38-8751-e1de3be5ff1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:35.751216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3e70e-2b31-4a3a-9e7f-6c7944a9eab0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:35.751743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3e70e-2b31-4a3a-9e7f-6c7944a9eab0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:35.752247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3e70e-2b31-4a3a-9e7f-6c7944a9eab0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:35.753764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 50/99] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:10:35.769038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-63855887-57e8-4d38-8751-e1de3be5ff1d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:35.770852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-63855887-57e8-4d38-8751-e1de3be5ff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:35.775013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78de9-c4ea-415d-8b06-c1108e037329 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:35.775606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78de9-c4ea-415d-8b06-c1108e037329 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:35.776109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78de9-c4ea-415d-8b06-c1108e037329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:35.813075 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bdf78de9-c4ea-415d-8b06-c1108e037329 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:35.814724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bdf78de9-c4ea-415d-8b06-c1108e037329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:35.889883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 51/100] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:35.920096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08d0b-df46-4d98-80a1-40591e1b6139 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:35.920381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08d0b-df46-4d98-80a1-40591e1b6139 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:35.921223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08d0b-df46-4d98-80a1-40591e1b6139 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:35.922710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 52/101] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:10:35.928268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de327fe-4bef-4657-961d-c4622e805d5e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:35.928711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de327fe-4bef-4657-961d-c4622e805d5e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:35.929122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de327fe-4bef-4657-961d-c4622e805d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:35.935496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 50/102] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:35.948199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4de327fe-4bef-4657-961d-c4622e805d5e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:35.949564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4de327fe-4bef-4657-961d-c4622e805d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:35.984996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:36.041138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 53/103] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:36.249705 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63855887-57e8-4d38-8751-e1de3be5ff1d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:36.323146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de327fe-4bef-4657-961d-c4622e805d5e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:36.328720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:36.414707 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63855887-57e8-4d38-8751-e1de3be5ff1d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:36.469839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256b835-0eb3-472f-81e6-cc48fbb93bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:36.470481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b835-0eb3-472f-81e6-cc48fbb93bac None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:36.470762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b835-0eb3-472f-81e6-cc48fbb93bac None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:36.471037 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256b835-0eb3-472f-81e6-cc48fbb93bac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:36.490608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256b835-0eb3-472f-81e6-cc48fbb93bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0256b835-0eb3-472f-81e6-cc48fbb93bac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:36.495494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:36.496367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:36.497127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 51/104] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:36.506616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256b835-0eb3-472f-81e6-cc48fbb93bac None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:36.516752 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de327fe-4bef-4657-961d-c4622e805d5e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:36.590838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5b99c-65a4-4b2c-bc14-5b8657709904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:36.591553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5b99c-65a4-4b2c-bc14-5b8657709904 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:36.591838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5b99c-65a4-4b2c-bc14-5b8657709904 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:36.592136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5b99c-65a4-4b2c-bc14-5b8657709904 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:36.593274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5b99c-65a4-4b2c-bc14-5b8657709904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:36.594733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5b99c-65a4-4b2c-bc14-5b8657709904 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:36.596494 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 54/105] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:36.603727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5b99c-65a4-4b2c-bc14-5b8657709904 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:36.668296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:36.695055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256b835-0eb3-472f-81e6-cc48fbb93bac None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:36.733349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:36.753881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd563e6-70b3-415f-8d84-6a9955b8a3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:36.755815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd563e6-70b3-415f-8d84-6a9955b8a3ee None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:36.756318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd563e6-70b3-415f-8d84-6a9955b8a3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:36.756863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd563e6-70b3-415f-8d84-6a9955b8a3ee None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:36.758212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd563e6-70b3-415f-8d84-6a9955b8a3ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:36.759227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd563e6-70b3-415f-8d84-6a9955b8a3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:36.761046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd563e6-70b3-415f-8d84-6a9955b8a3ee None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:36.771996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 52/106] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:36.773077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd563e6-70b3-415f-8d84-6a9955b8a3ee None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:36.820266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5b99c-65a4-4b2c-bc14-5b8657709904 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:36.888153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450037d5-9be8-492c-a3e7-67c320009716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:36.889126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450037d5-9be8-492c-a3e7-67c320009716 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:36.889604 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450037d5-9be8-492c-a3e7-67c320009716 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:36.890074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450037d5-9be8-492c-a3e7-67c320009716 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:36.890942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450037d5-9be8-492c-a3e7-67c320009716 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:36.892620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450037d5-9be8-492c-a3e7-67c320009716 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:36.923680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 55/107] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:10:36 2022] POST /identity/v3/projects => generated 302 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:10:36.925193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450037d5-9be8-492c-a3e7-67c320009716 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:37.032470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:37.053716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd563e6-70b3-415f-8d84-6a9955b8a3ee None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:37.054063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450037d5-9be8-492c-a3e7-67c320009716 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:37.097090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f14ae-081f-4e3d-bb8d-8d909fc4393f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:37.098040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f14ae-081f-4e3d-bb8d-8d909fc4393f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.098566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f14ae-081f-4e3d-bb8d-8d909fc4393f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.098951 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f14ae-081f-4e3d-bb8d-8d909fc4393f None admin] PATH_INFO: `/v3/users/832804efe7d14e279241d21e5d8938c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.119106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f14ae-081f-4e3d-bb8d-8d909fc4393f None admin] RBAC: Authorizing `identity:get_user(user_id=832804efe7d14e279241d21e5d8938c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:37.121025 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f14ae-081f-4e3d-bb8d-8d909fc4393f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:37.123077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 56/108] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:36 2022] GET /identity/v3/users/832804efe7d14e279241d21e5d8938c0 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:37.128996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f14ae-081f-4e3d-bb8d-8d909fc4393f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:37.159465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba016fd0-7bbf-4636-ab18-271f0fbd70e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:37.160602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba016fd0-7bbf-4636-ab18-271f0fbd70e7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.161059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba016fd0-7bbf-4636-ab18-271f0fbd70e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.161497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba016fd0-7bbf-4636-ab18-271f0fbd70e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.182908 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba016fd0-7bbf-4636-ab18-271f0fbd70e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-ba016fd0-7bbf-4636-ab18-271f0fbd70e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:37.191185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:37.192537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:37.193308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 53/109] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:10:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:37.200542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba016fd0-7bbf-4636-ab18-271f0fbd70e7 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:37.250057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:37.257070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f14ae-081f-4e3d-bb8d-8d909fc4393f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:37.295826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16b45b-c2b0-47ea-9022-9b533b0c50ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:37.297259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16b45b-c2b0-47ea-9022-9b533b0c50ed None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.298113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16b45b-c2b0-47ea-9022-9b533b0c50ed None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.298575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16b45b-c2b0-47ea-9022-9b533b0c50ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.313256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:37.328039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba016fd0-7bbf-4636-ab18-271f0fbd70e7 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:37.374734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4f824-11b7-485b-8c4c-cc8b3c6a3cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:37.375860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4f824-11b7-485b-8c4c-cc8b3c6a3cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.376242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4f824-11b7-485b-8c4c-cc8b3c6a3cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.376594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4f824-11b7-485b-8c4c-cc8b3c6a3cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.377605 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4f824-11b7-485b-8c4c-cc8b3c6a3cf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:37.377980 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4f824-11b7-485b-8c4c-cc8b3c6a3cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:37.380668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4f824-11b7-485b-8c4c-cc8b3c6a3cf7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:37.388734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16b45b-c2b0-47ea-9022-9b533b0c50ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:37.390673 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16b45b-c2b0-47ea-9022-9b533b0c50ed None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:37.391530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 54/110] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:37.393255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9d6e1-761f-42ca-8bee-959fc431f68e None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.393644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9d6e1-761f-42ca-8bee-959fc431f68e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.394040 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9d6e1-761f-42ca-8bee-959fc431f68e None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.397150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 55/111] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:37.398363 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c010360-86b2-4509-861f-45cf55392776 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.398747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c010360-86b2-4509-861f-45cf55392776 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.399121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c010360-86b2-4509-861f-45cf55392776 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.400560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 56/112] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:37.402074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c010360-86b2-4509-861f-45cf55392776 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:37.523677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c010360-86b2-4509-861f-45cf55392776 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:37.525751 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:37.537628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 57/113] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 18 06:10:37.540950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c680cf6-0e45-4d75-acf3-e22e3c3c4c66 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.541404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c680cf6-0e45-4d75-acf3-e22e3c3c4c66 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.541874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c680cf6-0e45-4d75-acf3-e22e3c3c4c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.562557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5c680cf6-0e45-4d75-acf3-e22e3c3c4c66 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:37.564211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5c680cf6-0e45-4d75-acf3-e22e3c3c4c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:37.575257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca16f2a-fa59-4940-8d0d-9125f8b579c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:37.575940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16f2a-fa59-4940-8d0d-9125f8b579c4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.576230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16f2a-fa59-4940-8d0d-9125f8b579c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.576508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca16f2a-fa59-4940-8d0d-9125f8b579c4 None admin] PATH_INFO: `/v3/users/1346a82e96a54c0884b956d4511e0c94` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.578433 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca16f2a-fa59-4940-8d0d-9125f8b579c4 None admin] RBAC: Authorizing `identity:get_user(user_id=1346a82e96a54c0884b956d4511e0c94)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:37.580418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca16f2a-fa59-4940-8d0d-9125f8b579c4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:37.583075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 57/114] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:37 2022] GET /identity/v3/users/1346a82e96a54c0884b956d4511e0c94 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:37.585069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1c991-6640-4e05-afde-e306a4e57c52 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.585357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1c991-6640-4e05-afde-e306a4e57c52 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.585638 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1c991-6640-4e05-afde-e306a4e57c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.607003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-87f1c991-6640-4e05-afde-e306a4e57c52 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:37.608571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-87f1c991-6640-4e05-afde-e306a4e57c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:37.610259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:37.656103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 58/115] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:37.656801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c680cf6-0e45-4d75-acf3-e22e3c3c4c66 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:37.682584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 58/116] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:37.683804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1c991-6640-4e05-afde-e306a4e57c52 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:37.784001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c680cf6-0e45-4d75-acf3-e22e3c3c4c66 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:37.796532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:37.801511 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1c991-6640-4e05-afde-e306a4e57c52 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:37.843038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13758601-306c-43bd-bf10-e2969b0e6890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:37.843681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13758601-306c-43bd-bf10-e2969b0e6890 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.843995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13758601-306c-43bd-bf10-e2969b0e6890 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.844351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13758601-306c-43bd-bf10-e2969b0e6890 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.845404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13758601-306c-43bd-bf10-e2969b0e6890 None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:37.846931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13758601-306c-43bd-bf10-e2969b0e6890 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:37.849017 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 59/117] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:37 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:37.849266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da9bd5-021c-47a7-9db7-f76c8fe525b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:37.850152 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ba39-943b-4ad5-a6a6-fb329b30333f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.850399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da9bd5-021c-47a7-9db7-f76c8fe525b5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.850498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ba39-943b-4ad5-a6a6-fb329b30333f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.850691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ba39-943b-4ad5-a6a6-fb329b30333f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.855790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da9bd5-021c-47a7-9db7-f76c8fe525b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.855938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 60/118] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:37.856495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da9bd5-021c-47a7-9db7-f76c8fe525b5 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.856798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8ba39-943b-4ad5-a6a6-fb329b30333f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:37.858211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da9bd5-021c-47a7-9db7-f76c8fe525b5 None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:37.860266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da9bd5-021c-47a7-9db7-f76c8fe525b5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:37.864024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 59/119] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:37 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:37.865619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f06a-f513-4c56-82cf-934cbba0cc37 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:37.866100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f06a-f513-4c56-82cf-934cbba0cc37 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:37.867132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f06a-f513-4c56-82cf-934cbba0cc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:37.893310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1bf3f06a-f513-4c56-82cf-934cbba0cc37 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:37.895126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1bf3f06a-f513-4c56-82cf-934cbba0cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:37.902575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:37.970319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8ba39-943b-4ad5-a6a6-fb329b30333f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:37.976391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 60/120] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:37.977466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3f06a-f513-4c56-82cf-934cbba0cc37 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:38.044023 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86833939-a6c9-4e16-9f14-e96fe6704c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:38.045977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833939-a6c9-4e16-9f14-e96fe6704c8f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:38.047035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833939-a6c9-4e16-9f14-e96fe6704c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:38.050010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833939-a6c9-4e16-9f14-e96fe6704c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:38.050950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86833939-a6c9-4e16-9f14-e96fe6704c8f None admin] RBAC: Adding query filter params (role.id=8bcabf2ca49c4f07920dd2e85ac800c0, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385, user.id=832804efe7d14e279241d21e5d8938c0) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:38.052056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86833939-a6c9-4e16-9f14-e96fe6704c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:38.053699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86833939-a6c9-4e16-9f14-e96fe6704c8f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:38.065518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 61/121] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:37 2022] GET /identity/v3/role_assignments?user.id=832804efe7d14e279241d21e5d8938c0&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=8bcabf2ca49c4f07920dd2e85ac800c0 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:38.074378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86833939-a6c9-4e16-9f14-e96fe6704c8f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:38.166150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:38.174106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3f06a-f513-4c56-82cf-934cbba0cc37 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:38.217870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86833939-a6c9-4e16-9f14-e96fe6704c8f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:38.220351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:38.263342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c89cda-7220-4fc2-8b86-89d7f3f8a0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:38.264379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c89cda-7220-4fc2-8b86-89d7f3f8a0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:38.264859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c89cda-7220-4fc2-8b86-89d7f3f8a0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:38.265330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c89cda-7220-4fc2-8b86-89d7f3f8a0a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:38.270011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bc857-070d-4ec1-ae4f-2213cf45f08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:38.270719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bc857-070d-4ec1-ae4f-2213cf45f08a None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:38.271007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bc857-070d-4ec1-ae4f-2213cf45f08a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:38.271292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bc857-070d-4ec1-ae4f-2213cf45f08a None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/users/1346a82e96a54c0884b956d4511e0c94/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:38.273400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bc857-070d-4ec1-ae4f-2213cf45f08a None admin] RBAC: Authorizing `identity:create_grant(project_id=5392f8ed83ee41e8bfc7496a8c67f385, user_id=1346a82e96a54c0884b956d4511e0c94, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:38.274902 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bc857-070d-4ec1-ae4f-2213cf45f08a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:38.281001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c89cda-7220-4fc2-8b86-89d7f3f8a0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d3c89cda-7220-4fc2-8b86-89d7f3f8a0a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:38.288399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:38.289402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:38.290190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 62/122] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:10:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:38.290887 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c89cda-7220-4fc2-8b86-89d7f3f8a0a2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:38.300412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 61/123] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:10:37 2022] PUT /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/users/1346a82e96a54c0884b956d4511e0c94/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:10:38.301514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bc857-070d-4ec1-ae4f-2213cf45f08a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:38.420173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bc857-070d-4ec1-ae4f-2213cf45f08a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:38.432901 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c89cda-7220-4fc2-8b86-89d7f3f8a0a2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:38.459830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f737cb8-2b17-4f3a-9d51-56a68cbdc585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:38.460660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737cb8-2b17-4f3a-9d51-56a68cbdc585 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:38.461028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737cb8-2b17-4f3a-9d51-56a68cbdc585 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:38.461421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737cb8-2b17-4f3a-9d51-56a68cbdc585 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:38.473850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f737cb8-2b17-4f3a-9d51-56a68cbdc585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:38.476064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35293-6b1b-4daf-807c-8442b4fac672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:38.476892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35293-6b1b-4daf-807c-8442b4fac672 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:38.477350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35293-6b1b-4daf-807c-8442b4fac672 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:38.477773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35293-6b1b-4daf-807c-8442b4fac672 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6f737cb8-2b17-4f3a-9d51-56a68cbdc585 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:38.480185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:38.481227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:38.482222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:38.487965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 62/124] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:38.487965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f737cb8-2b17-4f3a-9d51-56a68cbdc585 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:38.499042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f35293-6b1b-4daf-807c-8442b4fac672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-06f35293-6b1b-4daf-807c-8442b4fac672 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:38.505027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:38.505977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:38.506793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:38.509889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 63/125] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:38.511253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35293-6b1b-4daf-807c-8442b4fac672 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:38.514733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:38.542147 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:38.619993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f737cb8-2b17-4f3a-9d51-56a68cbdc585 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:38.642599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35293-6b1b-4daf-807c-8442b4fac672 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:38.657477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfffd6-1caf-4cc7-9b34-c097efcee2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:38.658241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfffd6-1caf-4cc7-9b34-c097efcee2bd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:38.658639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfffd6-1caf-4cc7-9b34-c097efcee2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:38.659015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfffd6-1caf-4cc7-9b34-c097efcee2bd None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:38.659790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfffd6-1caf-4cc7-9b34-c097efcee2bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:38.660207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfffd6-1caf-4cc7-9b34-c097efcee2bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:38.661950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfffd6-1caf-4cc7-9b34-c097efcee2bd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:38.674884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 63/126] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:10:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:38.674884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfffd6-1caf-4cc7-9b34-c097efcee2bd None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:38.691600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9244f5-c0af-45b3-bdbc-947bfda353c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:38.692634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9244f5-c0af-45b3-bdbc-947bfda353c2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:38.693065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9244f5-c0af-45b3-bdbc-947bfda353c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:38.693487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9244f5-c0af-45b3-bdbc-947bfda353c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:38.694290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9244f5-c0af-45b3-bdbc-947bfda353c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:38.694741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9244f5-c0af-45b3-bdbc-947bfda353c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:38.696296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9244f5-c0af-45b3-bdbc-947bfda353c2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:38.712870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 64/127] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:38.714123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9244f5-c0af-45b3-bdbc-947bfda353c2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:38.772285 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:38.787660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfffd6-1caf-4cc7-9b34-c097efcee2bd None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:38.813096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:38.833583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9244f5-c0af-45b3-bdbc-947bfda353c2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:38.872761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11186519-9df6-4563-ba04-5cea993dab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:38.873390 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e933f6d-005c-49a3-910e-e2045603083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:38.873748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e933f6d-005c-49a3-910e-e2045603083c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:38.874061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e933f6d-005c-49a3-910e-e2045603083c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:38.874437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e933f6d-005c-49a3-910e-e2045603083c None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:38.874829 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186519-9df6-4563-ba04-5cea993dab52 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:38.875247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186519-9df6-4563-ba04-5cea993dab52 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:38.875352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e933f6d-005c-49a3-910e-e2045603083c None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:38.875767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e933f6d-005c-49a3-910e-e2045603083c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:38.875871 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186519-9df6-4563-ba04-5cea993dab52 None admin] PATH_INFO: `/v3/users/157f75ac057d4058925eb8b5162a75ee` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:38.877175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11186519-9df6-4563-ba04-5cea993dab52 None admin] RBAC: Authorizing `identity:get_user(user_id=157f75ac057d4058925eb8b5162a75ee)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:38.877867 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e933f6d-005c-49a3-910e-e2045603083c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:38.878904 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11186519-9df6-4563-ba04-5cea993dab52 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:38.882006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 65/128] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:38 2022] GET /identity/v3/users/157f75ac057d4058925eb8b5162a75ee => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:38.883003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11186519-9df6-4563-ba04-5cea993dab52 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:38.893001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 64/129] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:38.894021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e933f6d-005c-49a3-910e-e2045603083c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:38.994593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11186519-9df6-4563-ba04-5cea993dab52 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:39.032692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3e292-3d36-4cea-9d93-1b0a88d4f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:39.033596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e292-3d36-4cea-9d93-1b0a88d4f13c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:39.034024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e292-3d36-4cea-9d93-1b0a88d4f13c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:39.034444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e292-3d36-4cea-9d93-1b0a88d4f13c None admin] PATH_INFO: `/v3/users/157f75ac057d4058925eb8b5162a75ee` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:39.036368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3e292-3d36-4cea-9d93-1b0a88d4f13c None admin] RBAC: Authorizing `identity:get_user(user_id=157f75ac057d4058925eb8b5162a75ee)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:39.038597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3e292-3d36-4cea-9d93-1b0a88d4f13c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:39.040728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 66/130] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:38 2022] GET /identity/v3/users/157f75ac057d4058925eb8b5162a75ee => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:39.041882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3e292-3d36-4cea-9d93-1b0a88d4f13c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:39.067920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:39.138152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e933f6d-005c-49a3-910e-e2045603083c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:39.153612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3e292-3d36-4cea-9d93-1b0a88d4f13c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:39.189968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0fe77-6e72-4acf-9082-8158ae2994f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:39.191223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0fe77-6e72-4acf-9082-8158ae2994f1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:39.192433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0fe77-6e72-4acf-9082-8158ae2994f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:39.192920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0fe77-6e72-4acf-9082-8158ae2994f1 None admin] PATH_INFO: `/v3/users/157f75ac057d4058925eb8b5162a75ee` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:39.194297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0fe77-6e72-4acf-9082-8158ae2994f1 None admin] RBAC: Authorizing `identity:get_user(user_id=157f75ac057d4058925eb8b5162a75ee)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:39.196134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0fe77-6e72-4acf-9082-8158ae2994f1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:39.198281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 67/131] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:39 2022] GET /identity/v3/users/157f75ac057d4058925eb8b5162a75ee => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:39.199845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0fe77-6e72-4acf-9082-8158ae2994f1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:39.252742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2cab-956b-4878-a378-77261da1f97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:39.253336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2cab-956b-4878-a378-77261da1f97c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:39.253622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2cab-956b-4878-a378-77261da1f97c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:39.253927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2cab-956b-4878-a378-77261da1f97c None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:39.255360 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed2cab-956b-4878-a378-77261da1f97c None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:39.256882 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed2cab-956b-4878-a378-77261da1f97c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:39.259122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 65/132] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:38 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:39.259944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2cab-956b-4878-a378-77261da1f97c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:39.290366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:39.300448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:39.313467 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0fe77-6e72-4acf-9082-8158ae2994f1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:39.349859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85691b4-5a19-4c4f-ac81-e14a3a4ccfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:39.350500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85691b4-5a19-4c4f-ac81-e14a3a4ccfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:39.350785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85691b4-5a19-4c4f-ac81-e14a3a4ccfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:39.351066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85691b4-5a19-4c4f-ac81-e14a3a4ccfe0 None admin] PATH_INFO: `/v3/projects/6f68c623cbf447d785d67e05742dbd95` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:39.352241 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85691b4-5a19-4c4f-ac81-e14a3a4ccfe0 None admin] RBAC: Authorizing `identity:get_project(project_id=6f68c623cbf447d785d67e05742dbd95)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:39.353701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85691b4-5a19-4c4f-ac81-e14a3a4ccfe0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:39.355510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 68/133] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:39 2022] GET /identity/v3/projects/6f68c623cbf447d785d67e05742dbd95 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:39.356200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85691b4-5a19-4c4f-ac81-e14a3a4ccfe0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:39.461734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85691b4-5a19-4c4f-ac81-e14a3a4ccfe0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:39.497148 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d6955-51cc-4186-9f76-d9e8f3e7cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:39.497824 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d6955-51cc-4186-9f76-d9e8f3e7cf26 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:39.498217 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d6955-51cc-4186-9f76-d9e8f3e7cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:39.498613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d6955-51cc-4186-9f76-d9e8f3e7cf26 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/users/157f75ac057d4058925eb8b5162a75ee/roles/fbc3d149dd894c219e21c220b192281a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:39.500948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d6955-51cc-4186-9f76-d9e8f3e7cf26 None admin] RBAC: Authorizing `identity:create_grant(project_id=5392f8ed83ee41e8bfc7496a8c67f385, user_id=157f75ac057d4058925eb8b5162a75ee, role_id=fbc3d149dd894c219e21c220b192281a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:39.502526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d6955-51cc-4186-9f76-d9e8f3e7cf26 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:39.525941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 69/134] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:10:39 2022] PUT /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/users/157f75ac057d4058925eb8b5162a75ee/roles/fbc3d149dd894c219e21c220b192281a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:10:39.526729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d6955-51cc-4186-9f76-d9e8f3e7cf26 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:39.537316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2cab-956b-4878-a378-77261da1f97c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:39.560315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:39.641711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5af4-2328-48ca-9101-dd855fab44a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:39.642373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5af4-2328-48ca-9101-dd855fab44a2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:39.642662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5af4-2328-48ca-9101-dd855fab44a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:39.642941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd5af4-2328-48ca-9101-dd855fab44a2 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:39.644114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd5af4-2328-48ca-9101-dd855fab44a2 None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:39.645892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd5af4-2328-48ca-9101-dd855fab44a2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:39.647742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 66/135] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:39 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:39.648672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d6955-51cc-4186-9f76-d9e8f3e7cf26 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:39.657041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5af4-2328-48ca-9101-dd855fab44a2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:39.687880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc7eab-33a5-472d-bbdf-f34f47ccef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:39.688843 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7eab-33a5-472d-bbdf-f34f47ccef01 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:39.689359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7eab-33a5-472d-bbdf-f34f47ccef01 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:39.689770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc7eab-33a5-472d-bbdf-f34f47ccef01 None admin] PATH_INFO: `/v3/projects/6f68c623cbf447d785d67e05742dbd95/users/157f75ac057d4058925eb8b5162a75ee/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:39.692530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc7eab-33a5-472d-bbdf-f34f47ccef01 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f68c623cbf447d785d67e05742dbd95, user_id=157f75ac057d4058925eb8b5162a75ee, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:39.694413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc7eab-33a5-472d-bbdf-f34f47ccef01 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:39.710613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 70/136] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:10:39 2022] PUT /identity/v3/projects/6f68c623cbf447d785d67e05742dbd95/users/157f75ac057d4058925eb8b5162a75ee/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:10:39.712270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad9381-defc-4775-8e11-dd0d4726e4ae None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:39.712630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad9381-defc-4775-8e11-dd0d4726e4ae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:39.713135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad9381-defc-4775-8e11-dd0d4726e4ae None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:39.714652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 71/137] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:39.721268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4afd-fc0d-4ed3-8b52-cf1c66c93ff1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:39.721642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4afd-fc0d-4ed3-8b52-cf1c66c93ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:39.722043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4afd-fc0d-4ed3-8b52-cf1c66c93ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:39.745260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-65cf4afd-fc0d-4ed3-8b52-cf1c66c93ff1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:39.747021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-65cf4afd-fc0d-4ed3-8b52-cf1c66c93ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:39.834257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 72/138] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:39.884369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:39.912584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd5af4-2328-48ca-9101-dd855fab44a2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:39.966216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85c1d8-cb7e-45d6-aee0-31b4abce9a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:39.966907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85c1d8-cb7e-45d6-aee0-31b4abce9a98 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:39.967203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85c1d8-cb7e-45d6-aee0-31b4abce9a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:39.967485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85c1d8-cb7e-45d6-aee0-31b4abce9a98 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/users/157f75ac057d4058925eb8b5162a75ee/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:39.969487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85c1d8-cb7e-45d6-aee0-31b4abce9a98 None admin] RBAC: Authorizing `identity:create_grant(project_id=5392f8ed83ee41e8bfc7496a8c67f385, user_id=157f75ac057d4058925eb8b5162a75ee, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:39.970977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85c1d8-cb7e-45d6-aee0-31b4abce9a98 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:39.994772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 67/139] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:10:39 2022] PUT /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/users/157f75ac057d4058925eb8b5162a75ee/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:10:40.146634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf4afd-fc0d-4ed3-8b52-cf1c66c93ff1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:40.155315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:40.278863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf4afd-fc0d-4ed3-8b52-cf1c66c93ff1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:40.328925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe02a4-8dde-4c91-a71c-5bcbb1f7161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:40.329589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe02a4-8dde-4c91-a71c-5bcbb1f7161a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:40.329932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe02a4-8dde-4c91-a71c-5bcbb1f7161a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:40.330214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe02a4-8dde-4c91-a71c-5bcbb1f7161a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:40.331360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe02a4-8dde-4c91-a71c-5bcbb1f7161a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:40.333820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe02a4-8dde-4c91-a71c-5bcbb1f7161a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:40.341536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 73/140] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:40.346987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85c1d8-cb7e-45d6-aee0-31b4abce9a98 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:40.505266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85c1d8-cb7e-45d6-aee0-31b4abce9a98 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:40.551825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68079d37-e943-491c-b8fd-7c74b0e5be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:40.552529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68079d37-e943-491c-b8fd-7c74b0e5be38 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:40.552788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68079d37-e943-491c-b8fd-7c74b0e5be38 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:40.553061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68079d37-e943-491c-b8fd-7c74b0e5be38 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:40.553767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68079d37-e943-491c-b8fd-7c74b0e5be38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:40.555277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68079d37-e943-491c-b8fd-7c74b0e5be38 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:40.572499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:40.596370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 68/141] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:10:40 2022] POST /identity/v3/users => generated 283 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:10:40.861111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f0d15-a2e8-4dfb-83d0-675760872834 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:40.861448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f0d15-a2e8-4dfb-83d0-675760872834 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:40.861670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f0d15-a2e8-4dfb-83d0-675760872834 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:40.863197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 74/142] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:40.869871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69cb86-7eee-447b-a0c8-eb1ea0102c46 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:40.870141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69cb86-7eee-447b-a0c8-eb1ea0102c46 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:40.870418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69cb86-7eee-447b-a0c8-eb1ea0102c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:40.897875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6a69cb86-7eee-447b-a0c8-eb1ea0102c46 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:40.899091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6a69cb86-7eee-447b-a0c8-eb1ea0102c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:40.992960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 69/143] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:41.541632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f0d15-a2e8-4dfb-83d0-675760872834 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:41.626518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6ccc9-bdfb-40c8-b67c-301a4db5ff30 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:41.626860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6ccc9-bdfb-40c8-b67c-301a4db5ff30 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:41.627063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6ccc9-bdfb-40c8-b67c-301a4db5ff30 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:41.628512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 70/144] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:41.637249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6d10-4385-49f9-b5f8-a4b698b52c9b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:41.637541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6d10-4385-49f9-b5f8-a4b698b52c9b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:41.637809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6d10-4385-49f9-b5f8-a4b698b52c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:41.644135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:41.664452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-321a6d10-4385-49f9-b5f8-a4b698b52c9b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:41.665640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-321a6d10-4385-49f9-b5f8-a4b698b52c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:41.672538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f0d15-a2e8-4dfb-83d0-675760872834 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:41.715789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbb337-9964-46f0-8584-d2931ad81cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:41.716962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbb337-9964-46f0-8584-d2931ad81cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:41.717253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbb337-9964-46f0-8584-d2931ad81cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:41.717589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbb337-9964-46f0-8584-d2931ad81cc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:41.729639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbb337-9964-46f0-8584-d2931ad81cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-64fbb337-9964-46f0-8584-d2931ad81cc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:41.734659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:41.735492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:41.736306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 75/145] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:41.743823 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbb337-9964-46f0-8584-d2931ad81cc8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:41.825218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 71/146] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:41.859089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbb337-9964-46f0-8584-d2931ad81cc8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:41.895562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065d86e-38cf-40cf-a277-a9f36bf13a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:41.896234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065d86e-38cf-40cf-a277-a9f36bf13a5c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:41.896517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065d86e-38cf-40cf-a277-a9f36bf13a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:41.896788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065d86e-38cf-40cf-a277-a9f36bf13a5c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:41.897457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065d86e-38cf-40cf-a277-a9f36bf13a5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:41.897760 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065d86e-38cf-40cf-a277-a9f36bf13a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:41.899145 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065d86e-38cf-40cf-a277-a9f36bf13a5c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:41.908114 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 76/147] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:41.908698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:41.917044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6d10-4385-49f9-b5f8-a4b698b52c9b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:42.019236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:42.080200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6d10-4385-49f9-b5f8-a4b698b52c9b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:42.126965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5d2d1-c657-41d7-a686-fdc6d7c3a8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:42.127601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5d2d1-c657-41d7-a686-fdc6d7c3a8ba None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:42.127876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5d2d1-c657-41d7-a686-fdc6d7c3a8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:42.128175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5d2d1-c657-41d7-a686-fdc6d7c3a8ba None admin] PATH_INFO: `/v3/users/832804efe7d14e279241d21e5d8938c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:42.129994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5d2d1-c657-41d7-a686-fdc6d7c3a8ba None admin] RBAC: Authorizing `identity:get_user(user_id=832804efe7d14e279241d21e5d8938c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:42.131706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5d2d1-c657-41d7-a686-fdc6d7c3a8ba None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:42.133323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 72/148] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:41 2022] GET /identity/v3/users/832804efe7d14e279241d21e5d8938c0 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:42.139028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065d86e-38cf-40cf-a277-a9f36bf13a5c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:42.249704 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065d86e-38cf-40cf-a277-a9f36bf13a5c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:42.290021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b70d97-b4a5-4f29-9ba8-cac4c4e89bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:42.290707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b70d97-b4a5-4f29-9ba8-cac4c4e89bbc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:42.290986 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b70d97-b4a5-4f29-9ba8-cac4c4e89bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:42.291261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b70d97-b4a5-4f29-9ba8-cac4c4e89bbc None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:42.292407 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b70d97-b4a5-4f29-9ba8-cac4c4e89bbc None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:42.293849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b70d97-b4a5-4f29-9ba8-cac4c4e89bbc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:42.295460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 77/149] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:42 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:42.302051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5d2d1-c657-41d7-a686-fdc6d7c3a8ba None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:42.414686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5d2d1-c657-41d7-a686-fdc6d7c3a8ba None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:42.440299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:42.452088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934ed36-e1db-40d8-ab55-c7f3afe830d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:42.452747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934ed36-e1db-40d8-ab55-c7f3afe830d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:42.453019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934ed36-e1db-40d8-ab55-c7f3afe830d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:42.453284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934ed36-e1db-40d8-ab55-c7f3afe830d5 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/users/832804efe7d14e279241d21e5d8938c0/roles/8bcabf2ca49c4f07920dd2e85ac800c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:42.456005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46cff9-3f45-49ec-b072-b5d8cd5269cd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:42.456261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46cff9-3f45-49ec-b072-b5d8cd5269cd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:42.456532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46cff9-3f45-49ec-b072-b5d8cd5269cd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:42.458760 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 78/150] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:10:42.459123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934ed36-e1db-40d8-ab55-c7f3afe830d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5392f8ed83ee41e8bfc7496a8c67f385, user_id=832804efe7d14e279241d21e5d8938c0, role_id=8bcabf2ca49c4f07920dd2e85ac800c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:42.460674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934ed36-e1db-40d8-ab55-c7f3afe830d5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:42.464359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064701fe-afcb-442f-9ffc-193bc8740dd1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:42.464647 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064701fe-afcb-442f-9ffc-193bc8740dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:42.465372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064701fe-afcb-442f-9ffc-193bc8740dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:42.486594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 73/151] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:10:42 2022] PUT /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/users/832804efe7d14e279241d21e5d8938c0/roles/8bcabf2ca49c4f07920dd2e85ac800c0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:10:42.494063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-064701fe-afcb-442f-9ffc-193bc8740dd1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:42.495320 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-064701fe-afcb-442f-9ffc-193bc8740dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:42.545355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934ed36-e1db-40d8-ab55-c7f3afe830d5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:42.575612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:42.590567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 79/152] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:42.799409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934ed36-e1db-40d8-ab55-c7f3afe830d5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:42.892081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cce81-43d0-4e6f-a66b-57b5566ef882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:42.892737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cce81-43d0-4e6f-a66b-57b5566ef882 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:42.893010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cce81-43d0-4e6f-a66b-57b5566ef882 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:42.893277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cce81-43d0-4e6f-a66b-57b5566ef882 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:42.920920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66cce81-43d0-4e6f-a66b-57b5566ef882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d66cce81-43d0-4e6f-a66b-57b5566ef882 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:42.925872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:42.926830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:42.927627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:42.928260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 74/153] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:10:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:10:42.933519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064701fe-afcb-442f-9ffc-193bc8740dd1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:43.045180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cce81-43d0-4e6f-a66b-57b5566ef882 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:43.101646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:43.205178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cce81-43d0-4e6f-a66b-57b5566ef882 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:43.218721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064701fe-afcb-442f-9ffc-193bc8740dd1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:43.275406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99875988-caf4-428f-b628-0ec55290107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:43.276057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99875988-caf4-428f-b628-0ec55290107a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:43.276340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99875988-caf4-428f-b628-0ec55290107a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:43.276613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99875988-caf4-428f-b628-0ec55290107a None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:43.277097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712b6df-6d6e-4e7a-8534-5571b46025aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:43.277297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99875988-caf4-428f-b628-0ec55290107a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:43.277581 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99875988-caf4-428f-b628-0ec55290107a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:43.278337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b6df-6d6e-4e7a-8534-5571b46025aa None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:43.278812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b6df-6d6e-4e7a-8534-5571b46025aa None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:43.278982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99875988-caf4-428f-b628-0ec55290107a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:43.279439 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712b6df-6d6e-4e7a-8534-5571b46025aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:43.292778 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 80/154] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:43.298830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99875988-caf4-428f-b628-0ec55290107a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:43.305951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712b6df-6d6e-4e7a-8534-5571b46025aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-1712b6df-6d6e-4e7a-8534-5571b46025aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:43.311314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:43.312215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:43.313151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:43.315760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 75/155] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:10:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:43.324338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712b6df-6d6e-4e7a-8534-5571b46025aa None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:43.385591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:43.431564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99875988-caf4-428f-b628-0ec55290107a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:43.467328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b326-1923-44b9-918b-92989c909716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:43.468009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b326-1923-44b9-918b-92989c909716 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:43.468292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b326-1923-44b9-918b-92989c909716 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:43.468569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b326-1923-44b9-918b-92989c909716 None admin] PATH_INFO: `/v3/users/1346a82e96a54c0884b956d4511e0c94` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:43.469716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078b326-1923-44b9-918b-92989c909716 None admin] RBAC: Authorizing `identity:get_user(user_id=1346a82e96a54c0884b956d4511e0c94)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:43.471196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078b326-1923-44b9-918b-92989c909716 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:43.473390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 81/156] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:43 2022] GET /identity/v3/users/1346a82e96a54c0884b956d4511e0c94 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:43.482144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b326-1923-44b9-918b-92989c909716 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:43.519166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712b6df-6d6e-4e7a-8534-5571b46025aa None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:43.523931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:43.592937 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b326-1923-44b9-918b-92989c909716 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:43.603738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d69ea5-e12d-4172-820b-e12dc76fa01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:43.604713 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d69ea5-e12d-4172-820b-e12dc76fa01f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:43.605238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d69ea5-e12d-4172-820b-e12dc76fa01f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:43.605726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d69ea5-e12d-4172-820b-e12dc76fa01f None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:43.606602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d69ea5-e12d-4172-820b-e12dc76fa01f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:43.607107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d69ea5-e12d-4172-820b-e12dc76fa01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:43.608797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d69ea5-e12d-4172-820b-e12dc76fa01f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:43.631109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 76/157] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:10:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:43.634607 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246fcb-94d7-4a3d-8d5e-723f9bcfe076 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:43.636178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246fcb-94d7-4a3d-8d5e-723f9bcfe076 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:43.638091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246fcb-94d7-4a3d-8d5e-723f9bcfe076 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:43.639558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:43.640600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 77/158] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:43.644449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1246fcb-94d7-4a3d-8d5e-723f9bcfe076 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:43.667182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920971b-9ea6-4849-9f71-595971f8269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:43.668217 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920971b-9ea6-4849-9f71-595971f8269b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:43.668692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920971b-9ea6-4849-9f71-595971f8269b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:43.669157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920971b-9ea6-4849-9f71-595971f8269b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:43.817787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920971b-9ea6-4849-9f71-595971f8269b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:43.819288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920971b-9ea6-4849-9f71-595971f8269b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:43.889393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1246fcb-94d7-4a3d-8d5e-723f9bcfe076 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:43.964683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07c47c-2bed-4a02-a943-fac4740f5134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:43.965330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07c47c-2bed-4a02-a943-fac4740f5134 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:43.965621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07c47c-2bed-4a02-a943-fac4740f5134 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:43.965927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07c47c-2bed-4a02-a943-fac4740f5134 None admin] PATH_INFO: `/v3/users/157f75ac057d4058925eb8b5162a75ee` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:43.967138 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07c47c-2bed-4a02-a943-fac4740f5134 None admin] RBAC: Authorizing `identity:get_user(user_id=157f75ac057d4058925eb8b5162a75ee)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:43.968637 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07c47c-2bed-4a02-a943-fac4740f5134 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:43.970250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 78/159] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:43 2022] GET /identity/v3/users/157f75ac057d4058925eb8b5162a75ee => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:43.971385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a6572-a220-4f83-bab6-26a33054f320 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:43.971669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a6572-a220-4f83-bab6-26a33054f320 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:43.971966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a6572-a220-4f83-bab6-26a33054f320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:43.993172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 82/160] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:43.994036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920971b-9ea6-4849-9f71-595971f8269b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:44.009258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-002a6572-a220-4f83-bab6-26a33054f320 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:44.010794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-002a6572-a220-4f83-bab6-26a33054f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:44.046349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:44.064808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:44.154197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 79/161] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:44.155064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a6572-a220-4f83-bab6-26a33054f320 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:44.196392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920971b-9ea6-4849-9f71-595971f8269b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:44.261540 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49b0e-8e60-4a38-afaa-23b21ad9f845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:44.262165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49b0e-8e60-4a38-afaa-23b21ad9f845 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:44.262596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49b0e-8e60-4a38-afaa-23b21ad9f845 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:44.262883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49b0e-8e60-4a38-afaa-23b21ad9f845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:44.364157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a6572-a220-4f83-bab6-26a33054f320 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:44.406413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f49b0e-8e60-4a38-afaa-23b21ad9f845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:44.407823 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f49b0e-8e60-4a38-afaa-23b21ad9f845 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:44.444647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c8c8a-459e-452f-80bf-9ec0b5b4ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:44.445332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8c8a-459e-452f-80bf-9ec0b5b4ac4e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:44.445579 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8c8a-459e-452f-80bf-9ec0b5b4ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:44.445853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c8c8a-459e-452f-80bf-9ec0b5b4ac4e None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:44.447046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c8c8a-459e-452f-80bf-9ec0b5b4ac4e None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:44.448556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c8c8a-459e-452f-80bf-9ec0b5b4ac4e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:44.450406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 80/162] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:44 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:44.455871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c8c8a-459e-452f-80bf-9ec0b5b4ac4e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:44.458357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:44.529020 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:44.612216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 83/163] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:44.622239 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49b0e-8e60-4a38-afaa-23b21ad9f845 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:44.651636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c8c8a-459e-452f-80bf-9ec0b5b4ac4e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:44.721795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ea6f6-b8aa-4fbf-8b9e-0199146d5449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:44.722342 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ea6f6-b8aa-4fbf-8b9e-0199146d5449 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:44.722694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ea6f6-b8aa-4fbf-8b9e-0199146d5449 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:44.722971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ea6f6-b8aa-4fbf-8b9e-0199146d5449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:44.723711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ea6f6-b8aa-4fbf-8b9e-0199146d5449 None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385, user.id=1346a82e96a54c0884b956d4511e0c94) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:44.724057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ea6f6-b8aa-4fbf-8b9e-0199146d5449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:44.725566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ea6f6-b8aa-4fbf-8b9e-0199146d5449 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:44.736663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 81/164] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:44 2022] GET /identity/v3/role_assignments?user.id=1346a82e96a54c0884b956d4511e0c94&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=4494ba66c3f649febc69511a47e27b67 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:44.821627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49b0e-8e60-4a38-afaa-23b21ad9f845 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:44.868198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:44.884684 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a6d84-92ad-4dc0-baec-39cf41c74c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:44.885349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a6d84-92ad-4dc0-baec-39cf41c74c51 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:44.885630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a6d84-92ad-4dc0-baec-39cf41c74c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:44.885908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a6d84-92ad-4dc0-baec-39cf41c74c51 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:44.887218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a6d84-92ad-4dc0-baec-39cf41c74c51 None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:44.888738 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a6d84-92ad-4dc0-baec-39cf41c74c51 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:44.890430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 84/165] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:44 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:44.896474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ea6f6-b8aa-4fbf-8b9e-0199146d5449 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:44.960571 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a6d84-92ad-4dc0-baec-39cf41c74c51 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:45.055347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:45.066866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ea6f6-b8aa-4fbf-8b9e-0199146d5449 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:45.113727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a6d84-92ad-4dc0-baec-39cf41c74c51 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:45.143394 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639ae19-1e52-4cab-b40b-a89eceddd22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:45.144042 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639ae19-1e52-4cab-b40b-a89eceddd22f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:45.144404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639ae19-1e52-4cab-b40b-a89eceddd22f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:45.144746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639ae19-1e52-4cab-b40b-a89eceddd22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:45.145592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639ae19-1e52-4cab-b40b-a89eceddd22f None admin] RBAC: Adding query filter params (role.id=fbc3d149dd894c219e21c220b192281a, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385, user.id=157f75ac057d4058925eb8b5162a75ee) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:45.145904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639ae19-1e52-4cab-b40b-a89eceddd22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:45.147369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639ae19-1e52-4cab-b40b-a89eceddd22f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:45.157788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 82/166] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:44 2022] GET /identity/v3/role_assignments?user.id=157f75ac057d4058925eb8b5162a75ee&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=fbc3d149dd894c219e21c220b192281a => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:45.159077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccefa55-045c-4b45-a875-b85a92c5d3db None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:45.159365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccefa55-045c-4b45-a875-b85a92c5d3db None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:45.159644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccefa55-045c-4b45-a875-b85a92c5d3db None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:45.161631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 83/167] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:45.167802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cdbef-7dd6-4271-bc33-a20ef7139a5c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:45.168136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cdbef-7dd6-4271-bc33-a20ef7139a5c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:45.168389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cdbef-7dd6-4271-bc33-a20ef7139a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:45.174759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f99da0-6319-48b1-8675-7e4f675ff649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:45.175424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f99da0-6319-48b1-8675-7e4f675ff649 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:45.175774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f99da0-6319-48b1-8675-7e4f675ff649 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:45.176088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f99da0-6319-48b1-8675-7e4f675ff649 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:45.195427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f99da0-6319-48b1-8675-7e4f675ff649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:45.197836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4f3cdbef-7dd6-4271-bc33-a20ef7139a5c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:45.199085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4f3cdbef-7dd6-4271-bc33-a20ef7139a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-22f99da0-6319-48b1-8675-7e4f675ff649 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:45.200590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:45.201476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:45.202301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:45.212446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 85/168] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:10:45.213368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f99da0-6319-48b1-8675-7e4f675ff649 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:45.297447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:45.370487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f99da0-6319-48b1-8675-7e4f675ff649 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:45.378000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 84/169] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:45.409274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838e14b-9731-4991-ac70-62edc0137c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:45.409967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838e14b-9731-4991-ac70-62edc0137c0c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:45.410240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838e14b-9731-4991-ac70-62edc0137c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:45.410515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838e14b-9731-4991-ac70-62edc0137c0c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:45.411190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838e14b-9731-4991-ac70-62edc0137c0c None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:45.411494 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838e14b-9731-4991-ac70-62edc0137c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:45.412935 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838e14b-9731-4991-ac70-62edc0137c0c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:45.422150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 86/170] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:45.428762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cdbef-7dd6-4271-bc33-a20ef7139a5c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:45.561863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:45.575741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cdbef-7dd6-4271-bc33-a20ef7139a5c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:45.622715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7d173-c187-44e9-96e1-611eadd53dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:45.623272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7d173-c187-44e9-96e1-611eadd53dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:45.623551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7d173-c187-44e9-96e1-611eadd53dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:45.623822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7d173-c187-44e9-96e1-611eadd53dd9 None admin] PATH_INFO: `/v3/users/157f75ac057d4058925eb8b5162a75ee` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:45.625077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7d173-c187-44e9-96e1-611eadd53dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=157f75ac057d4058925eb8b5162a75ee)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:45.626535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7d173-c187-44e9-96e1-611eadd53dd9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:45.628387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 85/171] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:45 2022] GET /identity/v3/users/157f75ac057d4058925eb8b5162a75ee => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:45.635044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838e14b-9731-4991-ac70-62edc0137c0c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:45.725216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdd77e-d72f-4a5c-a87f-d1afcd0889b2 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:45.725548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdd77e-d72f-4a5c-a87f-d1afcd0889b2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:45.725767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdd77e-d72f-4a5c-a87f-d1afcd0889b2 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:45.727117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 86/172] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:45.732589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62159453-06ed-42ad-9b0e-86704336895b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:45.732857 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62159453-06ed-42ad-9b0e-86704336895b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:45.733127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62159453-06ed-42ad-9b0e-86704336895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:45.759020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838e14b-9731-4991-ac70-62edc0137c0c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:45.767460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-62159453-06ed-42ad-9b0e-86704336895b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:45.768690 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-62159453-06ed-42ad-9b0e-86704336895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:45.774835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:45.806707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974955e2-d1ec-4805-9d1e-fae23cb88eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:45.807783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974955e2-d1ec-4805-9d1e-fae23cb88eee None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:45.808393 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974955e2-d1ec-4805-9d1e-fae23cb88eee None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:45.808886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974955e2-d1ec-4805-9d1e-fae23cb88eee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:45.872542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 87/173] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:45.895009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974955e2-d1ec-4805-9d1e-fae23cb88eee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:45.896586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974955e2-d1ec-4805-9d1e-fae23cb88eee None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:46.010452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 87/174] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:46.016544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62159453-06ed-42ad-9b0e-86704336895b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:46.157032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:46.172970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62159453-06ed-42ad-9b0e-86704336895b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:46.190642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974955e2-d1ec-4805-9d1e-fae23cb88eee None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:46.217329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:46.223535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaa9cf-98f3-483f-905f-734b60b28418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:46.224210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa9cf-98f3-483f-905f-734b60b28418 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:46.224491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa9cf-98f3-483f-905f-734b60b28418 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:46.224763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa9cf-98f3-483f-905f-734b60b28418 None admin] PATH_INFO: `/v3/projects/6f68c623cbf447d785d67e05742dbd95` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:46.228590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaa9cf-98f3-483f-905f-734b60b28418 None admin] RBAC: Authorizing `identity:get_project(project_id=6f68c623cbf447d785d67e05742dbd95)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:46.230068 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaa9cf-98f3-483f-905f-734b60b28418 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:46.232071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 88/175] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:46 2022] GET /identity/v3/projects/6f68c623cbf447d785d67e05742dbd95 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:46.240378 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaa9cf-98f3-483f-905f-734b60b28418 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:46.336426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974955e2-d1ec-4805-9d1e-fae23cb88eee None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:46.400682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec738f-82fc-48ae-80b3-d4cda08de0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:46.401326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec738f-82fc-48ae-80b3-d4cda08de0fe None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:46.401599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec738f-82fc-48ae-80b3-d4cda08de0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:46.401865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec738f-82fc-48ae-80b3-d4cda08de0fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:46.431336 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec738f-82fc-48ae-80b3-d4cda08de0fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-17ec738f-82fc-48ae-80b3-d4cda08de0fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:46.436097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:46.436972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:46.437827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 88/176] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:10:46.445199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec738f-82fc-48ae-80b3-d4cda08de0fe None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:46.476950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaa9cf-98f3-483f-905f-734b60b28418 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:46.528798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9ba65-f796-4a63-b285-6d74b49bd266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:46.529825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9ba65-f796-4a63-b285-6d74b49bd266 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:46.530102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9ba65-f796-4a63-b285-6d74b49bd266 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:46.530372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9ba65-f796-4a63-b285-6d74b49bd266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:46.531368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9ba65-f796-4a63-b285-6d74b49bd266 None admin] RBAC: Adding query filter params (role.id=3009ebffeb104922b00cd072c83920c0, scope.project.id=6f68c623cbf447d785d67e05742dbd95, user.id=157f75ac057d4058925eb8b5162a75ee) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:46.531670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9ba65-f796-4a63-b285-6d74b49bd266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:46.533835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9ba65-f796-4a63-b285-6d74b49bd266 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:46.542621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 89/177] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:46 2022] GET /identity/v3/role_assignments?user.id=157f75ac057d4058925eb8b5162a75ee&scope.project.id=6f68c623cbf447d785d67e05742dbd95&role.id=3009ebffeb104922b00cd072c83920c0 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:46.544137 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6c79-fbd1-4cbf-8459-e74d56ca78b0 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:46.544414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6c79-fbd1-4cbf-8459-e74d56ca78b0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:46.544683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6c79-fbd1-4cbf-8459-e74d56ca78b0 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:46.547066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 90/178] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:46.547807 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6c79-fbd1-4cbf-8459-e74d56ca78b0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:46.552532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:46.576389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:46.623224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec738f-82fc-48ae-80b3-d4cda08de0fe None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:46.693497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6c79-fbd1-4cbf-8459-e74d56ca78b0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:46.716038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558a0d7-7520-4d12-8e67-954b5d81c0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:46.716728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558a0d7-7520-4d12-8e67-954b5d81c0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:46.716943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558a0d7-7520-4d12-8e67-954b5d81c0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:46.717222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558a0d7-7520-4d12-8e67-954b5d81c0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:46.717911 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558a0d7-7520-4d12-8e67-954b5d81c0f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:46.718433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558a0d7-7520-4d12-8e67-954b5d81c0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:46.719632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558a0d7-7520-4d12-8e67-954b5d81c0f2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:46.731119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 89/179] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:46.735703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4a80-697e-4914-b51a-64cde716f103 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:46.735703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4a80-697e-4914-b51a-64cde716f103 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:46.735703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f4a80-697e-4914-b51a-64cde716f103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:46.752366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01066b-a322-4d71-b7bc-fbddd693d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:46.753336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01066b-a322-4d71-b7bc-fbddd693d646 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:46.753727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01066b-a322-4d71-b7bc-fbddd693d646 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:46.754130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01066b-a322-4d71-b7bc-fbddd693d646 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:46.754234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-df6f4a80-697e-4914-b51a-64cde716f103 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:46.755552 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-df6f4a80-697e-4914-b51a-64cde716f103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:46.767579 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01066b-a322-4d71-b7bc-fbddd693d646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-5c01066b-a322-4d71-b7bc-fbddd693d646 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:46.774003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:46.774900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:46.775814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 91/180] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:10:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:46.776715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2f28-97ea-4c80-9547-bf964c6c4b80 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:46.776715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2f28-97ea-4c80-9547-bf964c6c4b80 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:46.776845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2f28-97ea-4c80-9547-bf964c6c4b80 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:46.778759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 92/181] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:46.778759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2f28-97ea-4c80-9547-bf964c6c4b80 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:46.855366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 90/182] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:46.856639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d0285-ea35-4090-aecf-bef4a4d060ab None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:46.857052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d0285-ea35-4090-aecf-bef4a4d060ab None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:46.857402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d0285-ea35-4090-aecf-bef4a4d060ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:46.877644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-346d0285-ea35-4090-aecf-bef4a4d060ab None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:46.878984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-346d0285-ea35-4090-aecf-bef4a4d060ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:46.880296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:46.906601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2f28-97ea-4c80-9547-bf964c6c4b80 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:46.951546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e128bb-960c-4c9f-b4c8-db2eb24516fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:46.952140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e128bb-960c-4c9f-b4c8-db2eb24516fc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:46.952420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e128bb-960c-4c9f-b4c8-db2eb24516fc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:46.952693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e128bb-960c-4c9f-b4c8-db2eb24516fc None admin] PATH_INFO: `/v3/users/157f75ac057d4058925eb8b5162a75ee` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:46.953113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:46.953963 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e128bb-960c-4c9f-b4c8-db2eb24516fc None admin] RBAC: Authorizing `identity:get_user(user_id=157f75ac057d4058925eb8b5162a75ee)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:46.955691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e128bb-960c-4c9f-b4c8-db2eb24516fc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:46.957986 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 93/183] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:46 2022] GET /identity/v3/users/157f75ac057d4058925eb8b5162a75ee => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:46.958841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e128bb-960c-4c9f-b4c8-db2eb24516fc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:46.964326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 91/184] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:46.965390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d0285-ea35-4090-aecf-bef4a4d060ab None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:47.074500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d0285-ea35-4090-aecf-bef4a4d060ab None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:47.119301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae800cba-9d52-40de-b0be-bb0fd7b009e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:47.120643 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800cba-9d52-40de-b0be-bb0fd7b009e6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:47.121388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800cba-9d52-40de-b0be-bb0fd7b009e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:47.121810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800cba-9d52-40de-b0be-bb0fd7b009e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:47.134238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e128bb-960c-4c9f-b4c8-db2eb24516fc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:47.169448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78143f66-ed39-435e-a3a6-a88c5bd4b72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:47.170066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78143f66-ed39-435e-a3a6-a88c5bd4b72d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:47.170304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78143f66-ed39-435e-a3a6-a88c5bd4b72d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:47.170572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78143f66-ed39-435e-a3a6-a88c5bd4b72d None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:47.171226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78143f66-ed39-435e-a3a6-a88c5bd4b72d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:47.171523 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78143f66-ed39-435e-a3a6-a88c5bd4b72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:47.172921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78143f66-ed39-435e-a3a6-a88c5bd4b72d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:47.186335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 94/185] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:47.186335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05844205-f48d-4b9b-afb6-16aac99e53e9 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:47.186335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05844205-f48d-4b9b-afb6-16aac99e53e9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:47.186335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05844205-f48d-4b9b-afb6-16aac99e53e9 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:47.188710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 95/186] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:47.189587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05844205-f48d-4b9b-afb6-16aac99e53e9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:47.198356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:47.201691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:47.206397 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae800cba-9d52-40de-b0be-bb0fd7b009e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:47.208615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae800cba-9d52-40de-b0be-bb0fd7b009e6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:47.293666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05844205-f48d-4b9b-afb6-16aac99e53e9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:47.311704 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 92/187] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:47.312414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae800cba-9d52-40de-b0be-bb0fd7b009e6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:47.330450 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3b79a-d3a3-4e88-98e7-7ea179f0d291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:47.331164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3b79a-d3a3-4e88-98e7-7ea179f0d291 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:47.331505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3b79a-d3a3-4e88-98e7-7ea179f0d291 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:47.332581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3b79a-d3a3-4e88-98e7-7ea179f0d291 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:47.342659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3b79a-d3a3-4e88-98e7-7ea179f0d291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-a9c3b79a-d3a3-4e88-98e7-7ea179f0d291 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:47.348592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:47.349663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:47.350496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 96/188] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:10:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:47.351147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3b03e-5876-4139-b8c9-044eb1c335ad None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:47.351147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3b03e-5876-4139-b8c9-044eb1c335ad None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:47.351473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3b03e-5876-4139-b8c9-044eb1c335ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:47.368614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1cf3b03e-5876-4139-b8c9-044eb1c335ad None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:47.369790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1cf3b03e-5876-4139-b8c9-044eb1c335ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:47.407435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:47.414151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae800cba-9d52-40de-b0be-bb0fd7b009e6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:47.431048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:47.438528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 97/189] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:47.449041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3b03e-5876-4139-b8c9-044eb1c335ad None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:47.460646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a610233-4682-4531-8005-5188fdcc2287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:47.461559 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a610233-4682-4531-8005-5188fdcc2287 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:47.461559 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a610233-4682-4531-8005-5188fdcc2287 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:47.461873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a610233-4682-4531-8005-5188fdcc2287 None admin] PATH_INFO: `/v3/users/9d041bfa129e4d6c85fc0d394a91a84f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:47.475884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a610233-4682-4531-8005-5188fdcc2287 None admin] RBAC: Authorizing `identity:get_user(user_id=9d041bfa129e4d6c85fc0d394a91a84f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:47.477377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a610233-4682-4531-8005-5188fdcc2287 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:47.479079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 93/190] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:47 2022] GET /identity/v3/users/9d041bfa129e4d6c85fc0d394a91a84f => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:47.479893 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a610233-4682-4531-8005-5188fdcc2287 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:47.548197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3b03e-5876-4139-b8c9-044eb1c335ad None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:47.583272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bea9e-dde2-4176-bce1-df71f4f8ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:47.584147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bea9e-dde2-4176-bce1-df71f4f8ef40 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:47.584428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bea9e-dde2-4176-bce1-df71f4f8ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:47.584712 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bea9e-dde2-4176-bce1-df71f4f8ef40 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:47.593557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a610233-4682-4531-8005-5188fdcc2287 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:47.594863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bea9e-dde2-4176-bce1-df71f4f8ef40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-4a0bea9e-dde2-4176-bce1-df71f4f8ef40 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:47.600259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:47.601147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 98/191] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:47.603010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bea9e-dde2-4176-bce1-df71f4f8ef40 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:47.635793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f1f45-73b4-4b9f-8f54-19bed628a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:47.636443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f1f45-73b4-4b9f-8f54-19bed628a112 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:47.636721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f1f45-73b4-4b9f-8f54-19bed628a112 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:47.637167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f1f45-73b4-4b9f-8f54-19bed628a112 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:47.638155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f1f45-73b4-4b9f-8f54-19bed628a112 None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:47.639531 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f1f45-73b4-4b9f-8f54-19bed628a112 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:47.641434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 94/192] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:47 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:47.642396 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f1f45-73b4-4b9f-8f54-19bed628a112 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:47.666898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:47.671852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:47.716154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bea9e-dde2-4176-bce1-df71f4f8ef40 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:47.747720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f1f45-73b4-4b9f-8f54-19bed628a112 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:47.750198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa407b-b4f3-4cc7-82bb-083061209789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:47.750797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa407b-b4f3-4cc7-82bb-083061209789 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:47.751067 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa407b-b4f3-4cc7-82bb-083061209789 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:47.751331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa407b-b4f3-4cc7-82bb-083061209789 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:47.752072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa407b-b4f3-4cc7-82bb-083061209789 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:47.752367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa407b-b4f3-4cc7-82bb-083061209789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:47.754448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa407b-b4f3-4cc7-82bb-083061209789 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:47.762889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 99/193] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:10:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:47.763366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa407b-b4f3-4cc7-82bb-083061209789 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:47.783422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050466-8c14-42ea-9ec6-f7b68ca687b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:47.784046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050466-8c14-42ea-9ec6-f7b68ca687b2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:47.784323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050466-8c14-42ea-9ec6-f7b68ca687b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:47.784593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050466-8c14-42ea-9ec6-f7b68ca687b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:47.854743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10050466-8c14-42ea-9ec6-f7b68ca687b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:47.856234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10050466-8c14-42ea-9ec6-f7b68ca687b2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:47.861837 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa407b-b4f3-4cc7-82bb-083061209789 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:47.879394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:47.882778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:47.898188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf50f12-9c40-420e-aee0-674a3412ee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:47.898784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50f12-9c40-420e-aee0-674a3412ee77 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:47.899066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50f12-9c40-420e-aee0-674a3412ee77 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:47.899333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50f12-9c40-420e-aee0-674a3412ee77 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:47.900003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf50f12-9c40-420e-aee0-674a3412ee77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:47.900303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf50f12-9c40-420e-aee0-674a3412ee77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:47.901668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf50f12-9c40-420e-aee0-674a3412ee77 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:47.909455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 100/194] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:47.910387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf50f12-9c40-420e-aee0-674a3412ee77 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:47.957960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 95/195] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:47.958791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050466-8c14-42ea-9ec6-f7b68ca687b2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:48.012400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf50f12-9c40-420e-aee0-674a3412ee77 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:48.046265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16f65d-1d53-4c63-9eb7-512b7b7ec012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:48.046862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f65d-1d53-4c63-9eb7-512b7b7ec012 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:48.047139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f65d-1d53-4c63-9eb7-512b7b7ec012 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:48.047411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f65d-1d53-4c63-9eb7-512b7b7ec012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:48.048182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16f65d-1d53-4c63-9eb7-512b7b7ec012 None admin] RBAC: Adding query filter params (role.id=3009ebffeb104922b00cd072c83920c0, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385, user.id=157f75ac057d4058925eb8b5162a75ee) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:48.048489 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16f65d-1d53-4c63-9eb7-512b7b7ec012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:48.049942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16f65d-1d53-4c63-9eb7-512b7b7ec012 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:48.055627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 101/196] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:47 2022] GET /identity/v3/role_assignments?user.id=157f75ac057d4058925eb8b5162a75ee&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=3009ebffeb104922b00cd072c83920c0 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:48.056431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16f65d-1d53-4c63-9eb7-512b7b7ec012 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:48.056666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050466-8c14-42ea-9ec6-f7b68ca687b2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:48.090573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:48.105242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a12c7-48e7-487c-a5e3-449fc62532bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:48.105879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a12c7-48e7-487c-a5e3-449fc62532bb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:48.106159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a12c7-48e7-487c-a5e3-449fc62532bb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:48.106430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a12c7-48e7-487c-a5e3-449fc62532bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:48.107776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a12c7-48e7-487c-a5e3-449fc62532bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:48.109299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a12c7-48e7-487c-a5e3-449fc62532bb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:48.116143 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 96/197] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:48.116143 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a12c7-48e7-487c-a5e3-449fc62532bb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:48.116860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:48.173145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16f65d-1d53-4c63-9eb7-512b7b7ec012 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:48.212179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ac075-cf76-4739-b65b-727726e4151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:48.212802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ac075-cf76-4739-b65b-727726e4151b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:48.213083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ac075-cf76-4739-b65b-727726e4151b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:48.213359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ac075-cf76-4739-b65b-727726e4151b None admin] PATH_INFO: `/v3/users/9d041bfa129e4d6c85fc0d394a91a84f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:48.214545 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ac075-cf76-4739-b65b-727726e4151b None admin] RBAC: Authorizing `identity:get_user(user_id=9d041bfa129e4d6c85fc0d394a91a84f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:48.216078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ac075-cf76-4739-b65b-727726e4151b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:48.217720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 102/198] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:48 2022] GET /identity/v3/users/9d041bfa129e4d6c85fc0d394a91a84f => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:48.218508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ac075-cf76-4739-b65b-727726e4151b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:48.232206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a12c7-48e7-487c-a5e3-449fc62532bb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:48.278195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947bef4-85c0-47f7-9bbe-9cc74bf68e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:48.278753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947bef4-85c0-47f7-9bbe-9cc74bf68e0e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:48.279033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947bef4-85c0-47f7-9bbe-9cc74bf68e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:48.279309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947bef4-85c0-47f7-9bbe-9cc74bf68e0e None admin] PATH_INFO: `/v3/users/832804efe7d14e279241d21e5d8938c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:48.282243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947bef4-85c0-47f7-9bbe-9cc74bf68e0e None admin] RBAC: Authorizing `identity:get_user(user_id=832804efe7d14e279241d21e5d8938c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:48.282483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947bef4-85c0-47f7-9bbe-9cc74bf68e0e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:48.284443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 97/199] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:48 2022] GET /identity/v3/users/832804efe7d14e279241d21e5d8938c0 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:48.285685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947bef4-85c0-47f7-9bbe-9cc74bf68e0e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:48.336397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ac075-cf76-4739-b65b-727726e4151b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:48.346790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:48.350865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:48.370449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c247cd6-b441-4d42-8c11-ccdd802c5d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:48.371075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247cd6-b441-4d42-8c11-ccdd802c5d3a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:48.371351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247cd6-b441-4d42-8c11-ccdd802c5d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:48.371619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247cd6-b441-4d42-8c11-ccdd802c5d3a None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:48.372748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c247cd6-b441-4d42-8c11-ccdd802c5d3a None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:48.374194 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c247cd6-b441-4d42-8c11-ccdd802c5d3a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:48.376048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 103/200] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:48 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:48.376580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c247cd6-b441-4d42-8c11-ccdd802c5d3a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:48.390929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947bef4-85c0-47f7-9bbe-9cc74bf68e0e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:48.425601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab4541-8c32-4a80-9442-28e7d1daf1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:48.426298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4541-8c32-4a80-9442-28e7d1daf1d2 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:48.426578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4541-8c32-4a80-9442-28e7d1daf1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:48.426849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4541-8c32-4a80-9442-28e7d1daf1d2 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:48.427485 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab4541-8c32-4a80-9442-28e7d1daf1d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:48.428954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab4541-8c32-4a80-9442-28e7d1daf1d2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:48.450351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 98/201] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:10:48 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:10:48.452882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab4541-8c32-4a80-9442-28e7d1daf1d2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:48.504331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c247cd6-b441-4d42-8c11-ccdd802c5d3a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:48.542417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b3e5f-a59f-440b-85c2-cea5d5711746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:48.543010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b3e5f-a59f-440b-85c2-cea5d5711746 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:48.543291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b3e5f-a59f-440b-85c2-cea5d5711746 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:48.543567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b3e5f-a59f-440b-85c2-cea5d5711746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:48.569334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab4541-8c32-4a80-9442-28e7d1daf1d2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:48.585381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:48.602426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:48.609822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae69264-c732-4cc9-acd8-1efae81f4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:48.610444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae69264-c732-4cc9-acd8-1efae81f4c6d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:48.610721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae69264-c732-4cc9-acd8-1efae81f4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:48.610994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae69264-c732-4cc9-acd8-1efae81f4c6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:48.625667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b3e5f-a59f-440b-85c2-cea5d5711746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:48.627161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b3e5f-a59f-440b-85c2-cea5d5711746 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:48.692770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae69264-c732-4cc9-acd8-1efae81f4c6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:48.694247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae69264-c732-4cc9-acd8-1efae81f4c6d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:48.750792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 104/202] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:48.751457 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b3e5f-a59f-440b-85c2-cea5d5711746 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:48.824767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 99/203] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:48.825547 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae69264-c732-4cc9-acd8-1efae81f4c6d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:48.849287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:48.869663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:48.895972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b3e5f-a59f-440b-85c2-cea5d5711746 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:48.937995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf77de4-782b-4973-a070-1123c258a4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:48.938702 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf77de4-782b-4973-a070-1123c258a4eb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:48.938985 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf77de4-782b-4973-a070-1123c258a4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:48.939257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf77de4-782b-4973-a070-1123c258a4eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:48.940014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf77de4-782b-4973-a070-1123c258a4eb None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=1bd737f4546c4cc9b891a21ee738540f, user.id=9d041bfa129e4d6c85fc0d394a91a84f) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:48.940323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf77de4-782b-4973-a070-1123c258a4eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:48.941962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf77de4-782b-4973-a070-1123c258a4eb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:48.948106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 105/204] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:48 2022] GET /identity/v3/role_assignments?user.id=9d041bfa129e4d6c85fc0d394a91a84f&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=4494ba66c3f649febc69511a47e27b67 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:48.948991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf77de4-782b-4973-a070-1123c258a4eb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:48.951193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae69264-c732-4cc9-acd8-1efae81f4c6d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:48.996301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58884586-720a-4cf7-87ad-444bd4c5c5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:48.997337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58884586-720a-4cf7-87ad-444bd4c5c5ee None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:48.997623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58884586-720a-4cf7-87ad-444bd4c5c5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:48.997903 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58884586-720a-4cf7-87ad-444bd4c5c5ee None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:48.999700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58884586-720a-4cf7-87ad-444bd4c5c5ee None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:49.001240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58884586-720a-4cf7-87ad-444bd4c5c5ee None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:49.003305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 100/205] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:48 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:49.009765 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58884586-720a-4cf7-87ad-444bd4c5c5ee None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:49.069232 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf77de4-782b-4973-a070-1123c258a4eb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:49.111029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:49.125783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58884586-720a-4cf7-87ad-444bd4c5c5ee None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:49.147989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa002-8e05-4bfa-a85f-226eda024098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:49.149023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa002-8e05-4bfa-a85f-226eda024098 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:49.149501 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa002-8e05-4bfa-a85f-226eda024098 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:49.149998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa002-8e05-4bfa-a85f-226eda024098 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:49.151422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaa002-8e05-4bfa-a85f-226eda024098 None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:49.153192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaa002-8e05-4bfa-a85f-226eda024098 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:49.162031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 106/206] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:48 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:49.163374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa002-8e05-4bfa-a85f-226eda024098 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:49.165928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2419e-0d16-4f8d-aff1-1aebb4f0c112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:49.166760 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2419e-0d16-4f8d-aff1-1aebb4f0c112 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:49.167147 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2419e-0d16-4f8d-aff1-1aebb4f0c112 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:49.171941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2419e-0d16-4f8d-aff1-1aebb4f0c112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:49.171941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2419e-0d16-4f8d-aff1-1aebb4f0c112 None admin] RBAC: Adding query filter params (role.id=fbc3d149dd894c219e21c220b192281a, scope.project.id=1bd737f4546c4cc9b891a21ee738540f, user.id=9d041bfa129e4d6c85fc0d394a91a84f) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:49.171941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2419e-0d16-4f8d-aff1-1aebb4f0c112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:49.171941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2419e-0d16-4f8d-aff1-1aebb4f0c112 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:49.177727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 101/207] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:49 2022] GET /identity/v3/role_assignments?user.id=9d041bfa129e4d6c85fc0d394a91a84f&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=fbc3d149dd894c219e21c220b192281a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:49.202061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:49.309313 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa002-8e05-4bfa-a85f-226eda024098 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:49.346250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f40ce-fe8a-42e2-a6bf-1ffd5445842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:49.347333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f40ce-fe8a-42e2-a6bf-1ffd5445842a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:49.348001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f40ce-fe8a-42e2-a6bf-1ffd5445842a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:49.348479 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f40ce-fe8a-42e2-a6bf-1ffd5445842a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:49.349418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f40ce-fe8a-42e2-a6bf-1ffd5445842a None admin] RBAC: Adding query filter params (role.id=8bcabf2ca49c4f07920dd2e85ac800c0, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385, user.id=832804efe7d14e279241d21e5d8938c0) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:49.349960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f40ce-fe8a-42e2-a6bf-1ffd5445842a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:49.351647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f40ce-fe8a-42e2-a6bf-1ffd5445842a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:49.363524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 107/208] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:49 2022] GET /identity/v3/role_assignments?user.id=832804efe7d14e279241d21e5d8938c0&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=8bcabf2ca49c4f07920dd2e85ac800c0 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:50.930818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c327-6ff5-41cf-9108-6f9943a1fa80 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:50.931347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c327-6ff5-41cf-9108-6f9943a1fa80 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:50.931347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c327-6ff5-41cf-9108-6f9943a1fa80 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:50.932808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 102/209] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:50.941324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e2ec-a1ec-4b58-8a85-fd929be694f4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:50.942362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e2ec-a1ec-4b58-8a85-fd929be694f4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:50.942835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e2ec-a1ec-4b58-8a85-fd929be694f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:50.962490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cb65e2ec-a1ec-4b58-8a85-fd929be694f4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:50.964035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cb65e2ec-a1ec-4b58-8a85-fd929be694f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:51.035295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 108/210] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:51.044797 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd0a06-6c74-4bdf-9e93-5dc1503b6c80 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:51.045341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd0a06-6c74-4bdf-9e93-5dc1503b6c80 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:51.045812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd0a06-6c74-4bdf-9e93-5dc1503b6c80 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:51.047339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 103/211] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:51.053175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ef2a-8388-4d12-874b-5bc10a530d0f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:51.053693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ef2a-8388-4d12-874b-5bc10a530d0f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:51.054180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ef2a-8388-4d12-874b-5bc10a530d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:51.072926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7070ef2a-8388-4d12-874b-5bc10a530d0f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:51.074395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7070ef2a-8388-4d12-874b-5bc10a530d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:51.076594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:51.159310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 109/212] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:51.309662 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd0a06-6c74-4bdf-9e93-5dc1503b6c80 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:51.424847 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd0a06-6c74-4bdf-9e93-5dc1503b6c80 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:51.434726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070ef2a-8388-4d12-874b-5bc10a530d0f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:51.465440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7b492-6247-492a-bbcd-6c466fa7d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:51.466075 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b492-6247-492a-bbcd-6c466fa7d20c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:51.466351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b492-6247-492a-bbcd-6c466fa7d20c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:51.466625 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b492-6247-492a-bbcd-6c466fa7d20c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:51.479852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7b492-6247-492a-bbcd-6c466fa7d20c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c9b7b492-6247-492a-bbcd-6c466fa7d20c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:51.485623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:51.486499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:51.487334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 104/213] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:51.488993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555753df-fa13-4093-9bcb-ed8ce73eff34 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:51.488993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555753df-fa13-4093-9bcb-ed8ce73eff34 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:51.489147 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555753df-fa13-4093-9bcb-ed8ce73eff34 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:51.490399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 105/214] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:51.491952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde809c0-ba30-4823-a512-1805c4c657a4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:51.491952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde809c0-ba30-4823-a512-1805c4c657a4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:51.491952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde809c0-ba30-4823-a512-1805c4c657a4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:51.493146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 106/215] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:51.493704 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde809c0-ba30-4823-a512-1805c4c657a4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:51.502635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:51.550883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070ef2a-8388-4d12-874b-5bc10a530d0f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:51.583877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0192ec-2867-43fb-bced-c298411748ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:51.584533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0192ec-2867-43fb-bced-c298411748ee None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:51.584808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0192ec-2867-43fb-bced-c298411748ee None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:51.585079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0192ec-2867-43fb-bced-c298411748ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:51.586298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0192ec-2867-43fb-bced-c298411748ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:51.587745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0192ec-2867-43fb-bced-c298411748ee None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:51.589413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 110/216] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:51.590498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bee6b-9ef9-4d7e-917d-a4e83647bfb8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:51.590774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bee6b-9ef9-4d7e-917d-a4e83647bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:51.591044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bee6b-9ef9-4d7e-917d-a4e83647bfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:51.600016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde809c0-ba30-4823-a512-1805c4c657a4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:51.604224 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:51.610010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9e7bee6b-9ef9-4d7e-917d-a4e83647bfb8 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:51.611207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9e7bee6b-9ef9-4d7e-917d-a4e83647bfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:51.634114 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed88cd-8d62-41d8-b88d-ddb541c659c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:51.634713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed88cd-8d62-41d8-b88d-ddb541c659c7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:51.634988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed88cd-8d62-41d8-b88d-ddb541c659c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:51.635258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed88cd-8d62-41d8-b88d-ddb541c659c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:51.635926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed88cd-8d62-41d8-b88d-ddb541c659c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:51.636233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed88cd-8d62-41d8-b88d-ddb541c659c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:51.637600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed88cd-8d62-41d8-b88d-ddb541c659c7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:51.646182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 107/217] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:51.647329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f96f7-5b18-4109-a35d-84dcdec71f3d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:51.647609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f96f7-5b18-4109-a35d-84dcdec71f3d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:51.647885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f96f7-5b18-4109-a35d-84dcdec71f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:51.665091 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-581f96f7-5b18-4109-a35d-84dcdec71f3d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:51.666300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-581f96f7-5b18-4109-a35d-84dcdec71f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:51.679547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 111/218] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:51.680331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bee6b-9ef9-4d7e-917d-a4e83647bfb8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:51.737106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:51.744246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 108/219] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:51.745201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f96f7-5b18-4109-a35d-84dcdec71f3d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:51.785143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bee6b-9ef9-4d7e-917d-a4e83647bfb8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:51.822682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de392814-c6cc-4878-a130-1a949a9fd292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:51.823290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de392814-c6cc-4878-a130-1a949a9fd292 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:51.823570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de392814-c6cc-4878-a130-1a949a9fd292 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:51.823845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de392814-c6cc-4878-a130-1a949a9fd292 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:51.826946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de392814-c6cc-4878-a130-1a949a9fd292 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:51.826946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de392814-c6cc-4878-a130-1a949a9fd292 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:51.835622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:51.859057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 112/220] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:10:51 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:10:51.886750 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f96f7-5b18-4109-a35d-84dcdec71f3d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:51.928443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ecdbd-1889-4882-9de1-6f06acef2e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:51.929092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ecdbd-1889-4882-9de1-6f06acef2e0a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:51.929370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ecdbd-1889-4882-9de1-6f06acef2e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:51.929696 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ecdbd-1889-4882-9de1-6f06acef2e0a None admin] PATH_INFO: `/v3/users/d9c24ea70b7d414a866655d60d27b305` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:51.947451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ecdbd-1889-4882-9de1-6f06acef2e0a None admin] RBAC: Authorizing `identity:get_user(user_id=d9c24ea70b7d414a866655d60d27b305)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:51.949088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ecdbd-1889-4882-9de1-6f06acef2e0a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:51.949719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de392814-c6cc-4878-a130-1a949a9fd292 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:51.950927 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 109/221] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:51 2022] GET /identity/v3/users/d9c24ea70b7d414a866655d60d27b305 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:51.960717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ecdbd-1889-4882-9de1-6f06acef2e0a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:52.036515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:52.071126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de392814-c6cc-4878-a130-1a949a9fd292 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:52.090296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ecdbd-1889-4882-9de1-6f06acef2e0a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:52.109482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b084ce-ea77-4f0e-b088-8952ea0e462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:52.110118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b084ce-ea77-4f0e-b088-8952ea0e462a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:52.110396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b084ce-ea77-4f0e-b088-8952ea0e462a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:52.110667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b084ce-ea77-4f0e-b088-8952ea0e462a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:52.123409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b084ce-ea77-4f0e-b088-8952ea0e462a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-77b084ce-ea77-4f0e-b088-8952ea0e462a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:52.129791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:52.130700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 113/222] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:10:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:10:52.132257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b084ce-ea77-4f0e-b088-8952ea0e462a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:52.133256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35b77b-ab5a-4967-aee0-c7cd3f8605dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:52.133754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35b77b-ab5a-4967-aee0-c7cd3f8605dc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:52.134027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35b77b-ab5a-4967-aee0-c7cd3f8605dc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:52.134892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35b77b-ab5a-4967-aee0-c7cd3f8605dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:52.210873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:52.221037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35b77b-ab5a-4967-aee0-c7cd3f8605dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:52.222866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35b77b-ab5a-4967-aee0-c7cd3f8605dc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:52.275983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b084ce-ea77-4f0e-b088-8952ea0e462a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:52.294405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:52.322208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e202d-a862-4bf2-b86b-10cd2b9e6c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:52.323011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e202d-a862-4bf2-b86b-10cd2b9e6c22 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:52.323393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e202d-a862-4bf2-b86b-10cd2b9e6c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:52.323768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e202d-a862-4bf2-b86b-10cd2b9e6c22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:52.337493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e202d-a862-4bf2-b86b-10cd2b9e6c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-b41e202d-a862-4bf2-b86b-10cd2b9e6c22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:52.344858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:52.345806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 114/223] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:10:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:52.347620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e202d-a862-4bf2-b86b-10cd2b9e6c22 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:52.358893 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 110/224] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:52.360060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35b77b-ab5a-4967-aee0-c7cd3f8605dc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:52.458902 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e202d-a862-4bf2-b86b-10cd2b9e6c22 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:52.472866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:52.474677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35b77b-ab5a-4967-aee0-c7cd3f8605dc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:52.494703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c937d-655b-4497-b4ba-0cf799ff07b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:52.495313 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c937d-655b-4497-b4ba-0cf799ff07b4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:52.495593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c937d-655b-4497-b4ba-0cf799ff07b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:52.495867 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c937d-655b-4497-b4ba-0cf799ff07b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:52.496577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c937d-655b-4497-b4ba-0cf799ff07b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:52.496886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c937d-655b-4497-b4ba-0cf799ff07b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:52.498274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c937d-655b-4497-b4ba-0cf799ff07b4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:52.507395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 115/225] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:52.513044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c937d-655b-4497-b4ba-0cf799ff07b4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:52.519432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b693675-2ed2-4f07-9625-d28e7390e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:52.520450 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b693675-2ed2-4f07-9625-d28e7390e649 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:52.520934 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b693675-2ed2-4f07-9625-d28e7390e649 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:52.521407 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b693675-2ed2-4f07-9625-d28e7390e649 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:52.522272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b693675-2ed2-4f07-9625-d28e7390e649 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:52.522907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b693675-2ed2-4f07-9625-d28e7390e649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:52.524541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b693675-2ed2-4f07-9625-d28e7390e649 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:52.534972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 111/226] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:10:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:52.536313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b693675-2ed2-4f07-9625-d28e7390e649 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:52.558225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:52.618564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c937d-655b-4497-b4ba-0cf799ff07b4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:52.653662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f6e17-46c0-4e6e-8f91-d266a06764c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:52.654193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b693675-2ed2-4f07-9625-d28e7390e649 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:52.654376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f6e17-46c0-4e6e-8f91-d266a06764c8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:52.654636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f6e17-46c0-4e6e-8f91-d266a06764c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:52.654917 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f6e17-46c0-4e6e-8f91-d266a06764c8 None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:52.656244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f6e17-46c0-4e6e-8f91-d266a06764c8 None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:52.657701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f6e17-46c0-4e6e-8f91-d266a06764c8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:52.660172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 116/227] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:52 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:52.660675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f6e17-46c0-4e6e-8f91-d266a06764c8 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:52.696037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eedc7-4682-4736-8d73-079f302d1f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:52.697173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eedc7-4682-4736-8d73-079f302d1f6f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:52.697671 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eedc7-4682-4736-8d73-079f302d1f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:52.698146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eedc7-4682-4736-8d73-079f302d1f6f None admin] PATH_INFO: `/v3/users/9d041bfa129e4d6c85fc0d394a91a84f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:52.699479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32eedc7-4682-4736-8d73-079f302d1f6f None admin] RBAC: Authorizing `identity:get_user(user_id=9d041bfa129e4d6c85fc0d394a91a84f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:52.701163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32eedc7-4682-4736-8d73-079f302d1f6f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:52.703545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 112/228] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:52 2022] GET /identity/v3/users/9d041bfa129e4d6c85fc0d394a91a84f => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:52.704785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eedc7-4682-4736-8d73-079f302d1f6f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:52.711721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:52.776196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f6e17-46c0-4e6e-8f91-d266a06764c8 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:52.812626 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:52.814874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e9ba7-1625-4be1-9bf8-8820f2a01668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:52.816624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9ba7-1625-4be1-9bf8-8820f2a01668 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:52.816984 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9ba7-1625-4be1-9bf8-8820f2a01668 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:52.817210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e9ba7-1625-4be1-9bf8-8820f2a01668 None admin] PATH_INFO: `/v3/users/9d041bfa129e4d6c85fc0d394a91a84f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:52.819293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e9ba7-1625-4be1-9bf8-8820f2a01668 None admin] RBAC: Authorizing `identity:get_user(user_id=9d041bfa129e4d6c85fc0d394a91a84f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:52.820903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e9ba7-1625-4be1-9bf8-8820f2a01668 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:52.822745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 117/229] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:52 2022] GET /identity/v3/users/9d041bfa129e4d6c85fc0d394a91a84f => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:52.823334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e9ba7-1625-4be1-9bf8-8820f2a01668 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:52.843938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eedc7-4682-4736-8d73-079f302d1f6f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:52.887095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41980fbb-28dd-4683-9fd7-5fc87143df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:52.887756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980fbb-28dd-4683-9fd7-5fc87143df80 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:52.888085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980fbb-28dd-4683-9fd7-5fc87143df80 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:52.888364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41980fbb-28dd-4683-9fd7-5fc87143df80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:52.889131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41980fbb-28dd-4683-9fd7-5fc87143df80 None admin] RBAC: Adding query filter params (role.id=3009ebffeb104922b00cd072c83920c0, scope.project.id=1bd737f4546c4cc9b891a21ee738540f, user.id=d9c24ea70b7d414a866655d60d27b305) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:52.889449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41980fbb-28dd-4683-9fd7-5fc87143df80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:52.891274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41980fbb-28dd-4683-9fd7-5fc87143df80 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:52.899818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 113/230] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:52 2022] GET /identity/v3/role_assignments?user.id=d9c24ea70b7d414a866655d60d27b305&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=3009ebffeb104922b00cd072c83920c0 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:52.900682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41980fbb-28dd-4683-9fd7-5fc87143df80 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:53.004967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e9ba7-1625-4be1-9bf8-8820f2a01668 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:53.034296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:53.091325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41980fbb-28dd-4683-9fd7-5fc87143df80 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:53.101081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6362-3c63-4ab1-9adc-52c91618f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:53.101732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6362-3c63-4ab1-9adc-52c91618f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:53.102012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6362-3c63-4ab1-9adc-52c91618f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:53.102299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6362-3c63-4ab1-9adc-52c91618f4d8 None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:53.104644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f6362-3c63-4ab1-9adc-52c91618f4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:53.106084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f6362-3c63-4ab1-9adc-52c91618f4d8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:53.107714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 118/231] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:52 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:53.115297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6362-3c63-4ab1-9adc-52c91618f4d8 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:53.138214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04859e7-bf46-4d83-9bb0-f85785616635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:53.139171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04859e7-bf46-4d83-9bb0-f85785616635 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:53.139630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04859e7-bf46-4d83-9bb0-f85785616635 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:53.140109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04859e7-bf46-4d83-9bb0-f85785616635 None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:53.141422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04859e7-bf46-4d83-9bb0-f85785616635 None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:53.143113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04859e7-bf46-4d83-9bb0-f85785616635 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:53.145833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 114/232] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:52 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:53.150579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04859e7-bf46-4d83-9bb0-f85785616635 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:53.177774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:53.303398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04859e7-bf46-4d83-9bb0-f85785616635 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:53.326156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6362-3c63-4ab1-9adc-52c91618f4d8 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:53.373581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04716453-3ee7-4318-881a-9ba03ca9746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:53.374241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04716453-3ee7-4318-881a-9ba03ca9746f None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:53.375042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bc8f0-8b76-4dcb-a315-3f92ac837666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:53.375691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bc8f0-8b76-4dcb-a315-3f92ac837666 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:53.376088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04716453-3ee7-4318-881a-9ba03ca9746f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:53.376357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04716453-3ee7-4318-881a-9ba03ca9746f None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f/users/9d041bfa129e4d6c85fc0d394a91a84f/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:53.377179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bc8f0-8b76-4dcb-a315-3f92ac837666 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:53.377462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bc8f0-8b76-4dcb-a315-3f92ac837666 None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f/users/9d041bfa129e4d6c85fc0d394a91a84f/roles/fbc3d149dd894c219e21c220b192281a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:53.380926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bc8f0-8b76-4dcb-a315-3f92ac837666 None admin] RBAC: Authorizing `identity:create_grant(project_id=1bd737f4546c4cc9b891a21ee738540f, user_id=9d041bfa129e4d6c85fc0d394a91a84f, role_id=fbc3d149dd894c219e21c220b192281a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:53.382367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bc8f0-8b76-4dcb-a315-3f92ac837666 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:53.385375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04716453-3ee7-4318-881a-9ba03ca9746f None admin] RBAC: Authorizing `identity:create_grant(project_id=1bd737f4546c4cc9b891a21ee738540f, user_id=9d041bfa129e4d6c85fc0d394a91a84f, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:53.386803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04716453-3ee7-4318-881a-9ba03ca9746f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:53.412244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 115/233] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:10:53 2022] PUT /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f/users/9d041bfa129e4d6c85fc0d394a91a84f/roles/fbc3d149dd894c219e21c220b192281a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:10:53.412425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 119/234] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:10:53 2022] PUT /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f/users/9d041bfa129e4d6c85fc0d394a91a84f/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:10:54.450913 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481b633-9f30-4eaa-bc11-994e2f81379b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:54.451437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481b633-9f30-4eaa-bc11-994e2f81379b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:54.451437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481b633-9f30-4eaa-bc11-994e2f81379b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:54.453059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 116/235] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:54.458755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f1d98-d689-47db-b23d-3f6575fe8057 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:54.459187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f1d98-d689-47db-b23d-3f6575fe8057 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:54.459376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f1d98-d689-47db-b23d-3f6575fe8057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:54.478039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-876f1d98-d689-47db-b23d-3f6575fe8057 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:54.479211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-876f1d98-d689-47db-b23d-3f6575fe8057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:54.523071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:54.564967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 120/236] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:54.705427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e8dd9-c5e1-4bf3-848a-773514eb5c9f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:54.705716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e8dd9-c5e1-4bf3-848a-773514eb5c9f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:54.705901 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e8dd9-c5e1-4bf3-848a-773514eb5c9f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:54.708212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 117/237] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:54.713669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788da961-1887-44a4-8253-74bb3d267336 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:54.714001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788da961-1887-44a4-8253-74bb3d267336 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:54.714225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788da961-1887-44a4-8253-74bb3d267336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:54.740936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-788da961-1887-44a4-8253-74bb3d267336 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:54.742119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-788da961-1887-44a4-8253-74bb3d267336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:54.812931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 121/238] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:54.890108 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e8dd9-c5e1-4bf3-848a-773514eb5c9f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:54.982228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:55.013479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e8dd9-c5e1-4bf3-848a-773514eb5c9f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:55.055466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f98deb-f773-4e03-8999-e008528158dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:55.056119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98deb-f773-4e03-8999-e008528158dd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:55.056394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98deb-f773-4e03-8999-e008528158dd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:55.056663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98deb-f773-4e03-8999-e008528158dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:55.069771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f98deb-f773-4e03-8999-e008528158dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e5f98deb-f773-4e03-8999-e008528158dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:55.075433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:55.076373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:55.077174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 118/239] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:55.083826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788da961-1887-44a4-8253-74bb3d267336 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:55.214199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:55.218287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788da961-1887-44a4-8253-74bb3d267336 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:55.263013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b072644-05be-4701-a0ab-0111e88cc606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:55.263551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b072644-05be-4701-a0ab-0111e88cc606 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:55.263831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b072644-05be-4701-a0ab-0111e88cc606 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:55.264148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b072644-05be-4701-a0ab-0111e88cc606 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:55.264810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b072644-05be-4701-a0ab-0111e88cc606 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:55.265111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b072644-05be-4701-a0ab-0111e88cc606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:55.266652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b072644-05be-4701-a0ab-0111e88cc606 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:55.279067 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 122/240] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:55.279951 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f98deb-f773-4e03-8999-e008528158dd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:55.284937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b072644-05be-4701-a0ab-0111e88cc606 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:55.435286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f98deb-f773-4e03-8999-e008528158dd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:55.489458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122587f-1e57-4873-9bec-de6bb68a6010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:55.490881 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122587f-1e57-4873-9bec-de6bb68a6010 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:55.491975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122587f-1e57-4873-9bec-de6bb68a6010 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:55.494213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b072644-05be-4701-a0ab-0111e88cc606 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:55.494964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122587f-1e57-4873-9bec-de6bb68a6010 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:55.497724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122587f-1e57-4873-9bec-de6bb68a6010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:55.499373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122587f-1e57-4873-9bec-de6bb68a6010 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:55.501164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 119/241] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:55.507895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122587f-1e57-4873-9bec-de6bb68a6010 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:55.532369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:55.554980 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac79b21-6b44-49ec-bfac-50471959b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:55.557505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac79b21-6b44-49ec-bfac-50471959b377 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:55.558211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac79b21-6b44-49ec-bfac-50471959b377 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:55.559786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac79b21-6b44-49ec-bfac-50471959b377 None admin] PATH_INFO: `/v3/users/959ea40cd0c24f5b8e8bcdc047277b34` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:55.576626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac79b21-6b44-49ec-bfac-50471959b377 None admin] RBAC: Authorizing `identity:get_user(user_id=959ea40cd0c24f5b8e8bcdc047277b34)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:55.578044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac79b21-6b44-49ec-bfac-50471959b377 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:55.584267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 123/242] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:55 2022] GET /identity/v3/users/959ea40cd0c24f5b8e8bcdc047277b34 => generated 297 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:55.584267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8061c-82ab-49eb-91b7-dd3c29d19679 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:55.584267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8061c-82ab-49eb-91b7-dd3c29d19679 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:55.584267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8061c-82ab-49eb-91b7-dd3c29d19679 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:55.584267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 124/243] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:55.589514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781cbc2-e859-4be9-9ace-91d4e978207d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:55.589514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781cbc2-e859-4be9-9ace-91d4e978207d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:55.589514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781cbc2-e859-4be9-9ace-91d4e978207d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:55.608796 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1781cbc2-e859-4be9-9ace-91d4e978207d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:55.610284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1781cbc2-e859-4be9-9ace-91d4e978207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:55.624188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:55.670069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122587f-1e57-4873-9bec-de6bb68a6010 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:55.688062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 125/244] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:55.689048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781cbc2-e859-4be9-9ace-91d4e978207d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:55.711741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0468177-1e02-4108-8dcc-ac54ddadf311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:55.714057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468177-1e02-4108-8dcc-ac54ddadf311 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:55.714389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468177-1e02-4108-8dcc-ac54ddadf311 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:55.714668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468177-1e02-4108-8dcc-ac54ddadf311 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:55.715331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0468177-1e02-4108-8dcc-ac54ddadf311 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:55.716948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0468177-1e02-4108-8dcc-ac54ddadf311 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:55.758726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 120/245] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:10:55 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:10:55.858289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781cbc2-e859-4be9-9ace-91d4e978207d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:55.904387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15ad98-ec8d-4c33-ba7c-b8589fe19b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:55.905088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ad98-ec8d-4c33-ba7c-b8589fe19b27 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:55.905370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ad98-ec8d-4c33-ba7c-b8589fe19b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:55.905645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ad98-ec8d-4c33-ba7c-b8589fe19b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:55.926431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:55.985691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15ad98-ec8d-4c33-ba7c-b8589fe19b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:55.987845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15ad98-ec8d-4c33-ba7c-b8589fe19b27 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:56.106542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcb725-b3c4-4f56-b304-cdf138ef6bbe None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:56.106542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcb725-b3c4-4f56-b304-cdf138ef6bbe None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:56.106542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcb725-b3c4-4f56-b304-cdf138ef6bbe None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:56.107880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 121/246] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:56.108626 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcb725-b3c4-4f56-b304-cdf138ef6bbe None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:56.133659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 126/247] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:56.133659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2766d7c-820d-41d2-9782-e1e0e435c2cb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:56.133659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2766d7c-820d-41d2-9782-e1e0e435c2cb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:56.133659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2766d7c-820d-41d2-9782-e1e0e435c2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:56.154771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a2766d7c-820d-41d2-9782-e1e0e435c2cb None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:56.156043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a2766d7c-820d-41d2-9782-e1e0e435c2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:56.194566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:56.209883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:56.240362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 127/248] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:56.241558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2766d7c-820d-41d2-9782-e1e0e435c2cb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:56.249563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcb725-b3c4-4f56-b304-cdf138ef6bbe None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:56.305926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c72ad5-b481-4584-b3ea-ce8a77761808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:56.306572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c72ad5-b481-4584-b3ea-ce8a77761808 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:56.306849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c72ad5-b481-4584-b3ea-ce8a77761808 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:56.307123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c72ad5-b481-4584-b3ea-ce8a77761808 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:56.319316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c72ad5-b481-4584-b3ea-ce8a77761808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-30c72ad5-b481-4584-b3ea-ce8a77761808 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:56.325781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:56.326679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:56.327481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 122/249] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:56.328189 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc363874-e8c3-4495-889f-63f58d2f87f9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:56.328998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc363874-e8c3-4495-889f-63f58d2f87f9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:56.328998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc363874-e8c3-4495-889f-63f58d2f87f9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:56.330227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 123/250] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:56.341013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc363874-e8c3-4495-889f-63f58d2f87f9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:56.369728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2766d7c-820d-41d2-9782-e1e0e435c2cb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:56.433300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34defb42-d876-4480-a012-60c37dc1a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:56.433956 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34defb42-d876-4480-a012-60c37dc1a93a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:56.434232 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34defb42-d876-4480-a012-60c37dc1a93a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:56.434496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34defb42-d876-4480-a012-60c37dc1a93a None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:56.436325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34defb42-d876-4480-a012-60c37dc1a93a None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:56.438254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34defb42-d876-4480-a012-60c37dc1a93a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:56.441308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 128/251] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:56 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:56.444093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f678562-ff12-469a-a0df-62421bde30ed None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:56.444647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f678562-ff12-469a-a0df-62421bde30ed None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:56.444925 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f678562-ff12-469a-a0df-62421bde30ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:56.470273 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6f678562-ff12-469a-a0df-62421bde30ed None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:56.471646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6f678562-ff12-469a-a0df-62421bde30ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:56.472856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc363874-e8c3-4495-889f-63f58d2f87f9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:56.509373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:56.537331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc618f1-86b1-4efc-ba13-5aa69225de8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:56.538245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc618f1-86b1-4efc-ba13-5aa69225de8e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:56.538718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc618f1-86b1-4efc-ba13-5aa69225de8e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:56.539146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc618f1-86b1-4efc-ba13-5aa69225de8e None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:56.540035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc618f1-86b1-4efc-ba13-5aa69225de8e None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:56.540466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc618f1-86b1-4efc-ba13-5aa69225de8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:56.542038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc618f1-86b1-4efc-ba13-5aa69225de8e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:56.546907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:56.556982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 124/252] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:56.558105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc618f1-86b1-4efc-ba13-5aa69225de8e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:56.576717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 129/253] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:10:56.577206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f678562-ff12-469a-a0df-62421bde30ed None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:56.697865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f678562-ff12-469a-a0df-62421bde30ed None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:56.723769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc618f1-86b1-4efc-ba13-5aa69225de8e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:56.741333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614cdbc-3814-451d-81a1-95b94da9b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:56.742114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614cdbc-3814-451d-81a1-95b94da9b914 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:56.742495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614cdbc-3814-451d-81a1-95b94da9b914 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:56.743189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614cdbc-3814-451d-81a1-95b94da9b914 None admin] PATH_INFO: `/v3/users/d9c24ea70b7d414a866655d60d27b305` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:56.744193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614cdbc-3814-451d-81a1-95b94da9b914 None admin] RBAC: Authorizing `identity:get_user(user_id=d9c24ea70b7d414a866655d60d27b305)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:56.745859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614cdbc-3814-451d-81a1-95b94da9b914 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:56.747507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 130/254] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:56 2022] GET /identity/v3/users/d9c24ea70b7d414a866655d60d27b305 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:56.748474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614cdbc-3814-451d-81a1-95b94da9b914 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:56.777923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f3658-9d9b-4744-b23d-91e9eaac387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:56.778823 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f3658-9d9b-4744-b23d-91e9eaac387d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:56.779258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f3658-9d9b-4744-b23d-91e9eaac387d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:56.779673 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f3658-9d9b-4744-b23d-91e9eaac387d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:56.780615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f3658-9d9b-4744-b23d-91e9eaac387d None admin] RBAC: Adding query filter params (role.id=8bcabf2ca49c4f07920dd2e85ac800c0, scope.project.id=1bd737f4546c4cc9b891a21ee738540f, user.id=959ea40cd0c24f5b8e8bcdc047277b34) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:56.781079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f3658-9d9b-4744-b23d-91e9eaac387d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:56.782826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f3658-9d9b-4744-b23d-91e9eaac387d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:56.795942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 125/255] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:56 2022] GET /identity/v3/role_assignments?user.id=959ea40cd0c24f5b8e8bcdc047277b34&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=8bcabf2ca49c4f07920dd2e85ac800c0 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:56.797022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f3658-9d9b-4744-b23d-91e9eaac387d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:56.823824 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:56.921309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:56.978582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614cdbc-3814-451d-81a1-95b94da9b914 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:57.039455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f3658-9d9b-4744-b23d-91e9eaac387d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:57.078251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fab57-f0ea-4bbd-acff-a231b72b0cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:57.079043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fab57-f0ea-4bbd-acff-a231b72b0cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:57.079323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fab57-f0ea-4bbd-acff-a231b72b0cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:57.079594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fab57-f0ea-4bbd-acff-a231b72b0cb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:57.084208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59e841-77d3-400a-883f-6bc79acfb98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:57.085254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59e841-77d3-400a-883f-6bc79acfb98e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:57.085705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59e841-77d3-400a-883f-6bc79acfb98e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:57.086176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59e841-77d3-400a-883f-6bc79acfb98e None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:57.092357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59e841-77d3-400a-883f-6bc79acfb98e None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:57.094224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59e841-77d3-400a-883f-6bc79acfb98e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:57.096213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 126/256] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:56 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:57.098172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59e841-77d3-400a-883f-6bc79acfb98e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:57.117431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fab57-f0ea-4bbd-acff-a231b72b0cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6e7fab57-f0ea-4bbd-acff-a231b72b0cb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:57.122852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:57.123760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:10:57.124583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:10:57.135929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 131/257] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:57.135929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fab57-f0ea-4bbd-acff-a231b72b0cb5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:57.220307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59e841-77d3-400a-883f-6bc79acfb98e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:57.248046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:57.264644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7ec41-aeef-4d2c-bb9a-a0631f7c87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:57.265313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7ec41-aeef-4d2c-bb9a-a0631f7c87e4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:57.265695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7ec41-aeef-4d2c-bb9a-a0631f7c87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:57.265984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7ec41-aeef-4d2c-bb9a-a0631f7c87e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:57.278843 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7ec41-aeef-4d2c-bb9a-a0631f7c87e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-81a7ec41-aeef-4d2c-bb9a-a0631f7c87e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:57.284473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:57.285636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 127/258] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:10:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:57.286841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7ec41-aeef-4d2c-bb9a-a0631f7c87e4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:57.388823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fab57-f0ea-4bbd-acff-a231b72b0cb5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:57.404275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:57.433293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae6000-19a5-4fe0-b82a-c7b2f39ccd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:57.433959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae6000-19a5-4fe0-b82a-c7b2f39ccd83 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:57.434231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae6000-19a5-4fe0-b82a-c7b2f39ccd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:57.434499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae6000-19a5-4fe0-b82a-c7b2f39ccd83 None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f/users/d9c24ea70b7d414a866655d60d27b305/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:57.437286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae6000-19a5-4fe0-b82a-c7b2f39ccd83 None admin] RBAC: Authorizing `identity:create_grant(project_id=1bd737f4546c4cc9b891a21ee738540f, user_id=d9c24ea70b7d414a866655d60d27b305, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:57.438732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae6000-19a5-4fe0-b82a-c7b2f39ccd83 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:57.466681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 132/259] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:10:57 2022] PUT /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f/users/d9c24ea70b7d414a866655d60d27b305/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:10:57.474521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae6000-19a5-4fe0-b82a-c7b2f39ccd83 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:57.538665 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7ec41-aeef-4d2c-bb9a-a0631f7c87e4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:57.604826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ec8cc-836f-45c7-9011-120b6931fbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:57.606495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ec8cc-836f-45c7-9011-120b6931fbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:57.607148 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ec8cc-836f-45c7-9011-120b6931fbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:57.608874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ec8cc-836f-45c7-9011-120b6931fbd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:57.609774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ec8cc-836f-45c7-9011-120b6931fbd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:57.610993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ec8cc-836f-45c7-9011-120b6931fbd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:57.612740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ec8cc-836f-45c7-9011-120b6931fbd9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:57.625328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 128/260] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:57.632140 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ec8cc-836f-45c7-9011-120b6931fbd9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:57.687327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:57.688894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae6000-19a5-4fe0-b82a-c7b2f39ccd83 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:57.729749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6d013-e7a2-4c06-8511-c0a954b431da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:57.730739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d013-e7a2-4c06-8511-c0a954b431da None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:57.731220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d013-e7a2-4c06-8511-c0a954b431da None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:57.731800 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d013-e7a2-4c06-8511-c0a954b431da None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:57.732806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6d013-e7a2-4c06-8511-c0a954b431da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:57.733309 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6d013-e7a2-4c06-8511-c0a954b431da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:57.734889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6d013-e7a2-4c06-8511-c0a954b431da None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:57.744407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 133/261] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:10:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:57.753653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6d013-e7a2-4c06-8511-c0a954b431da None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:57.776313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ec8cc-836f-45c7-9011-120b6931fbd9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:57.808402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:57.841095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd66738-afb1-4e88-baa9-75ba9aac5550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:57.841653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd66738-afb1-4e88-baa9-75ba9aac5550 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:57.841933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd66738-afb1-4e88-baa9-75ba9aac5550 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:57.842205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd66738-afb1-4e88-baa9-75ba9aac5550 None admin] PATH_INFO: `/v3/users/9d041bfa129e4d6c85fc0d394a91a84f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:57.848823 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd66738-afb1-4e88-baa9-75ba9aac5550 None admin] RBAC: Authorizing `identity:get_user(user_id=9d041bfa129e4d6c85fc0d394a91a84f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:57.850320 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd66738-afb1-4e88-baa9-75ba9aac5550 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:57.852440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 129/262] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:57 2022] GET /identity/v3/users/9d041bfa129e4d6c85fc0d394a91a84f => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:57.861105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd66738-afb1-4e88-baa9-75ba9aac5550 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:57.969273 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6d013-e7a2-4c06-8511-c0a954b431da None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:58.013154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bee46-799f-4725-9fb2-ce4bdf5e5a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:58.013787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bee46-799f-4725-9fb2-ce4bdf5e5a40 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:58.014066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bee46-799f-4725-9fb2-ce4bdf5e5a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:58.014339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bee46-799f-4725-9fb2-ce4bdf5e5a40 None admin] PATH_INFO: `/v3/users/9d041bfa129e4d6c85fc0d394a91a84f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:58.019970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bee46-799f-4725-9fb2-ce4bdf5e5a40 None admin] RBAC: Authorizing `identity:get_user(user_id=9d041bfa129e4d6c85fc0d394a91a84f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:58.019970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bee46-799f-4725-9fb2-ce4bdf5e5a40 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:58.019970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 134/263] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:57 2022] GET /identity/v3/users/9d041bfa129e4d6c85fc0d394a91a84f => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:58.025749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bee46-799f-4725-9fb2-ce4bdf5e5a40 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:58.042560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd66738-afb1-4e88-baa9-75ba9aac5550 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:58.059044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:58.109102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9ca57-a434-492b-b331-5df49676aac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:58.109719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ca57-a434-492b-b331-5df49676aac0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:58.109995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ca57-a434-492b-b331-5df49676aac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:58.110266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ca57-a434-492b-b331-5df49676aac0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:58.194440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:58.215671 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bee46-799f-4725-9fb2-ce4bdf5e5a40 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:58.255322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9ca57-a434-492b-b331-5df49676aac0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:58.256815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9ca57-a434-492b-b331-5df49676aac0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:58.291000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1ae49-6503-483a-84f2-463ee9b4d27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:58.291618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1ae49-6503-483a-84f2-463ee9b4d27f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:58.291893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1ae49-6503-483a-84f2-463ee9b4d27f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:58.292186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1ae49-6503-483a-84f2-463ee9b4d27f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:58.403894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 130/264] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:58.410921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9ca57-a434-492b-b331-5df49676aac0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:58.419258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:58.420440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1ae49-6503-483a-84f2-463ee9b4d27f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:58.422167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1ae49-6503-483a-84f2-463ee9b4d27f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:58.585440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9ca57-a434-492b-b331-5df49676aac0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:58.613385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:58.626258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 135/265] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:10:58.633619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1ae49-6503-483a-84f2-463ee9b4d27f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:58.668354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad739a7-b706-4b6b-821e-3158614f62f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:58.668909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad739a7-b706-4b6b-821e-3158614f62f4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:58.669185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad739a7-b706-4b6b-821e-3158614f62f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:58.669457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad739a7-b706-4b6b-821e-3158614f62f4 None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:58.671413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad739a7-b706-4b6b-821e-3158614f62f4 None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:58.672884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad739a7-b706-4b6b-821e-3158614f62f4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:58.680048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 131/266] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:58 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:58.686878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad739a7-b706-4b6b-821e-3158614f62f4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:58.804948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1ae49-6503-483a-84f2-463ee9b4d27f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:58.868281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:58.885618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f02af4-3c2f-46d6-90a0-957d2c9f34c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:58.886317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f02af4-3c2f-46d6-90a0-957d2c9f34c8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:58.886661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f02af4-3c2f-46d6-90a0-957d2c9f34c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:58.886876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f02af4-3c2f-46d6-90a0-957d2c9f34c8 None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:58.889671 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f02af4-3c2f-46d6-90a0-957d2c9f34c8 None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:58.891213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f02af4-3c2f-46d6-90a0-957d2c9f34c8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:58.893217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 136/267] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:10:58 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:58.899938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f02af4-3c2f-46d6-90a0-957d2c9f34c8 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:58.930920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad739a7-b706-4b6b-821e-3158614f62f4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:58.998427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:59.005880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656f1af-3d35-442d-b190-ade0b4a09a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:59.006805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f1af-3d35-442d-b190-ade0b4a09a9b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:59.007285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f1af-3d35-442d-b190-ade0b4a09a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:59.007761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f1af-3d35-442d-b190-ade0b4a09a9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:59.008982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656f1af-3d35-442d-b190-ade0b4a09a9b None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=1bd737f4546c4cc9b891a21ee738540f, user.id=9d041bfa129e4d6c85fc0d394a91a84f) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:59.009793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656f1af-3d35-442d-b190-ade0b4a09a9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:59.012480 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656f1af-3d35-442d-b190-ade0b4a09a9b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:59.029107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 132/268] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:58 2022] GET /identity/v3/role_assignments?user.id=9d041bfa129e4d6c85fc0d394a91a84f&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=4494ba66c3f649febc69511a47e27b67 => generated 608 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:59.030756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587d50a-f829-4d3c-9f98-9105722cc178 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:59.031266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587d50a-f829-4d3c-9f98-9105722cc178 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:59.031757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587d50a-f829-4d3c-9f98-9105722cc178 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:59.037935 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 133/269] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:59.040045 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37f92d-6687-436c-83d5-79f8e6a7adf4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:59.040535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37f92d-6687-436c-83d5-79f8e6a7adf4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:59.041034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37f92d-6687-436c-83d5-79f8e6a7adf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:59.061560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8f37f92d-6687-436c-83d5-79f8e6a7adf4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:59.063122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8f37f92d-6687-436c-83d5-79f8e6a7adf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:59.106158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f02af4-3c2f-46d6-90a0-957d2c9f34c8 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:59.156210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 134/270] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:59.201620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a144d-fc1d-4d55-a53f-bd975641d2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:59.202179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a144d-fc1d-4d55-a53f-bd975641d2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:59.202458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a144d-fc1d-4d55-a53f-bd975641d2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:59.202727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a144d-fc1d-4d55-a53f-bd975641d2f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:59.203497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a144d-fc1d-4d55-a53f-bd975641d2f1 None admin] RBAC: Adding query filter params (role.id=fbc3d149dd894c219e21c220b192281a, scope.project.id=1bd737f4546c4cc9b891a21ee738540f, user.id=9d041bfa129e4d6c85fc0d394a91a84f) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:59.203803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a144d-fc1d-4d55-a53f-bd975641d2f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:59.205399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a144d-fc1d-4d55-a53f-bd975641d2f1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:59.223293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 137/271] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:10:58 2022] GET /identity/v3/role_assignments?user.id=9d041bfa129e4d6c85fc0d394a91a84f&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=fbc3d149dd894c219e21c220b192281a => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:10:59.371221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d54cb-8d32-4e45-9964-36bca021f9c8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:59.371569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d54cb-8d32-4e45-9964-36bca021f9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:59.371780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d54cb-8d32-4e45-9964-36bca021f9c8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:59.373493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 135/272] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:10:59.380478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecddc8-b0ff-4fc9-9681-acb833b6f009 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:59.380774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecddc8-b0ff-4fc9-9681-acb833b6f009 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:59.381025 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecddc8-b0ff-4fc9-9681-acb833b6f009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:59.409658 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-71ecddc8-b0ff-4fc9-9681-acb833b6f009 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:10:59.410890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-71ecddc8-b0ff-4fc9-9681-acb833b6f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:10:59.496017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 138/273] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:10:59.552029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d54cb-8d32-4e45-9964-36bca021f9c8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:59.630644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:59.673176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d54cb-8d32-4e45-9964-36bca021f9c8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:59.714701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287569c-5b27-4736-9709-ae5a907e958a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:59.715696 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287569c-5b27-4736-9709-ae5a907e958a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:59.716316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287569c-5b27-4736-9709-ae5a907e958a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:59.716840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287569c-5b27-4736-9709-ae5a907e958a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:59.734341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287569c-5b27-4736-9709-ae5a907e958a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3287569c-5b27-4736-9709-ae5a907e958a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:10:59.740254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:10:59.741139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:10:59.741954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:10:59.744625 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 136/274] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:10:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:10:59.750926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecddc8-b0ff-4fc9-9681-acb833b6f009 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:59.806466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287569c-5b27-4736-9709-ae5a907e958a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:59.814741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:10:59.872914 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecddc8-b0ff-4fc9-9681-acb833b6f009 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:59.917425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a68e9-ebd3-4b3e-85a8-4a2a1f4a8214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:10:59.918423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a68e9-ebd3-4b3e-85a8-4a2a1f4a8214 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:10:59.918884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a68e9-ebd3-4b3e-85a8-4a2a1f4a8214 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:10:59.919463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a68e9-ebd3-4b3e-85a8-4a2a1f4a8214 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:10:59.921319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a68e9-ebd3-4b3e-85a8-4a2a1f4a8214 None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:10:59.921913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a68e9-ebd3-4b3e-85a8-4a2a1f4a8214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:10:59.923586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a68e9-ebd3-4b3e-85a8-4a2a1f4a8214 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:10:59.941119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 139/275] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:10:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:10:59.944746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a68e9-ebd3-4b3e-85a8-4a2a1f4a8214 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:10:59.964100 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287569c-5b27-4736-9709-ae5a907e958a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:10:59.994426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:00.004733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413e433-2cc6-4844-8612-d892779af30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:00.005250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413e433-2cc6-4844-8612-d892779af30b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:00.005527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413e433-2cc6-4844-8612-d892779af30b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:00.005803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413e433-2cc6-4844-8612-d892779af30b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:00.007150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413e433-2cc6-4844-8612-d892779af30b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:00.008847 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413e433-2cc6-4844-8612-d892779af30b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:00.015393 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 137/276] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:10:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:00.016262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413e433-2cc6-4844-8612-d892779af30b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:00.082848 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a68e9-ebd3-4b3e-85a8-4a2a1f4a8214 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:00.103459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:00.122318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ce35c-24d9-4041-9855-8a830bb229c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:00.122995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ce35c-24d9-4041-9855-8a830bb229c9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:00.123387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ce35c-24d9-4041-9855-8a830bb229c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:00.123661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ce35c-24d9-4041-9855-8a830bb229c9 None admin] PATH_INFO: `/v3/users/018d26fb1cba445c8458109358c5a7ac` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:00.126644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413e433-2cc6-4844-8612-d892779af30b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:00.138605 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ce35c-24d9-4041-9855-8a830bb229c9 None admin] RBAC: Authorizing `identity:get_user(user_id=018d26fb1cba445c8458109358c5a7ac)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:00.140435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ce35c-24d9-4041-9855-8a830bb229c9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:00.142694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 140/277] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:10:59 2022] GET /identity/v3/users/018d26fb1cba445c8458109358c5a7ac => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:00.144352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d159b-a7b2-4d0f-b4bf-9a412aab530b None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:00.144633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d159b-a7b2-4d0f-b4bf-9a412aab530b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:00.144907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d159b-a7b2-4d0f-b4bf-9a412aab530b None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:00.146136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 141/278] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:00.148349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d159b-a7b2-4d0f-b4bf-9a412aab530b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:00.168775 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71effb-d3b7-4bd9-ab35-22bce3fe0378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:00.169374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71effb-d3b7-4bd9-ab35-22bce3fe0378 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:00.169647 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71effb-d3b7-4bd9-ab35-22bce3fe0378 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:00.169915 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71effb-d3b7-4bd9-ab35-22bce3fe0378 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:00.170566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71effb-d3b7-4bd9-ab35-22bce3fe0378 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:00.172013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71effb-d3b7-4bd9-ab35-22bce3fe0378 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:00.195280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 138/279] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:11:00 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:11:00.196766 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3919712-23d7-418a-abda-02d972d1d251 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:00.197047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3919712-23d7-418a-abda-02d972d1d251 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:00.197618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3919712-23d7-418a-abda-02d972d1d251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:00.217740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d3919712-23d7-418a-abda-02d972d1d251 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:00.218981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d3919712-23d7-418a-abda-02d972d1d251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:00.289612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:00.297079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d159b-a7b2-4d0f-b4bf-9a412aab530b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:00.323942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 139/280] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:00.350790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0846c4-5dd3-49f0-a3ce-76eebcb971b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:00.351470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0846c4-5dd3-49f0-a3ce-76eebcb971b7 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:00.351753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0846c4-5dd3-49f0-a3ce-76eebcb971b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:00.352062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0846c4-5dd3-49f0-a3ce-76eebcb971b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:00.352855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0846c4-5dd3-49f0-a3ce-76eebcb971b7 None admin] RBAC: Adding query filter params (role.id=3009ebffeb104922b00cd072c83920c0, user.id=018d26fb1cba445c8458109358c5a7ac, scope.system=all) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:00.353162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0846c4-5dd3-49f0-a3ce-76eebcb971b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:00.354804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0846c4-5dd3-49f0-a3ce-76eebcb971b7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:00.361190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 142/281] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 18 06:11:00 2022] GET /identity/v3/role_assignments?user.id=018d26fb1cba445c8458109358c5a7ac&scope.system=all&role.id=3009ebffeb104922b00cd072c83920c0 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:00.607110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3919712-23d7-418a-abda-02d972d1d251 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:00.700433 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03acec9-3f7a-47f2-8e6d-10f713aa3a52 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:00.700752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03acec9-3f7a-47f2-8e6d-10f713aa3a52 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:00.700987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03acec9-3f7a-47f2-8e6d-10f713aa3a52 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:00.702336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 143/282] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:00.707676 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d358f-c8c5-41c4-be64-fd0b2d120315 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:00.707989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d358f-c8c5-41c4-be64-fd0b2d120315 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:00.708269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d358f-c8c5-41c4-be64-fd0b2d120315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:00.720740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3919712-23d7-418a-abda-02d972d1d251 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:00.728366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-274d358f-c8c5-41c4-be64-fd0b2d120315 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:00.729565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-274d358f-c8c5-41c4-be64-fd0b2d120315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:00.767011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:00.772155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83343050-837b-4c08-999d-fe23d0569c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:00.773065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343050-837b-4c08-999d-fe23d0569c9d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:00.773535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343050-837b-4c08-999d-fe23d0569c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:00.773995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343050-837b-4c08-999d-fe23d0569c9d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:00.788302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83343050-837b-4c08-999d-fe23d0569c9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-83343050-837b-4c08-999d-fe23d0569c9d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:00.795128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:00.796037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:11:00.796835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:00.798213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 140/283] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:00.804742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83343050-837b-4c08-999d-fe23d0569c9d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:00.819692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 144/284] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:00.861134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:00.923931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83343050-837b-4c08-999d-fe23d0569c9d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:00.960901 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41e5bd-5b1f-4874-8bd9-26bb367aa49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:00.961509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41e5bd-5b1f-4874-8bd9-26bb367aa49e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:00.961783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41e5bd-5b1f-4874-8bd9-26bb367aa49e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:00.962051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41e5bd-5b1f-4874-8bd9-26bb367aa49e None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:00.962704 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41e5bd-5b1f-4874-8bd9-26bb367aa49e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:00.963002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41e5bd-5b1f-4874-8bd9-26bb367aa49e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:00.964399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41e5bd-5b1f-4874-8bd9-26bb367aa49e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:00.974042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 141/285] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:00.979572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d358f-c8c5-41c4-be64-fd0b2d120315 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:01.099449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d358f-c8c5-41c4-be64-fd0b2d120315 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:01.144450 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab435d-8b00-4111-a9e9-176d27c02aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:01.145042 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab435d-8b00-4111-a9e9-176d27c02aeb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:01.159923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab435d-8b00-4111-a9e9-176d27c02aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:01.159923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab435d-8b00-4111-a9e9-176d27c02aeb None admin] PATH_INFO: `/v3/users/959ea40cd0c24f5b8e8bcdc047277b34` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:01.160130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41e5bd-5b1f-4874-8bd9-26bb367aa49e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:01.160202 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab435d-8b00-4111-a9e9-176d27c02aeb None admin] RBAC: Authorizing `identity:get_user(user_id=959ea40cd0c24f5b8e8bcdc047277b34)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:01.161594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab435d-8b00-4111-a9e9-176d27c02aeb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:01.163552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 145/286] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:11:00 2022] GET /identity/v3/users/959ea40cd0c24f5b8e8bcdc047277b34 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:01.168913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab435d-8b00-4111-a9e9-176d27c02aeb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:01.230375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:01.277355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41e5bd-5b1f-4874-8bd9-26bb367aa49e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:01.279812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:01.326101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33213a06-9532-4d19-948d-6cdc9ee6e65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:01.326745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33213a06-9532-4d19-948d-6cdc9ee6e65a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:01.327061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33213a06-9532-4d19-948d-6cdc9ee6e65a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:01.327344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33213a06-9532-4d19-948d-6cdc9ee6e65a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:01.340617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab435d-8b00-4111-a9e9-176d27c02aeb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:01.349564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33213a06-9532-4d19-948d-6cdc9ee6e65a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-33213a06-9532-4d19-948d-6cdc9ee6e65a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:01.354909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:01.356983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:01.358924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:01.365033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 142/287] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:01.370777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33213a06-9532-4d19-948d-6cdc9ee6e65a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:01.376740 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38690184-2edc-410e-9759-8531d230a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:01.377376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38690184-2edc-410e-9759-8531d230a67d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:01.378177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38690184-2edc-410e-9759-8531d230a67d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:01.378596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38690184-2edc-410e-9759-8531d230a67d None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:01.381425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38690184-2edc-410e-9759-8531d230a67d None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:01.382863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38690184-2edc-410e-9759-8531d230a67d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:01.385084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 146/288] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:01 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:01.397134 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38690184-2edc-410e-9759-8531d230a67d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:01.499231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33213a06-9532-4d19-948d-6cdc9ee6e65a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:01.527890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38690184-2edc-410e-9759-8531d230a67d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:01.541218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:01.564606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf195db6-9630-4322-a116-67df50e6aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:01.565906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195db6-9630-4322-a116-67df50e6aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:01.566216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195db6-9630-4322-a116-67df50e6aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:01.566476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf195db6-9630-4322-a116-67df50e6aaa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:01.567120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf195db6-9630-4322-a116-67df50e6aaa7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:01.567425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf195db6-9630-4322-a116-67df50e6aaa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:01.568835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf195db6-9630-4322-a116-67df50e6aaa7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:01.572167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe76d16-48ed-4204-a89d-60b4c236cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:01.572824 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe76d16-48ed-4204-a89d-60b4c236cbec None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:01.573102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe76d16-48ed-4204-a89d-60b4c236cbec None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:01.573375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe76d16-48ed-4204-a89d-60b4c236cbec None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f/users/959ea40cd0c24f5b8e8bcdc047277b34/roles/8bcabf2ca49c4f07920dd2e85ac800c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:01.575426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe76d16-48ed-4204-a89d-60b4c236cbec None admin] RBAC: Authorizing `identity:create_grant(project_id=1bd737f4546c4cc9b891a21ee738540f, user_id=959ea40cd0c24f5b8e8bcdc047277b34, role_id=8bcabf2ca49c4f07920dd2e85ac800c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:01.576875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe76d16-48ed-4204-a89d-60b4c236cbec None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:01.585063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 143/289] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:01.592945 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf195db6-9630-4322-a116-67df50e6aaa7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:01.597012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 147/290] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:11:01 2022] PUT /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f/users/959ea40cd0c24f5b8e8bcdc047277b34/roles/8bcabf2ca49c4f07920dd2e85ac800c0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:11:01.630044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:01.711845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf195db6-9630-4322-a116-67df50e6aaa7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:01.749070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9365fd-ac92-4590-a316-d03913347338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:01.749850 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9365fd-ac92-4590-a316-d03913347338 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:01.750032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9365fd-ac92-4590-a316-d03913347338 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:01.750220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9365fd-ac92-4590-a316-d03913347338 None admin] PATH_INFO: `/v3/users/d9c24ea70b7d414a866655d60d27b305` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:01.751374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9365fd-ac92-4590-a316-d03913347338 None admin] RBAC: Authorizing `identity:get_user(user_id=d9c24ea70b7d414a866655d60d27b305)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:01.753238 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9365fd-ac92-4590-a316-d03913347338 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:01.755365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 144/291] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:11:01 2022] GET /identity/v3/users/d9c24ea70b7d414a866655d60d27b305 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:01.761071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe76d16-48ed-4204-a89d-60b4c236cbec None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:01.884925 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe76d16-48ed-4204-a89d-60b4c236cbec None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:01.921964 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c667ca-40ed-417e-8948-87c5282441a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:01.922575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c667ca-40ed-417e-8948-87c5282441a9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:01.922848 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c667ca-40ed-417e-8948-87c5282441a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:01.923121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c667ca-40ed-417e-8948-87c5282441a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:01.960491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:01.997338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c667ca-40ed-417e-8948-87c5282441a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:01.998739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c667ca-40ed-417e-8948-87c5282441a9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:02.103179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 148/292] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:02.108512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9365fd-ac92-4590-a316-d03913347338 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:02.231728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:02.242920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9365fd-ac92-4590-a316-d03913347338 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:02.292798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282707ac-1b98-4c55-a406-4a847d0c0fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:02.293685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282707ac-1b98-4c55-a406-4a847d0c0fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:02.294125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282707ac-1b98-4c55-a406-4a847d0c0fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:02.294543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282707ac-1b98-4c55-a406-4a847d0c0fa9 None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:02.300585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282707ac-1b98-4c55-a406-4a847d0c0fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:02.302196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282707ac-1b98-4c55-a406-4a847d0c0fa9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:02.304314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 145/293] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:02 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:02.309963 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c667ca-40ed-417e-8948-87c5282441a9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:02.423254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:02.475389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c667ca-40ed-417e-8948-87c5282441a9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:02.520000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6315fae-d349-486d-837d-fbba338ade4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:02.520654 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315fae-d349-486d-837d-fbba338ade4a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:02.520936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315fae-d349-486d-837d-fbba338ade4a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:02.521213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315fae-d349-486d-837d-fbba338ade4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:02.521935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6315fae-d349-486d-837d-fbba338ade4a None admin] RBAC: Adding query filter params (role.id=3009ebffeb104922b00cd072c83920c0, scope.project.id=1bd737f4546c4cc9b891a21ee738540f, user.id=d9c24ea70b7d414a866655d60d27b305) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:02.522242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6315fae-d349-486d-837d-fbba338ade4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:02.523712 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6315fae-d349-486d-837d-fbba338ade4a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:02.537046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 149/294] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:02 2022] GET /identity/v3/role_assignments?user.id=d9c24ea70b7d414a866655d60d27b305&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=3009ebffeb104922b00cd072c83920c0 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:02.991789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d8044-b275-4242-927c-fd1fd1ccbd23 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:02.992818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d8044-b275-4242-927c-fd1fd1ccbd23 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:02.993356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d8044-b275-4242-927c-fd1fd1ccbd23 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:02.994946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 146/295] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:03.000913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aa409-c71a-4f05-b801-8bc74eaee67b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:03.001850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aa409-c71a-4f05-b801-8bc74eaee67b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:03.002846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aa409-c71a-4f05-b801-8bc74eaee67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:03.024847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b77aa409-c71a-4f05-b801-8bc74eaee67b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:03.026468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b77aa409-c71a-4f05-b801-8bc74eaee67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:03.038872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664b025-2332-4364-bc78-120e299312c7 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:03.039492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664b025-2332-4364-bc78-120e299312c7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:03.039998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664b025-2332-4364-bc78-120e299312c7 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:03.041898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 147/296] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:03.047609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d79eea-ec92-4a88-93a1-c614b3608845 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:03.048179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d79eea-ec92-4a88-93a1-c614b3608845 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:03.048664 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d79eea-ec92-4a88-93a1-c614b3608845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:03.070059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e0d79eea-ec92-4a88-93a1-c614b3608845 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:03.071505 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e0d79eea-ec92-4a88-93a1-c614b3608845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:03.114889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 150/297] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:03.149687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016d9b-2363-4983-aa9e-ef619e382a3a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:03.150243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016d9b-2363-4983-aa9e-ef619e382a3a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:03.150720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016d9b-2363-4983-aa9e-ef619e382a3a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:03.152276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 151/298] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:11:03.154040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 148/299] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:03.160200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb45c7-010b-448b-a918-f2525111d760 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:03.160733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb45c7-010b-448b-a918-f2525111d760 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:03.161203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb45c7-010b-448b-a918-f2525111d760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:03.179545 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-44eb45c7-010b-448b-a918-f2525111d760 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:03.181136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-44eb45c7-010b-448b-a918-f2525111d760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:03.238249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:03.250083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 152/300] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:03.415088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d79eea-ec92-4a88-93a1-c614b3608845 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:03.436043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb45c7-010b-448b-a918-f2525111d760 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:03.527115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:03.537852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d79eea-ec92-4a88-93a1-c614b3608845 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:03.559676 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb45c7-010b-448b-a918-f2525111d760 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:03.576757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3946df1-30af-42eb-aee6-73607a9f274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:03.577373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946df1-30af-42eb-aee6-73607a9f274b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:03.577807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946df1-30af-42eb-aee6-73607a9f274b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:03.578076 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946df1-30af-42eb-aee6-73607a9f274b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:03.579157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3946df1-30af-42eb-aee6-73607a9f274b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:03.580704 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3946df1-30af-42eb-aee6-73607a9f274b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:03.582742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 149/301] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:03.583316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3946df1-30af-42eb-aee6-73607a9f274b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:03.594663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74ad74-e6e9-4029-94f6-f5ae53ab014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:03.595302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ad74-e6e9-4029-94f6-f5ae53ab014c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:03.595581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ad74-e6e9-4029-94f6-f5ae53ab014c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:03.595852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ad74-e6e9-4029-94f6-f5ae53ab014c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:03.607715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74ad74-e6e9-4029-94f6-f5ae53ab014c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-3c74ad74-e6e9-4029-94f6-f5ae53ab014c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:03.612609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:03.613500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:03.614300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 153/302] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:03.615633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74ad74-e6e9-4029-94f6-f5ae53ab014c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:03.668324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:03.695602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3946df1-30af-42eb-aee6-73607a9f274b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:03.721682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74ad74-e6e9-4029-94f6-f5ae53ab014c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:03.730806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8d9d5-bb29-467d-a812-41a9a391500a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:03.731789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d9d5-bb29-467d-a812-41a9a391500a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:03.732093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d9d5-bb29-467d-a812-41a9a391500a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:03.732809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d9d5-bb29-467d-a812-41a9a391500a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:03.743466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8d9d5-bb29-467d-a812-41a9a391500a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-dca8d9d5-bb29-467d-a812-41a9a391500a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:03.748220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:03.749126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 150/303] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:03.753118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8d9d5-bb29-467d-a812-41a9a391500a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:03.762670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bd2ee-895b-4a0b-a2f7-77cafa93d299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:03.763520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bd2ee-895b-4a0b-a2f7-77cafa93d299 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:03.764072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bd2ee-895b-4a0b-a2f7-77cafa93d299 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:03.764516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bd2ee-895b-4a0b-a2f7-77cafa93d299 None admin] PATH_INFO: `/v3/groups` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:03.765301 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bd2ee-895b-4a0b-a2f7-77cafa93d299 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:03.767129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bd2ee-895b-4a0b-a2f7-77cafa93d299 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:03.773427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:03.796418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 154/304] 10.222.0.16 () {60 vars in 1134 bytes} [Sun Sep 18 06:11:03 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:11:03.797643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bd2ee-895b-4a0b-a2f7-77cafa93d299 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:03.881789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8d9d5-bb29-467d-a812-41a9a391500a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:03.930636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00936f90-093c-4f15-a7bc-39ecc7ed6459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:03.931518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936f90-093c-4f15-a7bc-39ecc7ed6459 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:03.931981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936f90-093c-4f15-a7bc-39ecc7ed6459 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:03.932426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936f90-093c-4f15-a7bc-39ecc7ed6459 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:03.933560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00936f90-093c-4f15-a7bc-39ecc7ed6459 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:03.934016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00936f90-093c-4f15-a7bc-39ecc7ed6459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:03.936291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00936f90-093c-4f15-a7bc-39ecc7ed6459 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:03.949970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 151/305] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:03.958230 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00936f90-093c-4f15-a7bc-39ecc7ed6459 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:03.962645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bd2ee-895b-4a0b-a2f7-77cafa93d299 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:03.975515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:04.013069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad833c4-9cdf-46dc-ac96-7d7091e23a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:04.016890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad833c4-9cdf-46dc-ac96-7d7091e23a6b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:04.017323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad833c4-9cdf-46dc-ac96-7d7091e23a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:04.018382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad833c4-9cdf-46dc-ac96-7d7091e23a6b None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:04.019252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad833c4-9cdf-46dc-ac96-7d7091e23a6b None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:04.020044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad833c4-9cdf-46dc-ac96-7d7091e23a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:04.022374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad833c4-9cdf-46dc-ac96-7d7091e23a6b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:04.035240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 155/306] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:04.040660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad833c4-9cdf-46dc-ac96-7d7091e23a6b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:04.064839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:04.086538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00936f90-093c-4f15-a7bc-39ecc7ed6459 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:04.123886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a474ae-3212-48aa-a48e-da9663830fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:04.124585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a474ae-3212-48aa-a48e-da9663830fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:04.124848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a474ae-3212-48aa-a48e-da9663830fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:04.125118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a474ae-3212-48aa-a48e-da9663830fc9 None admin] PATH_INFO: `/v3/users/bcace09cc46d48eb819000d92d3eaeb8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:04.140212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a474ae-3212-48aa-a48e-da9663830fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=bcace09cc46d48eb819000d92d3eaeb8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:04.141674 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a474ae-3212-48aa-a48e-da9663830fc9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:04.144290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 152/307] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:11:03 2022] GET /identity/v3/users/bcace09cc46d48eb819000d92d3eaeb8 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:04.149970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a474ae-3212-48aa-a48e-da9663830fc9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:04.173189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad833c4-9cdf-46dc-ac96-7d7091e23a6b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:04.220582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67fc21-0d56-4030-a16b-e9866259a4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:04.222363 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67fc21-0d56-4030-a16b-e9866259a4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:04.222826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67fc21-0d56-4030-a16b-e9866259a4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:04.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67fc21-0d56-4030-a16b-e9866259a4c2 None admin] PATH_INFO: `/v3/users/018d26fb1cba445c8458109358c5a7ac` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:04.224914 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67fc21-0d56-4030-a16b-e9866259a4c2 None admin] RBAC: Authorizing `identity:get_user(user_id=018d26fb1cba445c8458109358c5a7ac)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:04.227263 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67fc21-0d56-4030-a16b-e9866259a4c2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:04.235622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 156/308] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:11:04 2022] GET /identity/v3/users/018d26fb1cba445c8458109358c5a7ac => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:04.237242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67fc21-0d56-4030-a16b-e9866259a4c2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:04.265416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a474ae-3212-48aa-a48e-da9663830fc9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:04.286664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:04.309481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb6f66-7cf5-493a-9f3e-846b878e4974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:04.310631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb6f66-7cf5-493a-9f3e-846b878e4974 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:04.311200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb6f66-7cf5-493a-9f3e-846b878e4974 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:04.311617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb6f66-7cf5-493a-9f3e-846b878e4974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:04.312547 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb6f66-7cf5-493a-9f3e-846b878e4974 None admin] RBAC: Adding query filter params (role.id=8bcabf2ca49c4f07920dd2e85ac800c0, user.id=bcace09cc46d48eb819000d92d3eaeb8, scope.system=all) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:04.312856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb6f66-7cf5-493a-9f3e-846b878e4974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:04.314429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb6f66-7cf5-493a-9f3e-846b878e4974 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:04.321104 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 153/309] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 18 06:11:04 2022] GET /identity/v3/role_assignments?user.id=bcace09cc46d48eb819000d92d3eaeb8&scope.system=all&role.id=8bcabf2ca49c4f07920dd2e85ac800c0 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:04.360093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67fc21-0d56-4030-a16b-e9866259a4c2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:04.399423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78104c-6e99-46e2-b3a9-a8b823064b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:04.400511 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78104c-6e99-46e2-b3a9-a8b823064b9c None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:04.400993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78104c-6e99-46e2-b3a9-a8b823064b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:04.401495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78104c-6e99-46e2-b3a9-a8b823064b9c None admin] PATH_INFO: `/v3/system/users/018d26fb1cba445c8458109358c5a7ac/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:04.403248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78104c-6e99-46e2-b3a9-a8b823064b9c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=018d26fb1cba445c8458109358c5a7ac, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:04.404987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78104c-6e99-46e2-b3a9-a8b823064b9c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:04.417315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ac4c-a4e0-4fb4-bb2f-2c6fbcbda2d0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:04.417631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ac4c-a4e0-4fb4-bb2f-2c6fbcbda2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:04.417867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ac4c-a4e0-4fb4-bb2f-2c6fbcbda2d0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:04.418393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 157/310] 10.222.0.16 () {58 vars in 1334 bytes} [Sun Sep 18 06:11:04 2022] PUT /identity/v3/system/users/018d26fb1cba445c8458109358c5a7ac/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:11:04.419951 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 154/311] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:04.425646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece7db0-2f27-443b-bc01-9700b133cff4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:04.425940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece7db0-2f27-443b-bc01-9700b133cff4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:04.426206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece7db0-2f27-443b-bc01-9700b133cff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:04.447078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8ece7db0-2f27-443b-bc01-9700b133cff4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:04.448485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8ece7db0-2f27-443b-bc01-9700b133cff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:04.531327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 158/312] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:04.804844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847ac4c-a4e0-4fb4-bb2f-2c6fbcbda2d0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:04.809831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:04.927282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847ac4c-a4e0-4fb4-bb2f-2c6fbcbda2d0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:04.962842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123fde5-fc5b-4002-9f21-5cd31c82a2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:04.963475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123fde5-fc5b-4002-9f21-5cd31c82a2fc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:04.963749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123fde5-fc5b-4002-9f21-5cd31c82a2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:04.964040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123fde5-fc5b-4002-9f21-5cd31c82a2fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:04.974603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123fde5-fc5b-4002-9f21-5cd31c82a2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5123fde5-fc5b-4002-9f21-5cd31c82a2fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:04.979322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:04.980254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:04.981060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 155/313] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:04.988413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece7db0-2f27-443b-bc01-9700b133cff4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:05.023668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:05.097599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece7db0-2f27-443b-bc01-9700b133cff4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:05.134159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861bdc2-6327-4445-a575-11bacb0406ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:05.134766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861bdc2-6327-4445-a575-11bacb0406ad None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:05.135040 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861bdc2-6327-4445-a575-11bacb0406ad None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:05.135309 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861bdc2-6327-4445-a575-11bacb0406ad None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:05.135999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861bdc2-6327-4445-a575-11bacb0406ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:05.136294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861bdc2-6327-4445-a575-11bacb0406ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:05.137724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861bdc2-6327-4445-a575-11bacb0406ad None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:05.147287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 159/314] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:05.152905 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123fde5-fc5b-4002-9f21-5cd31c82a2fc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:05.218657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:05.259177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123fde5-fc5b-4002-9f21-5cd31c82a2fc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:05.294270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1036db-5ace-4caf-86f0-d4a8fd70a68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:05.294895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1036db-5ace-4caf-86f0-d4a8fd70a68b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:05.295171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1036db-5ace-4caf-86f0-d4a8fd70a68b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:05.295441 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1036db-5ace-4caf-86f0-d4a8fd70a68b None admin] PATH_INFO: `/v3/users/959ea40cd0c24f5b8e8bcdc047277b34` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:05.296580 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1036db-5ace-4caf-86f0-d4a8fd70a68b None admin] RBAC: Authorizing `identity:get_user(user_id=959ea40cd0c24f5b8e8bcdc047277b34)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:05.298024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1036db-5ace-4caf-86f0-d4a8fd70a68b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:05.300114 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 156/315] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:11:05 2022] GET /identity/v3/users/959ea40cd0c24f5b8e8bcdc047277b34 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:05.305688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861bdc2-6327-4445-a575-11bacb0406ad None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:05.413555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:05.419619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861bdc2-6327-4445-a575-11bacb0406ad None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:05.454106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c61c5-9532-49a2-bccc-01d883914a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:05.454751 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c61c5-9532-49a2-bccc-01d883914a04 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:05.455027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c61c5-9532-49a2-bccc-01d883914a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:05.455444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c61c5-9532-49a2-bccc-01d883914a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:05.526887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c61c5-9532-49a2-bccc-01d883914a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:05.528743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c61c5-9532-49a2-bccc-01d883914a04 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:05.624112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:05.635296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 160/316] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:05.636741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1036db-5ace-4caf-86f0-d4a8fd70a68b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:05.744443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1036db-5ace-4caf-86f0-d4a8fd70a68b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:05.775625 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:05.780844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ad71-09fc-4acc-b44f-4a074e01e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:05.781487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ad71-09fc-4acc-b44f-4a074e01e7fb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:05.781764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ad71-09fc-4acc-b44f-4a074e01e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:05.782040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ad71-09fc-4acc-b44f-4a074e01e7fb None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:05.783223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ad71-09fc-4acc-b44f-4a074e01e7fb None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:05.784858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ad71-09fc-4acc-b44f-4a074e01e7fb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:05.786501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 157/317] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:05 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:05.792658 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c61c5-9532-49a2-bccc-01d883914a04 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:05.898281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c61c5-9532-49a2-bccc-01d883914a04 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:05.933350 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a51f9-7166-4113-851f-4fd7b86090b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:05.934278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a51f9-7166-4113-851f-4fd7b86090b4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:05.934754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a51f9-7166-4113-851f-4fd7b86090b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:05.935238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a51f9-7166-4113-851f-4fd7b86090b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:05.936190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a51f9-7166-4113-851f-4fd7b86090b4 None admin] RBAC: Adding query filter params (role.id=8bcabf2ca49c4f07920dd2e85ac800c0, scope.project.id=1bd737f4546c4cc9b891a21ee738540f, user.id=959ea40cd0c24f5b8e8bcdc047277b34) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:05.936710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a51f9-7166-4113-851f-4fd7b86090b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:05.938331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a51f9-7166-4113-851f-4fd7b86090b4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:05.945493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 161/318] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:05 2022] GET /identity/v3/role_assignments?user.id=959ea40cd0c24f5b8e8bcdc047277b34&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=8bcabf2ca49c4f07920dd2e85ac800c0 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:06.197817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb70e-a6f0-4f2b-bbea-9d10b4435dcd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:06.198804 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb70e-a6f0-4f2b-bbea-9d10b4435dcd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:06.199306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bb70e-a6f0-4f2b-bbea-9d10b4435dcd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:06.200894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 158/319] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:06.207191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bddc1f-825c-4242-828c-466d21772035 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:06.207654 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bddc1f-825c-4242-828c-466d21772035 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:06.207730 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bddc1f-825c-4242-828c-466d21772035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:06.225853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-93bddc1f-825c-4242-828c-466d21772035 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:06.227035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-93bddc1f-825c-4242-828c-466d21772035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:06.285910 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:06.297964 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 162/320] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:06.563097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bb70e-a6f0-4f2b-bbea-9d10b4435dcd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:06.617063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3380a1-9e91-45cc-b48d-e319de6585d7 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:06.617806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3380a1-9e91-45cc-b48d-e319de6585d7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:06.618090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3380a1-9e91-45cc-b48d-e319de6585d7 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:06.619566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 163/321] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:11:06.624430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2bfdd-dd1a-416d-80a2-2f0da9f67434 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:06.624706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2bfdd-dd1a-416d-80a2-2f0da9f67434 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:06.624983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2bfdd-dd1a-416d-80a2-2f0da9f67434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:06.642929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-08b2bfdd-dd1a-416d-80a2-2f0da9f67434 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:06.644326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-08b2bfdd-dd1a-416d-80a2-2f0da9f67434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:06.675613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bb70e-a6f0-4f2b-bbea-9d10b4435dcd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:06.712542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 164/322] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:06.713783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f185eba-b596-4567-918c-b5b708abbc3c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:06.714062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f185eba-b596-4567-918c-b5b708abbc3c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:06.714330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f185eba-b596-4567-918c-b5b708abbc3c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:06.715546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 165/323] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:06.716839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e1088-b4fa-460d-a43e-caf2b35d2641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:06.717467 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e1088-b4fa-460d-a43e-caf2b35d2641 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:06.717741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e1088-b4fa-460d-a43e-caf2b35d2641 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:06.718007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e1088-b4fa-460d-a43e-caf2b35d2641 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:06.719126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e1088-b4fa-460d-a43e-caf2b35d2641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:06.720616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc524c6b-b4ab-4eb6-82a4-6e00cc5cf781 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:06.721312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e1088-b4fa-460d-a43e-caf2b35d2641 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:06.721432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc524c6b-b4ab-4eb6-82a4-6e00cc5cf781 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:06.721879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc524c6b-b4ab-4eb6-82a4-6e00cc5cf781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:06.723939 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 159/324] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:06.728058 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e1088-b4fa-460d-a43e-caf2b35d2641 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:06.740595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-dc524c6b-b4ab-4eb6-82a4-6e00cc5cf781 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:06.742005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dc524c6b-b4ab-4eb6-82a4-6e00cc5cf781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:06.797031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:06.816130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 166/325] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:06.841546 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e1088-b4fa-460d-a43e-caf2b35d2641 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:06.876808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4807b1-2742-4626-bb05-ea979c961858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:06.877737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4807b1-2742-4626-bb05-ea979c961858 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:06.878241 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4807b1-2742-4626-bb05-ea979c961858 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:06.878700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4807b1-2742-4626-bb05-ea979c961858 None admin] PATH_INFO: `/v3/groups` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:06.879547 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4807b1-2742-4626-bb05-ea979c961858 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:06.881201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4807b1-2742-4626-bb05-ea979c961858 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:06.899526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 160/326] 10.222.0.16 () {60 vars in 1134 bytes} [Sun Sep 18 06:11:06 2022] POST /identity/v3/groups => generated 226 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:11:06.987605 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc524c6b-b4ab-4eb6-82a4-6e00cc5cf781 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:07.042971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:07.089451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4807b1-2742-4626-bb05-ea979c961858 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:07.100711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc524c6b-b4ab-4eb6-82a4-6e00cc5cf781 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:07.140983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f476f-4732-4466-be8e-e3acb738de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:07.141673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f476f-4732-4466-be8e-e3acb738de85 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:07.141955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f476f-4732-4466-be8e-e3acb738de85 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:07.142235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f476f-4732-4466-be8e-e3acb738de85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:07.153982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f476f-4732-4466-be8e-e3acb738de85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-937f476f-4732-4466-be8e-e3acb738de85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:07.158979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:07.160215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:07.161027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 167/327] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:07.168266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f476f-4732-4466-be8e-e3acb738de85 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:07.220423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4807b1-2742-4626-bb05-ea979c961858 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:07.255573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:07.265196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f4c9f-79b1-4f03-9a34-8f7e9a5976c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:07.266161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f4c9f-79b1-4f03-9a34-8f7e9a5976c6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:07.266643 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f4c9f-79b1-4f03-9a34-8f7e9a5976c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:07.267103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f4c9f-79b1-4f03-9a34-8f7e9a5976c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:07.278984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f4c9f-79b1-4f03-9a34-8f7e9a5976c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f58f4c9f-79b1-4f03-9a34-8f7e9a5976c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:07.285517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:07.286436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:07.287279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 161/328] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:07.292946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f4c9f-79b1-4f03-9a34-8f7e9a5976c6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:07.294129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f476f-4732-4466-be8e-e3acb738de85 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:07.308225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:07.335480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f1526-3124-4914-8262-fb172584a74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:07.336215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f1526-3124-4914-8262-fb172584a74b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:07.336555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f1526-3124-4914-8262-fb172584a74b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:07.336834 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f1526-3124-4914-8262-fb172584a74b None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:07.337493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f1526-3124-4914-8262-fb172584a74b None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:07.337785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f1526-3124-4914-8262-fb172584a74b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:07.339170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f1526-3124-4914-8262-fb172584a74b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:07.350683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 168/329] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:07.356183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f1526-3124-4914-8262-fb172584a74b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:07.425319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f4c9f-79b1-4f03-9a34-8f7e9a5976c6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:07.472932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c609-7522-4c44-9c06-1a1077842518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:07.473781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c609-7522-4c44-9c06-1a1077842518 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:07.474205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c609-7522-4c44-9c06-1a1077842518 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:07.474648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c609-7522-4c44-9c06-1a1077842518 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:07.475453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537c609-7522-4c44-9c06-1a1077842518 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:07.475916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537c609-7522-4c44-9c06-1a1077842518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:07.477455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537c609-7522-4c44-9c06-1a1077842518 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:07.480992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f1526-3124-4914-8262-fb172584a74b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:07.488161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 162/330] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:07.496280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c609-7522-4c44-9c06-1a1077842518 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:07.531608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b7d57-71e9-40c7-b6f3-1cdd6d39177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:07.532325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7d57-71e9-40c7-b6f3-1cdd6d39177c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:07.532602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7d57-71e9-40c7-b6f3-1cdd6d39177c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:07.532872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7d57-71e9-40c7-b6f3-1cdd6d39177c None admin] PATH_INFO: `/v3/users/018d26fb1cba445c8458109358c5a7ac` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:07.534910 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b7d57-71e9-40c7-b6f3-1cdd6d39177c None admin] RBAC: Authorizing `identity:get_user(user_id=018d26fb1cba445c8458109358c5a7ac)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:07.536821 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b7d57-71e9-40c7-b6f3-1cdd6d39177c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:07.538277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 169/331] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:11:07 2022] GET /identity/v3/users/018d26fb1cba445c8458109358c5a7ac => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:07.544091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b7d57-71e9-40c7-b6f3-1cdd6d39177c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:07.567670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:07.592601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:07.624651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c609-7522-4c44-9c06-1a1077842518 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:07.671092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15599a43-7be1-42b7-b890-198933edb80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:07.671569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b7d57-71e9-40c7-b6f3-1cdd6d39177c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:07.671748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599a43-7be1-42b7-b890-198933edb80b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:07.672028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599a43-7be1-42b7-b890-198933edb80b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:07.672292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599a43-7be1-42b7-b890-198933edb80b None admin] PATH_INFO: `/v3/users/bcace09cc46d48eb819000d92d3eaeb8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:07.676040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15599a43-7be1-42b7-b890-198933edb80b None admin] RBAC: Authorizing `identity:get_user(user_id=bcace09cc46d48eb819000d92d3eaeb8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:07.676040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15599a43-7be1-42b7-b890-198933edb80b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:07.682357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 163/332] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:11:07 2022] GET /identity/v3/users/bcace09cc46d48eb819000d92d3eaeb8 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:07.683820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15599a43-7be1-42b7-b890-198933edb80b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:07.722225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc56442-8326-4e62-9985-bda9ef12ffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:07.723223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc56442-8326-4e62-9985-bda9ef12ffce None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:07.723693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc56442-8326-4e62-9985-bda9ef12ffce None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:07.724262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc56442-8326-4e62-9985-bda9ef12ffce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:07.725195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc56442-8326-4e62-9985-bda9ef12ffce None admin] RBAC: Adding query filter params (role.id=3009ebffeb104922b00cd072c83920c0, user.id=018d26fb1cba445c8458109358c5a7ac, scope.system=all) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:07.725798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc56442-8326-4e62-9985-bda9ef12ffce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:07.727473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc56442-8326-4e62-9985-bda9ef12ffce None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:07.744329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 170/333] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 18 06:11:07 2022] GET /identity/v3/role_assignments?user.id=018d26fb1cba445c8458109358c5a7ac&scope.system=all&role.id=3009ebffeb104922b00cd072c83920c0 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:07.815234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15599a43-7be1-42b7-b890-198933edb80b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:07.852292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:07.863266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d460dc-b428-4ad9-b992-989692bbff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:07.864915 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d460dc-b428-4ad9-b992-989692bbff9b None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:07.865413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d460dc-b428-4ad9-b992-989692bbff9b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:07.866039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d460dc-b428-4ad9-b992-989692bbff9b None admin] PATH_INFO: `/v3/system/users/bcace09cc46d48eb819000d92d3eaeb8/roles/8bcabf2ca49c4f07920dd2e85ac800c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:07.873674 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d460dc-b428-4ad9-b992-989692bbff9b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bcace09cc46d48eb819000d92d3eaeb8, role_id=8bcabf2ca49c4f07920dd2e85ac800c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:07.875504 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d460dc-b428-4ad9-b992-989692bbff9b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:07.892939 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 164/334] 10.222.0.16 () {58 vars in 1334 bytes} [Sun Sep 18 06:11:07 2022] PUT /identity/v3/system/users/bcace09cc46d48eb819000d92d3eaeb8/roles/8bcabf2ca49c4f07920dd2e85ac800c0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:11:09.446537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e5c8-2f82-42ee-ad32-19a87e7bfa2f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:09.447048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e5c8-2f82-42ee-ad32-19a87e7bfa2f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:09.447124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788e5c8-2f82-42ee-ad32-19a87e7bfa2f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:09.448759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 171/335] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:09.454750 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0b66-a4a5-472e-a8be-3cc2b12c7dd0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:09.455836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0b66-a4a5-472e-a8be-3cc2b12c7dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:09.455982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0b66-a4a5-472e-a8be-3cc2b12c7dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:09.481506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-658a0b66-a4a5-472e-a8be-3cc2b12c7dd0 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:09.482715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-658a0b66-a4a5-472e-a8be-3cc2b12c7dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:09.566365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 165/336] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:09.899131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788e5c8-2f82-42ee-ad32-19a87e7bfa2f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:10.013394 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:10.018972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788e5c8-2f82-42ee-ad32-19a87e7bfa2f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:10.055111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be445a5-45e7-46e7-83cf-4930087b735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:10.055760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be445a5-45e7-46e7-83cf-4930087b735b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:10.056048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be445a5-45e7-46e7-83cf-4930087b735b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:10.056320 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be445a5-45e7-46e7-83cf-4930087b735b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:10.070524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be445a5-45e7-46e7-83cf-4930087b735b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-4be445a5-45e7-46e7-83cf-4930087b735b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:10.075315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:10.076308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:10.077096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:10.079153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 172/337] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:10.084844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a0b66-a4a5-472e-a8be-3cc2b12c7dd0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:10.210915 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a0b66-a4a5-472e-a8be-3cc2b12c7dd0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:10.230618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:10.253577 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548e72c-44f2-41d7-b0a4-2b367daab89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:10.254237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548e72c-44f2-41d7-b0a4-2b367daab89e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:10.254516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548e72c-44f2-41d7-b0a4-2b367daab89e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:10.254845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548e72c-44f2-41d7-b0a4-2b367daab89e None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:10.255509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548e72c-44f2-41d7-b0a4-2b367daab89e None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:10.255863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548e72c-44f2-41d7-b0a4-2b367daab89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:10.257333 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548e72c-44f2-41d7-b0a4-2b367daab89e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:10.269231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 166/338] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:10.275305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be445a5-45e7-46e7-83cf-4930087b735b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:10.399811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be445a5-45e7-46e7-83cf-4930087b735b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:10.455642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2791258-0a11-4b52-9660-bc226db19e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:10.456406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791258-0a11-4b52-9660-bc226db19e6c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:10.456644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791258-0a11-4b52-9660-bc226db19e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:10.456827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791258-0a11-4b52-9660-bc226db19e6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:10.487378 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:10.529081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072441-dcc8-4443-80df-3744fffca8f8 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:10.529584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072441-dcc8-4443-80df-3744fffca8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:10.529690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072441-dcc8-4443-80df-3744fffca8f8 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:10.530954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 167/339] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:11:10.537500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2791258-0a11-4b52-9660-bc226db19e6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:10.539417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf744d-0457-41ff-b26b-724e9af4ecd3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:10.539695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf744d-0457-41ff-b26b-724e9af4ecd3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:10.539988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf744d-0457-41ff-b26b-724e9af4ecd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:10.548196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2791258-0a11-4b52-9660-bc226db19e6c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:10.570804 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a9cf744d-0457-41ff-b26b-724e9af4ecd3 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:10.572053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a9cf744d-0457-41ff-b26b-724e9af4ecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:10.713597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 168/340] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:10.715172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90fe94-0b0f-4ef3-8d4b-16c767c24be2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:10.715455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90fe94-0b0f-4ef3-8d4b-16c767c24be2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:10.715727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90fe94-0b0f-4ef3-8d4b-16c767c24be2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:10.718390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 169/341] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:10.727280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b9c9a-e2a6-4a9d-9218-8a00e6cca900 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:10.727561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b9c9a-e2a6-4a9d-9218-8a00e6cca900 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:10.727838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b9c9a-e2a6-4a9d-9218-8a00e6cca900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:10.738033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 173/342] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:10.756808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2791258-0a11-4b52-9660-bc226db19e6c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:10.760927 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2e0b9c9a-e2a6-4a9d-9218-8a00e6cca900 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:10.766538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2e0b9c9a-e2a6-4a9d-9218-8a00e6cca900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:10.863476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:10.933667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 170/343] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:10.934991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2791258-0a11-4b52-9660-bc226db19e6c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:10.995362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b695992-bd92-42b9-bf1a-72679fb8380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:10.995940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b695992-bd92-42b9-bf1a-72679fb8380d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:10.996215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b695992-bd92-42b9-bf1a-72679fb8380d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:10.996485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b695992-bd92-42b9-bf1a-72679fb8380d None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:11.000581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b695992-bd92-42b9-bf1a-72679fb8380d None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:11.002249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b695992-bd92-42b9-bf1a-72679fb8380d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:11.004438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 174/344] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:10 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:11.010319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b9c9a-e2a6-4a9d-9218-8a00e6cca900 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:11.059676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:11.089458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45eac2-4308-47af-9c46-cedeab7da280 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:11.090068 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45eac2-4308-47af-9c46-cedeab7da280 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:11.090539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45eac2-4308-47af-9c46-cedeab7da280 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:11.092413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 175/345] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:11.099089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739bfc-9b04-4d92-a5b4-c1ff61523e39 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:11.099627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739bfc-9b04-4d92-a5b4-c1ff61523e39 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:11.100150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75739bfc-9b04-4d92-a5b4-c1ff61523e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:11.139968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b9c9a-e2a6-4a9d-9218-8a00e6cca900 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:11.152918 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-75739bfc-9b04-4d92-a5b4-c1ff61523e39 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:11.154283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-75739bfc-9b04-4d92-a5b4-c1ff61523e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:11.179327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cf365-c2f4-4d5d-b3eb-4e132d9c1435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:11.180243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cf365-c2f4-4d5d-b3eb-4e132d9c1435 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:11.180669 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cf365-c2f4-4d5d-b3eb-4e132d9c1435 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:11.181115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cf365-c2f4-4d5d-b3eb-4e132d9c1435 None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:11.187369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cf365-c2f4-4d5d-b3eb-4e132d9c1435 None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:11.189826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cf365-c2f4-4d5d-b3eb-4e132d9c1435 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:11.196055 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 171/346] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:11 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:11.198606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cf365-c2f4-4d5d-b3eb-4e132d9c1435 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:11.305126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:11.309349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cf365-c2f4-4d5d-b3eb-4e132d9c1435 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:11.351879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 176/347] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:11.352335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47380458-12e4-4719-8414-6f174219fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:11.353195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47380458-12e4-4719-8414-6f174219fa37 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:11.353333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739bfc-9b04-4d92-a5b4-c1ff61523e39 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:11.353742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47380458-12e4-4719-8414-6f174219fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:11.354202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47380458-12e4-4719-8414-6f174219fa37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:11.355109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47380458-12e4-4719-8414-6f174219fa37 None admin] RBAC: Adding query filter params (group.id=49fa5674d4b04c9aa57560b968e9a289, role.id=3009ebffeb104922b00cd072c83920c0, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:11.355595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47380458-12e4-4719-8414-6f174219fa37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:11.357267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47380458-12e4-4719-8414-6f174219fa37 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:11.377299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 172/348] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 18 06:11:11 2022] GET /identity/v3/role_assignments?group.id=49fa5674d4b04c9aa57560b968e9a289&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=3009ebffeb104922b00cd072c83920c0 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:11.388356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47380458-12e4-4719-8414-6f174219fa37 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:11.426639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:11.494975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75739bfc-9b04-4d92-a5b4-c1ff61523e39 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:11.544273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47380458-12e4-4719-8414-6f174219fa37 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:11.556821 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fc903-47f5-43cc-83d9-ab6b4c28af64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:11.557547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fc903-47f5-43cc-83d9-ab6b4c28af64 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:11.558043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fc903-47f5-43cc-83d9-ab6b4c28af64 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:11.558509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fc903-47f5-43cc-83d9-ab6b4c28af64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:11.573498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fc903-47f5-43cc-83d9-ab6b4c28af64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d54fc903-47f5-43cc-83d9-ab6b4c28af64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:11.583939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:11.584890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:11.585687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 177/349] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:11.591533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc6038-9ffd-469d-b5d6-0577e0e1b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:11.592281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc6038-9ffd-469d-b5d6-0577e0e1b93a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:11.592565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc6038-9ffd-469d-b5d6-0577e0e1b93a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:11.592842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc6038-9ffd-469d-b5d6-0577e0e1b93a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:11.596831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fc903-47f5-43cc-83d9-ab6b4c28af64 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:11.632921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc6038-9ffd-469d-b5d6-0577e0e1b93a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7cbc6038-9ffd-469d-b5d6-0577e0e1b93a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:11.638431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:11.639417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:11.640707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 173/350] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:11:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:11.648977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc6038-9ffd-469d-b5d6-0577e0e1b93a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:11.698652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:11.756174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fc903-47f5-43cc-83d9-ab6b4c28af64 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:11.778541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:11.803300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a31cc-5e01-4e48-8608-2ed930a7d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:11.804481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a31cc-5e01-4e48-8608-2ed930a7d644 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:11.805226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a31cc-5e01-4e48-8608-2ed930a7d644 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:11.805505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a31cc-5e01-4e48-8608-2ed930a7d644 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:11.806180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a31cc-5e01-4e48-8608-2ed930a7d644 None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:11.806482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a31cc-5e01-4e48-8608-2ed930a7d644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:11.807955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a31cc-5e01-4e48-8608-2ed930a7d644 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:11.813659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc6038-9ffd-469d-b5d6-0577e0e1b93a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:11.819148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 178/351] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:11.820188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a31cc-5e01-4e48-8608-2ed930a7d644 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:11.868336 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7582b78-457c-4f9c-b270-7ff3a47ef5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:11.869231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7582b78-457c-4f9c-b270-7ff3a47ef5ea None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:11.869682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7582b78-457c-4f9c-b270-7ff3a47ef5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:11.870159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7582b78-457c-4f9c-b270-7ff3a47ef5ea None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:11.870827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7582b78-457c-4f9c-b270-7ff3a47ef5ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:11.871277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7582b78-457c-4f9c-b270-7ff3a47ef5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:11.872918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7582b78-457c-4f9c-b270-7ff3a47ef5ea None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:11.883184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 174/352] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:11.884956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb004-32f7-41cd-ad28-4d29b39bf85b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:11.885442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb004-32f7-41cd-ad28-4d29b39bf85b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:11.885912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb004-32f7-41cd-ad28-4d29b39bf85b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:11.887333 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 175/353] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:11.888285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb004-32f7-41cd-ad28-4d29b39bf85b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:11.956502 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a31cc-5e01-4e48-8608-2ed930a7d644 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:11.989119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:12.009476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b444359-44ee-475a-9b24-9e95973bfac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:12.010609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b444359-44ee-475a-9b24-9e95973bfac5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:12.011104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b444359-44ee-475a-9b24-9e95973bfac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:12.011565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b444359-44ee-475a-9b24-9e95973bfac5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:12.018275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb004-32f7-41cd-ad28-4d29b39bf85b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:12.025903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b444359-44ee-475a-9b24-9e95973bfac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-1b444359-44ee-475a-9b24-9e95973bfac5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:12.032954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:12.033838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 06:11:12.034621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:12.037031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 179/354] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:12.038881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b444359-44ee-475a-9b24-9e95973bfac5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:12.065193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cddf6e-2b11-4bd3-bd2c-222b464a09b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:12.066330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cddf6e-2b11-4bd3-bd2c-222b464a09b5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:12.066818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cddf6e-2b11-4bd3-bd2c-222b464a09b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:12.067281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cddf6e-2b11-4bd3-bd2c-222b464a09b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:12.086887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:12.156919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cddf6e-2b11-4bd3-bd2c-222b464a09b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:12.159067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cddf6e-2b11-4bd3-bd2c-222b464a09b5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:12.166870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b444359-44ee-475a-9b24-9e95973bfac5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:12.203982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7b277-1d06-4a19-84b3-0b1ba1b0e28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:12.205154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7b277-1d06-4a19-84b3-0b1ba1b0e28b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:12.205826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7b277-1d06-4a19-84b3-0b1ba1b0e28b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:12.206386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7b277-1d06-4a19-84b3-0b1ba1b0e28b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:12.251335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:12.272988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 176/355] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:12.274763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3b0f3-e21e-42c5-b5c6-f588e9317aa8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:12.275254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3b0f3-e21e-42c5-b5c6-f588e9317aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:12.275727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3b0f3-e21e-42c5-b5c6-f588e9317aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:12.285796 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7b277-1d06-4a19-84b3-0b1ba1b0e28b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:12.287480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7b277-1d06-4a19-84b3-0b1ba1b0e28b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:12.295877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-41e3b0f3-e21e-42c5-b5c6-f588e9317aa8 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:12.297421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-41e3b0f3-e21e-42c5-b5c6-f588e9317aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:12.330429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:12.374081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 177/356] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:12.375544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3b0f3-e21e-42c5-b5c6-f588e9317aa8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:12.402770 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 180/357] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:12.404091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7b277-1d06-4a19-84b3-0b1ba1b0e28b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:12.490168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3b0f3-e21e-42c5-b5c6-f588e9317aa8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:12.506179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:12.514414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7b277-1d06-4a19-84b3-0b1ba1b0e28b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:12.531185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c311a24-680f-4fce-b457-4bc4be3fc707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:12.532334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c311a24-680f-4fce-b457-4bc4be3fc707 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:12.532334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c311a24-680f-4fce-b457-4bc4be3fc707 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:12.532788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c311a24-680f-4fce-b457-4bc4be3fc707 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:12.534417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c311a24-680f-4fce-b457-4bc4be3fc707 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:12.534817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c311a24-680f-4fce-b457-4bc4be3fc707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:12.536474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c311a24-680f-4fce-b457-4bc4be3fc707 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:12.545858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 178/358] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:12.546716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c311a24-680f-4fce-b457-4bc4be3fc707 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:12.574955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1d2de-5985-4d69-80cd-834abc4f2ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:12.575858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1d2de-5985-4d69-80cd-834abc4f2ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:12.576296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1d2de-5985-4d69-80cd-834abc4f2ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:12.576698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1d2de-5985-4d69-80cd-834abc4f2ba1 None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:12.579133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1d2de-5985-4d69-80cd-834abc4f2ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:12.581872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1d2de-5985-4d69-80cd-834abc4f2ba1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:12.584086 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 181/359] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:12 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:12.585000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1d2de-5985-4d69-80cd-834abc4f2ba1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:12.598528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:12.663163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c311a24-680f-4fce-b457-4bc4be3fc707 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:12.700700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bdab2-757b-4f13-b9cf-75cecfe95960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:12.701478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdab2-757b-4f13-b9cf-75cecfe95960 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:12.701860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdab2-757b-4f13-b9cf-75cecfe95960 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:12.702232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdab2-757b-4f13-b9cf-75cecfe95960 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:12.703477 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bdab2-757b-4f13-b9cf-75cecfe95960 None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:12.705885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bdab2-757b-4f13-b9cf-75cecfe95960 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:12.707784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 179/360] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:12 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:12.708798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bdab2-757b-4f13-b9cf-75cecfe95960 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:12.754971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1d2de-5985-4d69-80cd-834abc4f2ba1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:12.762146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:12.797596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602a36e-01f7-484a-a111-8cd4285fa40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:12.798228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602a36e-01f7-484a-a111-8cd4285fa40a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:12.798533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602a36e-01f7-484a-a111-8cd4285fa40a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:12.798844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602a36e-01f7-484a-a111-8cd4285fa40a None admin] PATH_INFO: `/v3/users/bcace09cc46d48eb819000d92d3eaeb8` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:12.800066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602a36e-01f7-484a-a111-8cd4285fa40a None admin] RBAC: Authorizing `identity:get_user(user_id=bcace09cc46d48eb819000d92d3eaeb8)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:12.802095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602a36e-01f7-484a-a111-8cd4285fa40a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:12.804195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 182/361] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:11:12 2022] GET /identity/v3/users/bcace09cc46d48eb819000d92d3eaeb8 => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:12.805585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602a36e-01f7-484a-a111-8cd4285fa40a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:12.843064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bdab2-757b-4f13-b9cf-75cecfe95960 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:12.892183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e33198-ecd0-454a-a903-320fb534d5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:12.893229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33198-ecd0-454a-a903-320fb534d5de None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:12.893511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33198-ecd0-454a-a903-320fb534d5de None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:12.893790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33198-ecd0-454a-a903-320fb534d5de None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:12.894931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33198-ecd0-454a-a903-320fb534d5de None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:12.897320 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33198-ecd0-454a-a903-320fb534d5de None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:12.899603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 180/362] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:12 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:12.900763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e33198-ecd0-454a-a903-320fb534d5de None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:12.907520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:12.940700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602a36e-01f7-484a-a111-8cd4285fa40a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:12.984807 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce26f4b-ee28-4922-91ba-054481cccb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:12.984807 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce26f4b-ee28-4922-91ba-054481cccb1b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:12.985098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce26f4b-ee28-4922-91ba-054481cccb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:12.985098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce26f4b-ee28-4922-91ba-054481cccb1b None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:12.986944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce26f4b-ee28-4922-91ba-054481cccb1b None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:12.989924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce26f4b-ee28-4922-91ba-054481cccb1b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:12.996404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 183/363] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:12 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:12.996404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce26f4b-ee28-4922-91ba-054481cccb1b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:13.025162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e33198-ecd0-454a-a903-320fb534d5de None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:13.042750 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:13.071023 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302fc6c-660d-4cf9-ab2f-53eeee1e9116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:13.071661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302fc6c-660d-4cf9-ab2f-53eeee1e9116 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:13.071977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302fc6c-660d-4cf9-ab2f-53eeee1e9116 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:13.072264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302fc6c-660d-4cf9-ab2f-53eeee1e9116 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:13.087601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302fc6c-660d-4cf9-ab2f-53eeee1e9116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8302fc6c-660d-4cf9-ab2f-53eeee1e9116 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:13.095553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:13.096755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 181/364] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:11:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:13.098240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302fc6c-660d-4cf9-ab2f-53eeee1e9116 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:13.119989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce26f4b-ee28-4922-91ba-054481cccb1b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:13.162734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17265b-9629-491d-86d2-1abda50088e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:13.163347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17265b-9629-491d-86d2-1abda50088e8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:13.163629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17265b-9629-491d-86d2-1abda50088e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:13.163926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17265b-9629-491d-86d2-1abda50088e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:13.164701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17265b-9629-491d-86d2-1abda50088e8 None admin] RBAC: Adding query filter params (role.id=8bcabf2ca49c4f07920dd2e85ac800c0, user.id=bcace09cc46d48eb819000d92d3eaeb8, scope.system=all) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:13.165012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17265b-9629-491d-86d2-1abda50088e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:13.166459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17265b-9629-491d-86d2-1abda50088e8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:13.175706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:13.181144 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 184/365] 10.222.0.16 () {56 vars in 1308 bytes} [Sun Sep 18 06:11:12 2022] GET /identity/v3/role_assignments?user.id=bcace09cc46d48eb819000d92d3eaeb8&scope.system=all&role.id=8bcabf2ca49c4f07920dd2e85ac800c0 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:13.182458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfa5fb-a3dd-4edc-a3b3-d41879d7a86b None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:13.182743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfa5fb-a3dd-4edc-a3b3-d41879d7a86b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:13.183058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfa5fb-a3dd-4edc-a3b3-d41879d7a86b None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:13.184326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 185/366] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:13.185163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfa5fb-a3dd-4edc-a3b3-d41879d7a86b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:13.250138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302fc6c-660d-4cf9-ab2f-53eeee1e9116 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:13.293645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652d12a-2a7f-4151-9328-3c05cdb3dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:13.294612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d12a-2a7f-4151-9328-3c05cdb3dee7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:13.295074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d12a-2a7f-4151-9328-3c05cdb3dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:13.295529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d12a-2a7f-4151-9328-3c05cdb3dee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:13.296481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652d12a-2a7f-4151-9328-3c05cdb3dee7 None admin] RBAC: Adding query filter params (group.id=49fa5674d4b04c9aa57560b968e9a289, role.id=3009ebffeb104922b00cd072c83920c0, scope.project.id=1bd737f4546c4cc9b891a21ee738540f) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:13.296985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652d12a-2a7f-4151-9328-3c05cdb3dee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:13.299182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652d12a-2a7f-4151-9328-3c05cdb3dee7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:13.306911 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 182/367] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 18 06:11:13 2022] GET /identity/v3/role_assignments?group.id=49fa5674d4b04c9aa57560b968e9a289&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=3009ebffeb104922b00cd072c83920c0 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:13.308640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652d12a-2a7f-4151-9328-3c05cdb3dee7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:13.313299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfa5fb-a3dd-4edc-a3b3-d41879d7a86b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:13.356753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7856901-a25b-4e97-80d6-eb7ee69a7d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:13.357290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7856901-a25b-4e97-80d6-eb7ee69a7d8d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:13.357569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7856901-a25b-4e97-80d6-eb7ee69a7d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:13.357840 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7856901-a25b-4e97-80d6-eb7ee69a7d8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:13.358626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7856901-a25b-4e97-80d6-eb7ee69a7d8d None admin] RBAC: Adding query filter params (group.id=49fa5674d4b04c9aa57560b968e9a289, role.id=fbc3d149dd894c219e21c220b192281a, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:13.358945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7856901-a25b-4e97-80d6-eb7ee69a7d8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:13.359791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:13.360607 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7856901-a25b-4e97-80d6-eb7ee69a7d8d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:13.368849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 186/368] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 18 06:11:13 2022] GET /identity/v3/role_assignments?group.id=49fa5674d4b04c9aa57560b968e9a289&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=fbc3d149dd894c219e21c220b192281a => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:13.370402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f573-4dc4-4594-b4b8-d03d96651c6a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:13.370690 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f573-4dc4-4594-b4b8-d03d96651c6a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:13.370965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f573-4dc4-4594-b4b8-d03d96651c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:13.395590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6ec2f573-4dc4-4594-b4b8-d03d96651c6a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:13.396958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6ec2f573-4dc4-4594-b4b8-d03d96651c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:13.452600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652d12a-2a7f-4151-9328-3c05cdb3dee7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:13.474564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:13.487256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 187/369] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:13.497364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1714978-a47c-46a1-be01-edc6882c1f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:13.498372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714978-a47c-46a1-be01-edc6882c1f1c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:13.498863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714978-a47c-46a1-be01-edc6882c1f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:13.499350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714978-a47c-46a1-be01-edc6882c1f1c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:13.500300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1714978-a47c-46a1-be01-edc6882c1f1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:13.500837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1714978-a47c-46a1-be01-edc6882c1f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:13.503533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1714978-a47c-46a1-be01-edc6882c1f1c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:13.514038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 183/370] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:13.522574 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2f573-4dc4-4594-b4b8-d03d96651c6a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:13.644571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2f573-4dc4-4594-b4b8-d03d96651c6a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:13.685946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27309c14-7589-4850-af0b-749f34b9ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:13.686578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309c14-7589-4850-af0b-749f34b9ced2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:13.686855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309c14-7589-4850-af0b-749f34b9ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:13.687129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309c14-7589-4850-af0b-749f34b9ced2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:13.762610 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:13.772800 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27309c14-7589-4850-af0b-749f34b9ced2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:13.774288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27309c14-7589-4850-af0b-749f34b9ced2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:13.840307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1714978-a47c-46a1-be01-edc6882c1f1c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:13.903741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 188/371] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:13.912950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27309c14-7589-4850-af0b-749f34b9ced2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:13.983933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:13.989234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1714978-a47c-46a1-be01-edc6882c1f1c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:14.050978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b0297-e7d7-4d2c-b743-7276d38e0164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:14.051623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0297-e7d7-4d2c-b743-7276d38e0164 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:14.051919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0297-e7d7-4d2c-b743-7276d38e0164 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:14.052199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0297-e7d7-4d2c-b743-7276d38e0164 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:14.074383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b0297-e7d7-4d2c-b743-7276d38e0164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b27b0297-e7d7-4d2c-b743-7276d38e0164 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:14.080558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:14.081745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:14.082553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 184/372] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:11:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:14.084054 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:14.091809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27309c14-7589-4850-af0b-749f34b9ced2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:14.092993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b0297-e7d7-4d2c-b743-7276d38e0164 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:14.142544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078863a2-0023-4285-b303-0ba22d0dd97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:14.143192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078863a2-0023-4285-b303-0ba22d0dd97a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:14.143501 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078863a2-0023-4285-b303-0ba22d0dd97a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:14.143757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078863a2-0023-4285-b303-0ba22d0dd97a None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:14.145180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078863a2-0023-4285-b303-0ba22d0dd97a None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:14.147586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078863a2-0023-4285-b303-0ba22d0dd97a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:14.152901 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 189/373] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:13 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:14.154849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078863a2-0023-4285-b303-0ba22d0dd97a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:14.243022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b0297-e7d7-4d2c-b743-7276d38e0164 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:14.281021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79204eb-5a86-4574-8b26-1a08e3306615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:14.281875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79204eb-5a86-4574-8b26-1a08e3306615 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:14.282415 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79204eb-5a86-4574-8b26-1a08e3306615 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:14.283414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79204eb-5a86-4574-8b26-1a08e3306615 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:14.284274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79204eb-5a86-4574-8b26-1a08e3306615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:14.284723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79204eb-5a86-4574-8b26-1a08e3306615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:14.286260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79204eb-5a86-4574-8b26-1a08e3306615 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:14.295958 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 185/374] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:14.304859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79204eb-5a86-4574-8b26-1a08e3306615 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:14.331347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:14.340293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078863a2-0023-4285-b303-0ba22d0dd97a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:14.386642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e17be8-a085-475c-a1a0-c1248609545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:14.387312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e17be8-a085-475c-a1a0-c1248609545f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:14.387594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e17be8-a085-475c-a1a0-c1248609545f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:14.387854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e17be8-a085-475c-a1a0-c1248609545f None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:14.389142 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e17be8-a085-475c-a1a0-c1248609545f None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:14.390671 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e17be8-a085-475c-a1a0-c1248609545f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:14.393244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 190/375] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:14 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:14.394395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88c601-8929-4899-bdea-231785620e94 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:14.394670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88c601-8929-4899-bdea-231785620e94 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:14.394940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88c601-8929-4899-bdea-231785620e94 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:14.404074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 191/376] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:14.405360 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88c601-8929-4899-bdea-231785620e94 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:14.425440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79204eb-5a86-4574-8b26-1a08e3306615 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:14.437197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:14.465894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ae333-4d0b-4d71-aeea-0481373cacd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:14.466939 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae333-4d0b-4d71-aeea-0481373cacd1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:14.467548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae333-4d0b-4d71-aeea-0481373cacd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:14.468082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae333-4d0b-4d71-aeea-0481373cacd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:14.527660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88c601-8929-4899-bdea-231785620e94 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:14.545952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ae333-4d0b-4d71-aeea-0481373cacd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:14.547773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ae333-4d0b-4d71-aeea-0481373cacd1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:14.570502 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d237d29-ea35-4b19-a36c-91b2d1321c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:14.571108 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d237d29-ea35-4b19-a36c-91b2d1321c3b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:14.571381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d237d29-ea35-4b19-a36c-91b2d1321c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:14.571650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d237d29-ea35-4b19-a36c-91b2d1321c3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:14.572431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d237d29-ea35-4b19-a36c-91b2d1321c3b None admin] RBAC: Adding query filter params (group.id=49fa5674d4b04c9aa57560b968e9a289, role.id=fbc3d149dd894c219e21c220b192281a, scope.project.id=1bd737f4546c4cc9b891a21ee738540f) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:14.573070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:14.573747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d237d29-ea35-4b19-a36c-91b2d1321c3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:14.575300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d237d29-ea35-4b19-a36c-91b2d1321c3b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:14.582394 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 192/377] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 18 06:11:14 2022] GET /identity/v3/role_assignments?group.id=49fa5674d4b04c9aa57560b968e9a289&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=fbc3d149dd894c219e21c220b192281a => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:14.583609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad57dc-43b7-4760-9c16-d6a294a964d6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:14.583887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad57dc-43b7-4760-9c16-d6a294a964d6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:14.588378 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad57dc-43b7-4760-9c16-d6a294a964d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:14.624687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-09ad57dc-43b7-4760-9c16-d6a294a964d6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:14.626007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-09ad57dc-43b7-4760-9c16-d6a294a964d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:14.699886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 186/378] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 18 06:11:14.706461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ae333-4d0b-4d71-aeea-0481373cacd1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:14.765935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 193/379] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:14.829052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ae333-4d0b-4d71-aeea-0481373cacd1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:14.851779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:14.870928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d611e8-d21b-4eaf-a34d-4f5d63110590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:14.871612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d611e8-d21b-4eaf-a34d-4f5d63110590 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:14.871894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d611e8-d21b-4eaf-a34d-4f5d63110590 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:14.872195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d611e8-d21b-4eaf-a34d-4f5d63110590 None admin] PATH_INFO: `/v3/projects/51a6b33098764a2dacc62af886817c55` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:14.873373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d611e8-d21b-4eaf-a34d-4f5d63110590 None admin] RBAC: Authorizing `identity:get_project(project_id=51a6b33098764a2dacc62af886817c55)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:14.874808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d611e8-d21b-4eaf-a34d-4f5d63110590 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:14.876974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 187/380] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:14 2022] GET /identity/v3/projects/51a6b33098764a2dacc62af886817c55 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:14.882972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad57dc-43b7-4760-9c16-d6a294a964d6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:14.911520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:14.996551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad57dc-43b7-4760-9c16-d6a294a964d6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:15.035928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4e2d2-d108-413a-a391-a2578b36e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:15.036620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e2d2-d108-413a-a391-a2578b36e057 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:15.036904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e2d2-d108-413a-a391-a2578b36e057 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:15.037222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e2d2-d108-413a-a391-a2578b36e057 None admin] PATH_INFO: `/v3/groups/842040fcb72d4b00935495a6e1f721bb` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:15.045341 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4e2d2-d108-413a-a391-a2578b36e057 None admin] RBAC: Authorizing `identity:get_group(group_id=842040fcb72d4b00935495a6e1f721bb)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:15.046880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4e2d2-d108-413a-a391-a2578b36e057 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:15.048929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 194/381] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:14 2022] GET /identity/v3/groups/842040fcb72d4b00935495a6e1f721bb => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:15.054854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d611e8-d21b-4eaf-a34d-4f5d63110590 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:15.134304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4e2d2-d108-413a-a391-a2578b36e057 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:15.198656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d611e8-d21b-4eaf-a34d-4f5d63110590 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:15.245367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be055124-2001-41f5-963d-dce377e58ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:15.245984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be055124-2001-41f5-963d-dce377e58ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:15.246268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be055124-2001-41f5-963d-dce377e58ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:15.246548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be055124-2001-41f5-963d-dce377e58ab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:15.247458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be055124-2001-41f5-963d-dce377e58ab9 None admin] RBAC: Adding query filter params (group.id=842040fcb72d4b00935495a6e1f721bb, role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=51a6b33098764a2dacc62af886817c55) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:15.247717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be055124-2001-41f5-963d-dce377e58ab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:15.251606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be055124-2001-41f5-963d-dce377e58ab9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:15.264167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 188/382] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 18 06:11:15 2022] GET /identity/v3/role_assignments?group.id=842040fcb72d4b00935495a6e1f721bb&scope.project.id=51a6b33098764a2dacc62af886817c55&role.id=4494ba66c3f649febc69511a47e27b67 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:15.313547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:15.340521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4e2d2-d108-413a-a391-a2578b36e057 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:15.387410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4aa07-3af9-495d-aaf1-3c1a7138189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:15.388140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4aa07-3af9-495d-aaf1-3c1a7138189a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:15.388419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4aa07-3af9-495d-aaf1-3c1a7138189a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:15.388688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4aa07-3af9-495d-aaf1-3c1a7138189a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:15.401609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4aa07-3af9-495d-aaf1-3c1a7138189a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-f1b4aa07-3af9-495d-aaf1-3c1a7138189a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:15.406874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:15.408012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:15.409011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 195/383] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:15.416213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be055124-2001-41f5-963d-dce377e58ab9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:15.502682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:15.556135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be055124-2001-41f5-963d-dce377e58ab9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:15.597997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd02e5c-27f4-454d-910a-2fa5af6b36f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:15.598619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd02e5c-27f4-454d-910a-2fa5af6b36f9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:15.598897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd02e5c-27f4-454d-910a-2fa5af6b36f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:15.599169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd02e5c-27f4-454d-910a-2fa5af6b36f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:15.599831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd02e5c-27f4-454d-910a-2fa5af6b36f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:15.600159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd02e5c-27f4-454d-910a-2fa5af6b36f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:15.601523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd02e5c-27f4-454d-910a-2fa5af6b36f9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:15.610796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 189/384] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:15.616363 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4aa07-3af9-495d-aaf1-3c1a7138189a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:15.734504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4aa07-3af9-495d-aaf1-3c1a7138189a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:15.775465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72907286-6a89-44dc-8a80-e1c71116a584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:15.776054 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907286-6a89-44dc-8a80-e1c71116a584 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:15.776335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907286-6a89-44dc-8a80-e1c71116a584 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:15.776607 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907286-6a89-44dc-8a80-e1c71116a584 None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:15.777732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72907286-6a89-44dc-8a80-e1c71116a584 None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:15.779173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72907286-6a89-44dc-8a80-e1c71116a584 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:15.781077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 196/385] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:15 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:15.787035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd02e5c-27f4-454d-910a-2fa5af6b36f9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:15.900643 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd02e5c-27f4-454d-910a-2fa5af6b36f9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:15.915989 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:15.947401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1f551-4dba-4bf3-a3f2-3c33deb2018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:15.948061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1f551-4dba-4bf3-a3f2-3c33deb2018a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:15.948342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1f551-4dba-4bf3-a3f2-3c33deb2018a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:15.948615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1f551-4dba-4bf3-a3f2-3c33deb2018a None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:15.949767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1f551-4dba-4bf3-a3f2-3c33deb2018a None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:15.951193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1f551-4dba-4bf3-a3f2-3c33deb2018a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:15.952849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 190/386] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:15 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:15.959715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72907286-6a89-44dc-8a80-e1c71116a584 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:15.982941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:16.087095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72907286-6a89-44dc-8a80-e1c71116a584 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:16.123811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab5bc6-338e-4aca-bbc7-ac603988623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:16.124499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab5bc6-338e-4aca-bbc7-ac603988623d None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:16.124776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab5bc6-338e-4aca-bbc7-ac603988623d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:16.125049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab5bc6-338e-4aca-bbc7-ac603988623d None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/groups/49fa5674d4b04c9aa57560b968e9a289/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:16.126992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab5bc6-338e-4aca-bbc7-ac603988623d None admin] RBAC: Authorizing `identity:create_grant(project_id=5392f8ed83ee41e8bfc7496a8c67f385, group_id=49fa5674d4b04c9aa57560b968e9a289, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:16.128518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab5bc6-338e-4aca-bbc7-ac603988623d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:16.145360 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 197/387] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 18 06:11:15 2022] PUT /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/groups/49fa5674d4b04c9aa57560b968e9a289/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:11:16.391266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182f77b-cc0e-4a90-88cc-fdaf1fdd742e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:16.391451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182f77b-cc0e-4a90-88cc-fdaf1fdd742e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:16.391724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182f77b-cc0e-4a90-88cc-fdaf1fdd742e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:16.393487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 191/388] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:16.400232 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa7eb5-7fb7-4887-9b54-7469cf7d5229 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:16.400530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa7eb5-7fb7-4887-9b54-7469cf7d5229 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:16.400784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa7eb5-7fb7-4887-9b54-7469cf7d5229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:16.424184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b5fa7eb5-7fb7-4887-9b54-7469cf7d5229 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:16.425468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b5fa7eb5-7fb7-4887-9b54-7469cf7d5229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:16.527600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 198/389] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:16.618793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741892-1942-401d-913b-c0df672c9ccf None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:16.619106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741892-1942-401d-913b-c0df672c9ccf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:16.619345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741892-1942-401d-913b-c0df672c9ccf None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:16.620869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 192/390] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:16.629643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b101-9f13-4e6c-b86a-3108efc5166d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:16.630509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b101-9f13-4e6c-b86a-3108efc5166d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:16.630999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b101-9f13-4e6c-b86a-3108efc5166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:16.646223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:16.657280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e181b101-9f13-4e6c-b86a-3108efc5166d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:16.659529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e181b101-9f13-4e6c-b86a-3108efc5166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:16.746083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 199/391] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:16.855762 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad741892-1942-401d-913b-c0df672c9ccf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:16.976966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad741892-1942-401d-913b-c0df672c9ccf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:17.021769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd58c43-a942-4e26-b99f-46332c48c6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:17.022463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd58c43-a942-4e26-b99f-46332c48c6ad None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:17.022798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd58c43-a942-4e26-b99f-46332c48c6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:17.023074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd58c43-a942-4e26-b99f-46332c48c6ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:17.035552 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd58c43-a942-4e26-b99f-46332c48c6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4bd58c43-a942-4e26-b99f-46332c48c6ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:17.041376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:17.042296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:17.043097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 193/392] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:17.050851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181b101-9f13-4e6c-b86a-3108efc5166d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:17.179659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181b101-9f13-4e6c-b86a-3108efc5166d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:17.222928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95f151-a88a-483c-b7b3-a82ee6380df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:17.223534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f151-a88a-483c-b7b3-a82ee6380df9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:17.223808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f151-a88a-483c-b7b3-a82ee6380df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:17.224104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f151-a88a-483c-b7b3-a82ee6380df9 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:17.224758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95f151-a88a-483c-b7b3-a82ee6380df9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:17.225055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95f151-a88a-483c-b7b3-a82ee6380df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:17.226430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95f151-a88a-483c-b7b3-a82ee6380df9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:17.228869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:17.239392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 200/393] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:17.244979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd58c43-a942-4e26-b99f-46332c48c6ad None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:17.287577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95f151-a88a-483c-b7b3-a82ee6380df9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:17.329266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:17.449084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd58c43-a942-4e26-b99f-46332c48c6ad None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:17.478707 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95f151-a88a-483c-b7b3-a82ee6380df9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:17.519163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2330273-60f7-4448-ae2e-66a4ee9f21cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:17.519656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330273-60f7-4448-ae2e-66a4ee9f21cf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:17.520077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330273-60f7-4448-ae2e-66a4ee9f21cf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:17.520351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330273-60f7-4448-ae2e-66a4ee9f21cf None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:17.521855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2330273-60f7-4448-ae2e-66a4ee9f21cf None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:17.523868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2330273-60f7-4448-ae2e-66a4ee9f21cf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:17.526118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 194/394] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:17 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:17.527378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be946fb-b2e9-471c-9e1f-670bf41f06f2 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:17.527661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be946fb-b2e9-471c-9e1f-670bf41f06f2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:17.528064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be946fb-b2e9-471c-9e1f-670bf41f06f2 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:17.529779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 195/395] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:17.531592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be946fb-b2e9-471c-9e1f-670bf41f06f2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:17.534584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a6c3f-18a0-4a65-9656-2a6680ba7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:17.535227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a6c3f-18a0-4a65-9656-2a6680ba7de4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:17.535504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a6c3f-18a0-4a65-9656-2a6680ba7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:17.535776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a6c3f-18a0-4a65-9656-2a6680ba7de4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:17.549752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a6c3f-18a0-4a65-9656-2a6680ba7de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-327a6c3f-18a0-4a65-9656-2a6680ba7de4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:17.557185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:17.558112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:17.558916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 201/396] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:11:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:17.559610 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351fad-8041-426e-9d07-d243d799d957 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:17.563924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351fad-8041-426e-9d07-d243d799d957 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:17.563924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351fad-8041-426e-9d07-d243d799d957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:17.581160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e7351fad-8041-426e-9d07-d243d799d957 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:17.582485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e7351fad-8041-426e-9d07-d243d799d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:17.645653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:17.661623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 202/397] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:17.663756 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7351fad-8041-426e-9d07-d243d799d957 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:17.690168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be946fb-b2e9-471c-9e1f-670bf41f06f2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:17.711021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:17.761776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bff02-4ad3-4343-921b-50f1fdd5cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:17.762406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bff02-4ad3-4343-921b-50f1fdd5cf9b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:17.762684 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bff02-4ad3-4343-921b-50f1fdd5cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:17.762959 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bff02-4ad3-4343-921b-50f1fdd5cf9b None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:17.764432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bff02-4ad3-4343-921b-50f1fdd5cf9b None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:17.765942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bff02-4ad3-4343-921b-50f1fdd5cf9b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:17.768960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 196/398] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:17 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:17.775195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bff02-4ad3-4343-921b-50f1fdd5cf9b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:17.870175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7351fad-8041-426e-9d07-d243d799d957 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:17.909118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bff02-4ad3-4343-921b-50f1fdd5cf9b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:17.920335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e875-81b0-48b0-9def-0e8ecd532bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:17.920957 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e875-81b0-48b0-9def-0e8ecd532bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:17.921234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e875-81b0-48b0-9def-0e8ecd532bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:17.921503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e875-81b0-48b0-9def-0e8ecd532bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:17.922169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367e875-81b0-48b0-9def-0e8ecd532bd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:17.922471 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367e875-81b0-48b0-9def-0e8ecd532bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:17.923932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367e875-81b0-48b0-9def-0e8ecd532bd4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:17.940078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 203/399] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:17.950655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e875-81b0-48b0-9def-0e8ecd532bd4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:17.951841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e4454-14f5-4e84-8fc1-0ce82de3cbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:17.952781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e4454-14f5-4e84-8fc1-0ce82de3cbaa None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:17.953253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e4454-14f5-4e84-8fc1-0ce82de3cbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:17.953791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e4454-14f5-4e84-8fc1-0ce82de3cbaa None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f/groups/49fa5674d4b04c9aa57560b968e9a289/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:17.956266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e4454-14f5-4e84-8fc1-0ce82de3cbaa None admin] RBAC: Authorizing `identity:create_grant(project_id=1bd737f4546c4cc9b891a21ee738540f, group_id=49fa5674d4b04c9aa57560b968e9a289, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:17.958003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e4454-14f5-4e84-8fc1-0ce82de3cbaa None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:17.980947 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 197/400] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 18 06:11:17 2022] PUT /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f/groups/49fa5674d4b04c9aa57560b968e9a289/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:11:18.029440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:18.089782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e4454-14f5-4e84-8fc1-0ce82de3cbaa None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:18.096827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e875-81b0-48b0-9def-0e8ecd532bd4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:18.141458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:18.145275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14422e-7bc2-4d5f-bc27-1d9e34fef8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:18.145929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14422e-7bc2-4d5f-bc27-1d9e34fef8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:18.146210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14422e-7bc2-4d5f-bc27-1d9e34fef8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:18.146485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14422e-7bc2-4d5f-bc27-1d9e34fef8f0 None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:18.147651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14422e-7bc2-4d5f-bc27-1d9e34fef8f0 None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:18.149672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14422e-7bc2-4d5f-bc27-1d9e34fef8f0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:18.155985 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 204/401] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:17 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:18.158456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dacae-ae1b-48b8-b2dc-390616107143 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:18.158729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dacae-ae1b-48b8-b2dc-390616107143 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:18.159224 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dacae-ae1b-48b8-b2dc-390616107143 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:18.160894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 205/402] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:18.161644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dacae-ae1b-48b8-b2dc-390616107143 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:18.240604 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e4454-14f5-4e84-8fc1-0ce82de3cbaa None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:18.281128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de22ab-fcc7-4483-9d08-3da7d51a33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:18.281682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de22ab-fcc7-4483-9d08-3da7d51a33e7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:18.282066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de22ab-fcc7-4483-9d08-3da7d51a33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:18.282337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de22ab-fcc7-4483-9d08-3da7d51a33e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:18.292183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dacae-ae1b-48b8-b2dc-390616107143 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:18.300873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de22ab-fcc7-4483-9d08-3da7d51a33e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c2de22ab-fcc7-4483-9d08-3da7d51a33e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:18.306458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:18.307369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:18.308277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 198/403] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:11:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:18.309434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba55e4-5e63-43ef-a835-ecac8b9ce131 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:18.309715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba55e4-5e63-43ef-a835-ecac8b9ce131 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:18.309996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba55e4-5e63-43ef-a835-ecac8b9ce131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:18.320138 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:18.331503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c5ba55e4-5e63-43ef-a835-ecac8b9ce131 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:18.332818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c5ba55e4-5e63-43ef-a835-ecac8b9ce131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:18.337201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f8147-f2db-4fef-8381-4b30bf225f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:18.338094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8147-f2db-4fef-8381-4b30bf225f3c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:18.338570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8147-f2db-4fef-8381-4b30bf225f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:18.340075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8147-f2db-4fef-8381-4b30bf225f3c None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:18.341648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f8147-f2db-4fef-8381-4b30bf225f3c None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:18.343298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f8147-f2db-4fef-8381-4b30bf225f3c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:18.345235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 206/404] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:18 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:18.346221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f8147-f2db-4fef-8381-4b30bf225f3c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:18.416088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 199/405] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:18.417015 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba55e4-5e63-43ef-a835-ecac8b9ce131 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:18.446411 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:18.459533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f8147-f2db-4fef-8381-4b30bf225f3c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:18.526232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba55e4-5e63-43ef-a835-ecac8b9ce131 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:18.527098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4706e4-434a-46f5-9c7c-bff87e821af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:18.527833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4706e4-434a-46f5-9c7c-bff87e821af6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:18.528230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4706e4-434a-46f5-9c7c-bff87e821af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:18.528596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4706e4-434a-46f5-9c7c-bff87e821af6 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:18.529351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4706e4-434a-46f5-9c7c-bff87e821af6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:18.530295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4706e4-434a-46f5-9c7c-bff87e821af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:18.531276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4706e4-434a-46f5-9c7c-bff87e821af6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:18.552307 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 207/406] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:18.553352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4706e4-434a-46f5-9c7c-bff87e821af6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:18.569452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae6f6b-8438-4fb8-9f2a-2c80848fbe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:18.571517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae6f6b-8438-4fb8-9f2a-2c80848fbe06 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:18.571999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae6f6b-8438-4fb8-9f2a-2c80848fbe06 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:18.572512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae6f6b-8438-4fb8-9f2a-2c80848fbe06 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/groups/49fa5674d4b04c9aa57560b968e9a289/roles/fbc3d149dd894c219e21c220b192281a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:18.575071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae6f6b-8438-4fb8-9f2a-2c80848fbe06 None admin] RBAC: Authorizing `identity:create_grant(project_id=5392f8ed83ee41e8bfc7496a8c67f385, group_id=49fa5674d4b04c9aa57560b968e9a289, role_id=fbc3d149dd894c219e21c220b192281a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:18.576776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae6f6b-8438-4fb8-9f2a-2c80848fbe06 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:18.602578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 200/407] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 18 06:11:18 2022] PUT /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385/groups/49fa5674d4b04c9aa57560b968e9a289/roles/fbc3d149dd894c219e21c220b192281a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:11:18.650465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:18.722329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4706e4-434a-46f5-9c7c-bff87e821af6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:18.765823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253ddf6-ea06-4c0f-92b2-316616a0f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:18.766470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ddf6-ea06-4c0f-92b2-316616a0f28d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:18.766753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ddf6-ea06-4c0f-92b2-316616a0f28d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:18.767201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ddf6-ea06-4c0f-92b2-316616a0f28d None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:18.772820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253ddf6-ea06-4c0f-92b2-316616a0f28d None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:18.774347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253ddf6-ea06-4c0f-92b2-316616a0f28d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:18.776234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 208/408] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:18 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:18.784476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae6f6b-8438-4fb8-9f2a-2c80848fbe06 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:18.852671 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253ddf6-ea06-4c0f-92b2-316616a0f28d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:18.916836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:18.932272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae6f6b-8438-4fb8-9f2a-2c80848fbe06 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:18.979803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253ddf6-ea06-4c0f-92b2-316616a0f28d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:18.984379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8bbf8-b330-4c5a-9298-6f756d0bf3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:18.986085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8bbf8-b330-4c5a-9298-6f756d0bf3cd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:18.986611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8bbf8-b330-4c5a-9298-6f756d0bf3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:18.987144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8bbf8-b330-4c5a-9298-6f756d0bf3cd None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:18.988561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8bbf8-b330-4c5a-9298-6f756d0bf3cd None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:18.990186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8bbf8-b330-4c5a-9298-6f756d0bf3cd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:18.997732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:19.000396 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 201/409] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:18 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:19.001468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8bbf8-b330-4c5a-9298-6f756d0bf3cd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:19.019135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c84f8c-143a-46cf-9e50-5fd3a7fa322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:19.020122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c84f8c-143a-46cf-9e50-5fd3a7fa322d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:19.020660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c84f8c-143a-46cf-9e50-5fd3a7fa322d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:19.021163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c84f8c-143a-46cf-9e50-5fd3a7fa322d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:19.032912 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c84f8c-143a-46cf-9e50-5fd3a7fa322d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-34c84f8c-143a-46cf-9e50-5fd3a7fa322d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:19.038763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:19.039726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:19.040565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:19.042812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 209/410] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:11:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:19.056115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c84f8c-143a-46cf-9e50-5fd3a7fa322d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:19.183479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8bbf8-b330-4c5a-9298-6f756d0bf3cd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:19.246193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c84f8c-143a-46cf-9e50-5fd3a7fa322d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:19.257874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d39e5-547c-48ec-85e2-ffb7afb20cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:19.258548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d39e5-547c-48ec-85e2-ffb7afb20cdb None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:19.258822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d39e5-547c-48ec-85e2-ffb7afb20cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:19.259094 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d39e5-547c-48ec-85e2-ffb7afb20cdb None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f/groups/49fa5674d4b04c9aa57560b968e9a289/roles/fbc3d149dd894c219e21c220b192281a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:19.264639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d39e5-547c-48ec-85e2-ffb7afb20cdb None admin] RBAC: Authorizing `identity:create_grant(project_id=1bd737f4546c4cc9b891a21ee738540f, group_id=49fa5674d4b04c9aa57560b968e9a289, role_id=fbc3d149dd894c219e21c220b192281a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:19.266085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d39e5-547c-48ec-85e2-ffb7afb20cdb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:19.287016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 202/411] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 18 06:11:19 2022] PUT /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f/groups/49fa5674d4b04c9aa57560b968e9a289/roles/fbc3d149dd894c219e21c220b192281a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:11:19.288388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba6bd1-18ee-4716-ad80-033154f18de4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:19.288670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba6bd1-18ee-4716-ad80-033154f18de4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:19.289089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba6bd1-18ee-4716-ad80-033154f18de4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:19.290546 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 203/412] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:19.303387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d266c16-bb3f-420d-bd63-3d78178e5db9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:19.303739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d266c16-bb3f-420d-bd63-3d78178e5db9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:19.304041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d266c16-bb3f-420d-bd63-3d78178e5db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:19.320636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd25ba-23f9-46a6-a002-f0e3d436e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:19.321266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd25ba-23f9-46a6-a002-f0e3d436e670 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:19.321541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd25ba-23f9-46a6-a002-f0e3d436e670 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:19.321812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd25ba-23f9-46a6-a002-f0e3d436e670 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:19.322558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd25ba-23f9-46a6-a002-f0e3d436e670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:19.322863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd25ba-23f9-46a6-a002-f0e3d436e670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:19.328552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd25ba-23f9-46a6-a002-f0e3d436e670 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:19.340160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1d266c16-bb3f-420d-bd63-3d78178e5db9 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:19.342439 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1d266c16-bb3f-420d-bd63-3d78178e5db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:19.346461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 210/413] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:19.352862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd25ba-23f9-46a6-a002-f0e3d436e670 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:19.371481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:19.442666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:19.459403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 204/414] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:19.517249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd25ba-23f9-46a6-a002-f0e3d436e670 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:19.553314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe3130-5006-4b24-91d9-72535b29dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:19.553832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe3130-5006-4b24-91d9-72535b29dbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:19.554109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe3130-5006-4b24-91d9-72535b29dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:19.554381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe3130-5006-4b24-91d9-72535b29dbe3 None admin] PATH_INFO: `/v3/groups/842040fcb72d4b00935495a6e1f721bb` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:19.555495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe3130-5006-4b24-91d9-72535b29dbe3 None admin] RBAC: Authorizing `identity:get_group(group_id=842040fcb72d4b00935495a6e1f721bb)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:19.556965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe3130-5006-4b24-91d9-72535b29dbe3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:19.558829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 211/415] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:19 2022] GET /identity/v3/groups/842040fcb72d4b00935495a6e1f721bb => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:19.565092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d266c16-bb3f-420d-bd63-3d78178e5db9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:19.685694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d266c16-bb3f-420d-bd63-3d78178e5db9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:19.732634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774b0e4-6955-4f60-a2b7-a1fbfee55158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:19.733285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b0e4-6955-4f60-a2b7-a1fbfee55158 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:19.733566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b0e4-6955-4f60-a2b7-a1fbfee55158 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:19.733845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774b0e4-6955-4f60-a2b7-a1fbfee55158 None admin] PATH_INFO: `/v3/projects/51a6b33098764a2dacc62af886817c55` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:19.734986 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774b0e4-6955-4f60-a2b7-a1fbfee55158 None admin] RBAC: Authorizing `identity:get_project(project_id=51a6b33098764a2dacc62af886817c55)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:19.737061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774b0e4-6955-4f60-a2b7-a1fbfee55158 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:19.738772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 205/416] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:19 2022] GET /identity/v3/projects/51a6b33098764a2dacc62af886817c55 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:19.744525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe3130-5006-4b24-91d9-72535b29dbe3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:19.785541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774b0e4-6955-4f60-a2b7-a1fbfee55158 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:19.813315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:19.909272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe3130-5006-4b24-91d9-72535b29dbe3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:19.924865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:19.972041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774b0e4-6955-4f60-a2b7-a1fbfee55158 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:19.984154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa63d0-1c58-49ed-9907-1b3503c4c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:19.984821 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa63d0-1c58-49ed-9907-1b3503c4c1fc None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:19.985142 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa63d0-1c58-49ed-9907-1b3503c4c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:19.985931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa63d0-1c58-49ed-9907-1b3503c4c1fc None admin] PATH_INFO: `/v3/projects/51a6b33098764a2dacc62af886817c55/groups/842040fcb72d4b00935495a6e1f721bb/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:19.996787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa63d0-1c58-49ed-9907-1b3503c4c1fc None admin] RBAC: Authorizing `identity:create_grant(project_id=51a6b33098764a2dacc62af886817c55, group_id=842040fcb72d4b00935495a6e1f721bb, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:19.998256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa63d0-1c58-49ed-9907-1b3503c4c1fc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:20.007770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e46eb-6ee0-4da0-ade2-d871acfb2e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:20.008430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e46eb-6ee0-4da0-ade2-d871acfb2e19 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:20.008868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e46eb-6ee0-4da0-ade2-d871acfb2e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:20.009149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e46eb-6ee0-4da0-ade2-d871acfb2e19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:20.018890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 212/417] 10.222.0.16 () {58 vars in 1442 bytes} [Sun Sep 18 06:11:19 2022] PUT /identity/v3/projects/51a6b33098764a2dacc62af886817c55/groups/842040fcb72d4b00935495a6e1f721bb/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:11:20.021379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e46eb-6ee0-4da0-ade2-d871acfb2e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-274e46eb-6ee0-4da0-ade2-d871acfb2e19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:20.026523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:20.027495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:20.028342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 206/418] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:20.034217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa63d0-1c58-49ed-9907-1b3503c4c1fc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:20.172316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa63d0-1c58-49ed-9907-1b3503c4c1fc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:20.214553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82d5c1-019e-48a8-b07e-3040f18469ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:20.215172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82d5c1-019e-48a8-b07e-3040f18469ce None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:20.215451 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82d5c1-019e-48a8-b07e-3040f18469ce None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:20.215724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82d5c1-019e-48a8-b07e-3040f18469ce None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:20.216429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82d5c1-019e-48a8-b07e-3040f18469ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:20.216732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82d5c1-019e-48a8-b07e-3040f18469ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:20.218164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82d5c1-019e-48a8-b07e-3040f18469ce None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:20.228070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 213/419] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:20.233942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e46eb-6ee0-4da0-ade2-d871acfb2e19 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:20.334561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:20.365844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e46eb-6ee0-4da0-ade2-d871acfb2e19 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:20.418061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a9ea3-a890-4457-aa3f-3c7d90837fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:20.418973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9ea3-a890-4457-aa3f-3c7d90837fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:20.419420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9ea3-a890-4457-aa3f-3c7d90837fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:20.419863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a9ea3-a890-4457-aa3f-3c7d90837fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:20.510011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a9ea3-a890-4457-aa3f-3c7d90837fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:20.511734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a9ea3-a890-4457-aa3f-3c7d90837fc5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:20.620555 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:20.654381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 207/420] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:20.659771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82d5c1-019e-48a8-b07e-3040f18469ce None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:20.679428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322f515-1e40-40d6-8aa9-4b636c9eb150 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:20.679428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322f515-1e40-40d6-8aa9-4b636c9eb150 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:20.679428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322f515-1e40-40d6-8aa9-4b636c9eb150 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:20.679428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 208/421] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:20.684897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76376047-96b7-46d4-8bf5-fdce17327239 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:20.685179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76376047-96b7-46d4-8bf5-fdce17327239 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:20.685455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76376047-96b7-46d4-8bf5-fdce17327239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:20.706968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-76376047-96b7-46d4-8bf5-fdce17327239 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:20.708214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-76376047-96b7-46d4-8bf5-fdce17327239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:20.720712 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:20.795364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 209/422] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:20.840889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82d5c1-019e-48a8-b07e-3040f18469ce None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:20.877176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e967cbf-3bf7-4485-a8c2-0073b9bed3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:20.877822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e967cbf-3bf7-4485-a8c2-0073b9bed3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:20.878105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e967cbf-3bf7-4485-a8c2-0073b9bed3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:20.878376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e967cbf-3bf7-4485-a8c2-0073b9bed3d6 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:20.879519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e967cbf-3bf7-4485-a8c2-0073b9bed3d6 None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:20.881007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e967cbf-3bf7-4485-a8c2-0073b9bed3d6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:20.883013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 214/423] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:20 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:20.888705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76376047-96b7-46d4-8bf5-fdce17327239 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:21.006662 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76376047-96b7-46d4-8bf5-fdce17327239 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:21.009423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:21.056691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec1370-752b-4845-b4ab-24980e3b6e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:21.057237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1370-752b-4845-b4ab-24980e3b6e46 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:21.057512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1370-752b-4845-b4ab-24980e3b6e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:21.057784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec1370-752b-4845-b4ab-24980e3b6e46 None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:21.059879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec1370-752b-4845-b4ab-24980e3b6e46 None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:21.061389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec1370-752b-4845-b4ab-24980e3b6e46 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:21.063257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 210/424] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:20 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:21.069578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e967cbf-3bf7-4485-a8c2-0073b9bed3d6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:21.221152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:21.240015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e967cbf-3bf7-4485-a8c2-0073b9bed3d6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:21.288899 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f74100-81e4-432f-b2a9-d53fa4070ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:21.289514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74100-81e4-432f-b2a9-d53fa4070ecd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:21.289795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74100-81e4-432f-b2a9-d53fa4070ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:21.290074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f74100-81e4-432f-b2a9-d53fa4070ecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:21.290796 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f74100-81e4-432f-b2a9-d53fa4070ecd None admin] RBAC: Adding query filter params (group.id=49fa5674d4b04c9aa57560b968e9a289, role.id=3009ebffeb104922b00cd072c83920c0, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:21.291104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f74100-81e4-432f-b2a9-d53fa4070ecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:21.292587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f74100-81e4-432f-b2a9-d53fa4070ecd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:21.304648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 215/425] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 18 06:11:21 2022] GET /identity/v3/role_assignments?group.id=49fa5674d4b04c9aa57560b968e9a289&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=3009ebffeb104922b00cd072c83920c0 => generated 611 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:21.349907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec1370-752b-4845-b4ab-24980e3b6e46 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:21.466504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b4ea1-5422-487e-9845-db783540228e None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:21.466829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b4ea1-5422-487e-9845-db783540228e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:21.467064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b4ea1-5422-487e-9845-db783540228e None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:21.468743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 216/426] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:21.477088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ef301-d7fa-4fef-8779-71889bdc3285 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:21.477412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ef301-d7fa-4fef-8779-71889bdc3285 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:21.477651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ef301-d7fa-4fef-8779-71889bdc3285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:21.500407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-706ef301-d7fa-4fef-8779-71889bdc3285 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:21.501685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-706ef301-d7fa-4fef-8779-71889bdc3285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:21.526113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec1370-752b-4845-b4ab-24980e3b6e46 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:21.573547 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b9f2-4560-40ea-b7ed-ebedaac7b829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:21.574425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b9f2-4560-40ea-b7ed-ebedaac7b829 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:21.575100 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b9f2-4560-40ea-b7ed-ebedaac7b829 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:21.575385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b9f2-4560-40ea-b7ed-ebedaac7b829 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:21.591490 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441b9f2-4560-40ea-b7ed-ebedaac7b829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:21.595984 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 217/427] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8441b9f2-4560-40ea-b7ed-ebedaac7b829 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:21.597769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:21.598635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 06:11:21.599438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:21.601179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 211/428] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:21.605999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ef301-d7fa-4fef-8779-71889bdc3285 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:21.704902 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:21.715237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ef301-d7fa-4fef-8779-71889bdc3285 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:21.753560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5557ae2-2ae7-4e3a-a699-5ce5c9499fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:21.754179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5557ae2-2ae7-4e3a-a699-5ce5c9499fff None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:21.754461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5557ae2-2ae7-4e3a-a699-5ce5c9499fff None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:21.754736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5557ae2-2ae7-4e3a-a699-5ce5c9499fff None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:21.755400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5557ae2-2ae7-4e3a-a699-5ce5c9499fff None admin] RBAC: Adding query filter params (name=member) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:21.755703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5557ae2-2ae7-4e3a-a699-5ce5c9499fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:21.757152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5557ae2-2ae7-4e3a-a699-5ce5c9499fff None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:21.766099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 218/429] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:11:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:21.772106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b9f2-4560-40ea-b7ed-ebedaac7b829 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:21.810583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:21.900700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b9f2-4560-40ea-b7ed-ebedaac7b829 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:21.918209 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5557ae2-2ae7-4e3a-a699-5ce5c9499fff None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:21.941655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe4afc-60aa-4e47-85a5-41fd525e2bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:21.942260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4afc-60aa-4e47-85a5-41fd525e2bcf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:21.942539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4afc-60aa-4e47-85a5-41fd525e2bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:21.942817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4afc-60aa-4e47-85a5-41fd525e2bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.029772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe4afc-60aa-4e47-85a5-41fd525e2bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:22.031228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe4afc-60aa-4e47-85a5-41fd525e2bcf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:22.069265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:22.080363 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5557ae2-2ae7-4e3a-a699-5ce5c9499fff None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:22.125977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4200192-2359-40f4-8873-9afa2c7423f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:22.126648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200192-2359-40f4-8873-9afa2c7423f1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:22.126936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200192-2359-40f4-8873-9afa2c7423f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:22.127192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200192-2359-40f4-8873-9afa2c7423f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.138545 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4200192-2359-40f4-8873-9afa2c7423f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-a4200192-2359-40f4-8873-9afa2c7423f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:22.146028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:22.146998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:22.147798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 219/430] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:11:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:22.148533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff6ad-021b-4ef0-8c0d-1168f0564ce4 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:22.148533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff6ad-021b-4ef0-8c0d-1168f0564ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:22.149154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff6ad-021b-4ef0-8c0d-1168f0564ce4 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.150008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 220/431] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:22.155659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294e419-02f3-42f3-bfd1-89cb5a00873e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:22.155886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294e419-02f3-42f3-bfd1-89cb5a00873e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:22.156186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294e419-02f3-42f3-bfd1-89cb5a00873e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.166443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 212/432] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:22.167585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe4afc-60aa-4e47-85a5-41fd525e2bcf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:22.182885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1294e419-02f3-42f3-bfd1-89cb5a00873e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:22.184284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1294e419-02f3-42f3-bfd1-89cb5a00873e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:22.194536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:22.263256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 221/433] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:22.268435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294e419-02f3-42f3-bfd1-89cb5a00873e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:22.292095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe4afc-60aa-4e47-85a5-41fd525e2bcf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:22.325096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:22.332316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b993c26-ce79-48d2-916e-89320b03837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:22.333095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993c26-ce79-48d2-916e-89320b03837c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:22.333448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993c26-ce79-48d2-916e-89320b03837c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:22.333817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993c26-ce79-48d2-916e-89320b03837c None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.334654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b993c26-ce79-48d2-916e-89320b03837c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:22.335027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b993c26-ce79-48d2-916e-89320b03837c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:22.336556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b993c26-ce79-48d2-916e-89320b03837c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:22.346119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 213/434] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:22.351408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b993c26-ce79-48d2-916e-89320b03837c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:22.400170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294e419-02f3-42f3-bfd1-89cb5a00873e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:22.436809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f29418-4e55-45a0-9479-ccd85875992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:22.437805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29418-4e55-45a0-9479-ccd85875992e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:22.438296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29418-4e55-45a0-9479-ccd85875992e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:22.439268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29418-4e55-45a0-9479-ccd85875992e None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.440747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f29418-4e55-45a0-9479-ccd85875992e None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:22.442421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f29418-4e55-45a0-9479-ccd85875992e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:22.444559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 222/435] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:22 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:22.450213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f29418-4e55-45a0-9479-ccd85875992e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:22.466666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:22.481375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b993c26-ce79-48d2-916e-89320b03837c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:22.520936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422406cc-1791-4d16-b829-9dddd631b3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:22.521921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422406cc-1791-4d16-b829-9dddd631b3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:22.522515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422406cc-1791-4d16-b829-9dddd631b3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:22.522991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422406cc-1791-4d16-b829-9dddd631b3e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.573229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f29418-4e55-45a0-9479-ccd85875992e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:22.587720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:22.596645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422406cc-1791-4d16-b829-9dddd631b3e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:22.598106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422406cc-1791-4d16-b829-9dddd631b3e1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:22.610546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426a8e-37c9-49f2-b0e3-cb9e28552c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:22.611397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426a8e-37c9-49f2-b0e3-cb9e28552c90 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:22.611675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426a8e-37c9-49f2-b0e3-cb9e28552c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:22.611973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426a8e-37c9-49f2-b0e3-cb9e28552c90 None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.613092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc426a8e-37c9-49f2-b0e3-cb9e28552c90 None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:22.614509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc426a8e-37c9-49f2-b0e3-cb9e28552c90 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:22.616284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 223/436] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:22 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:22.621651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426a8e-37c9-49f2-b0e3-cb9e28552c90 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:22.704703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:22.707548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 214/437] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:22.708412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422406cc-1791-4d16-b829-9dddd631b3e1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:22.728726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426a8e-37c9-49f2-b0e3-cb9e28552c90 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:22.766454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182117d2-92a9-4e07-b281-eb46fc5ce760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:22.767698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182117d2-92a9-4e07-b281-eb46fc5ce760 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:22.768015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182117d2-92a9-4e07-b281-eb46fc5ce760 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:22.768388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182117d2-92a9-4e07-b281-eb46fc5ce760 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.780940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182117d2-92a9-4e07-b281-eb46fc5ce760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-182117d2-92a9-4e07-b281-eb46fc5ce760 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:22.786283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:22.787188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:22.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 224/438] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:11:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:22.788675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182117d2-92a9-4e07-b281-eb46fc5ce760 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:22.823771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:22.831889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422406cc-1791-4d16-b829-9dddd631b3e1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:22.871609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f864c1a-15b2-4796-bf77-616ad72f93dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:22.872240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f864c1a-15b2-4796-bf77-616ad72f93dd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:22.872514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f864c1a-15b2-4796-bf77-616ad72f93dd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:22.872786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f864c1a-15b2-4796-bf77-616ad72f93dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.873510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f864c1a-15b2-4796-bf77-616ad72f93dd None admin] RBAC: Adding query filter params (group.id=49fa5674d4b04c9aa57560b968e9a289, role.id=3009ebffeb104922b00cd072c83920c0, scope.project.id=1bd737f4546c4cc9b891a21ee738540f) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:22.873820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f864c1a-15b2-4796-bf77-616ad72f93dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:22.875263 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f864c1a-15b2-4796-bf77-616ad72f93dd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:22.881982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 215/439] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 18 06:11:22 2022] GET /identity/v3/role_assignments?group.id=49fa5674d4b04c9aa57560b968e9a289&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=3009ebffeb104922b00cd072c83920c0 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:22.883034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f864c1a-15b2-4796-bf77-616ad72f93dd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:22.905473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182117d2-92a9-4e07-b281-eb46fc5ce760 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:22.943316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889d8d9-d783-4b44-85a1-c2eec453e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:22.944030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889d8d9-d783-4b44-85a1-c2eec453e613 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:22.944319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889d8d9-d783-4b44-85a1-c2eec453e613 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:22.944599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889d8d9-d783-4b44-85a1-c2eec453e613 None admin] PATH_INFO: `/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.945858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889d8d9-d783-4b44-85a1-c2eec453e613 None admin] RBAC: Authorizing `identity:get_project(project_id=5392f8ed83ee41e8bfc7496a8c67f385)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:22.947358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889d8d9-d783-4b44-85a1-c2eec453e613 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:22.949077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 225/440] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:22 2022] GET /identity/v3/projects/5392f8ed83ee41e8bfc7496a8c67f385 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:22.950256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d998b-2843-41ab-9a54-ba68fb74b2ca None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:22.950534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d998b-2843-41ab-9a54-ba68fb74b2ca None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:22.950808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d998b-2843-41ab-9a54-ba68fb74b2ca None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:22.952215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 226/441] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:22.957623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d998b-2843-41ab-9a54-ba68fb74b2ca None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:22.969011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:23.011529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f864c1a-15b2-4796-bf77-616ad72f93dd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:23.053498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba8b76-2238-428e-8e24-9435547bddf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:23.054117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba8b76-2238-428e-8e24-9435547bddf7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:23.054389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba8b76-2238-428e-8e24-9435547bddf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:23.054650 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba8b76-2238-428e-8e24-9435547bddf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:23.055317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba8b76-2238-428e-8e24-9435547bddf7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:23.055629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba8b76-2238-428e-8e24-9435547bddf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:23.057035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba8b76-2238-428e-8e24-9435547bddf7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:23.066825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 216/442] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:23.068449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83070341-dd88-4729-97a6-f1645b176e3c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:23.068935 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83070341-dd88-4729-97a6-f1645b176e3c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:23.069215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83070341-dd88-4729-97a6-f1645b176e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:23.080023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d998b-2843-41ab-9a54-ba68fb74b2ca None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:23.087763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-83070341-dd88-4729-97a6-f1645b176e3c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:23.089099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-83070341-dd88-4729-97a6-f1645b176e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:23.106118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:23.118697 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68c43c-78f2-4cb4-98ab-df4cd0962eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:23.119337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68c43c-78f2-4cb4-98ab-df4cd0962eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:23.119665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68c43c-78f2-4cb4-98ab-df4cd0962eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:23.119890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68c43c-78f2-4cb4-98ab-df4cd0962eb8 None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:23.121084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68c43c-78f2-4cb4-98ab-df4cd0962eb8 None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:23.122544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68c43c-78f2-4cb4-98ab-df4cd0962eb8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:23.124139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 227/443] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:22 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:23.124924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68c43c-78f2-4cb4-98ab-df4cd0962eb8 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:23.164955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 217/444] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:23.165955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83070341-dd88-4729-97a6-f1645b176e3c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:23.204481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:23.230766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68c43c-78f2-4cb4-98ab-df4cd0962eb8 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:23.268275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbe8b9-c5a4-4cfc-9889-27ffd0dad230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:23.268884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbe8b9-c5a4-4cfc-9889-27ffd0dad230 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:23.269310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbe8b9-c5a4-4cfc-9889-27ffd0dad230 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:23.269591 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbe8b9-c5a4-4cfc-9889-27ffd0dad230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:23.275289 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83070341-dd88-4729-97a6-f1645b176e3c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:23.312606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5916-b082-410a-8370-c4f85c851e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:23.313207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5916-b082-410a-8370-c4f85c851e6c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:23.314029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5916-b082-410a-8370-c4f85c851e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:23.314473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5916-b082-410a-8370-c4f85c851e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:23.315159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d5916-b082-410a-8370-c4f85c851e6c None admin] RBAC: Adding query filter params (group.id=49fa5674d4b04c9aa57560b968e9a289, role.id=fbc3d149dd894c219e21c220b192281a, scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:23.315465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d5916-b082-410a-8370-c4f85c851e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:23.316918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d5916-b082-410a-8370-c4f85c851e6c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:23.332284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 218/445] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 18 06:11:23 2022] GET /identity/v3/role_assignments?group.id=49fa5674d4b04c9aa57560b968e9a289&scope.project.id=5392f8ed83ee41e8bfc7496a8c67f385&role.id=fbc3d149dd894c219e21c220b192281a => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:23.343308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbe8b9-c5a4-4cfc-9889-27ffd0dad230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:23.345562 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbe8b9-c5a4-4cfc-9889-27ffd0dad230 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:23.427790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:23.435350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5916-b082-410a-8370-c4f85c851e6c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:23.456166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:23.458847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 228/446] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:23.464620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbe8b9-c5a4-4cfc-9889-27ffd0dad230 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:23.558498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5916-b082-410a-8370-c4f85c851e6c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:23.582698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbe8b9-c5a4-4cfc-9889-27ffd0dad230 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:23.601518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64804aa-95b5-4bff-b712-1695ae215853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:23.602146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64804aa-95b5-4bff-b712-1695ae215853 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:23.602425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64804aa-95b5-4bff-b712-1695ae215853 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:23.602694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64804aa-95b5-4bff-b712-1695ae215853 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:23.614860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64804aa-95b5-4bff-b712-1695ae215853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a64804aa-95b5-4bff-b712-1695ae215853 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:23.621047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:23.622089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:23.623012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 219/447] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:23.624963 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd3c2c-12b7-4f6f-af1f-31153199eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:23.625593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd3c2c-12b7-4f6f-af1f-31153199eb71 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:23.625897 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd3c2c-12b7-4f6f-af1f-31153199eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:23.626277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd3c2c-12b7-4f6f-af1f-31153199eb71 None admin] PATH_INFO: `/v3/projects/1bd737f4546c4cc9b891a21ee738540f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:23.627646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd3c2c-12b7-4f6f-af1f-31153199eb71 None admin] RBAC: Authorizing `identity:get_project(project_id=1bd737f4546c4cc9b891a21ee738540f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:23.628335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64804aa-95b5-4bff-b712-1695ae215853 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:23.629132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd3c2c-12b7-4f6f-af1f-31153199eb71 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:23.630739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 229/448] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:23 2022] GET /identity/v3/projects/1bd737f4546c4cc9b891a21ee738540f => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:23.636525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd3c2c-12b7-4f6f-af1f-31153199eb71 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:23.687165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:23.722925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:23.754694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd3c2c-12b7-4f6f-af1f-31153199eb71 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:23.756958 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64804aa-95b5-4bff-b712-1695ae215853 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:23.797317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91b3bd-7acc-4a3e-9e6f-ff6e0e84bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:23.798535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91b3bd-7acc-4a3e-9e6f-ff6e0e84bf79 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:23.798804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91b3bd-7acc-4a3e-9e6f-ff6e0e84bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:23.799156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91b3bd-7acc-4a3e-9e6f-ff6e0e84bf79 None admin] PATH_INFO: `/v3/groups/49fa5674d4b04c9aa57560b968e9a289` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:23.801998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91b3bd-7acc-4a3e-9e6f-ff6e0e84bf79 None admin] RBAC: Authorizing `identity:get_group(group_id=49fa5674d4b04c9aa57560b968e9a289)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:23.801998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91b3bd-7acc-4a3e-9e6f-ff6e0e84bf79 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:23.803787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 230/449] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:23 2022] GET /identity/v3/groups/49fa5674d4b04c9aa57560b968e9a289 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:23.806351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c25fa-6206-4f78-a9bf-6b044c04d2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:23.806950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c25fa-6206-4f78-a9bf-6b044c04d2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:23.807226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c25fa-6206-4f78-a9bf-6b044c04d2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:23.807495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c25fa-6206-4f78-a9bf-6b044c04d2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:23.808179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c25fa-6206-4f78-a9bf-6b044c04d2e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:23.808484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c25fa-6206-4f78-a9bf-6b044c04d2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:23.810317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91b3bd-7acc-4a3e-9e6f-ff6e0e84bf79 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:23.810444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c25fa-6206-4f78-a9bf-6b044c04d2e4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:23.819363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 220/450] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:23.825911 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c25fa-6206-4f78-a9bf-6b044c04d2e4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:23.918846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91b3bd-7acc-4a3e-9e6f-ff6e0e84bf79 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:23.930292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:23.936590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c25fa-6206-4f78-a9bf-6b044c04d2e4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:23.954544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774da05-86be-44ac-ba39-c1112e766aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:23.955137 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774da05-86be-44ac-ba39-c1112e766aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:23.955412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774da05-86be-44ac-ba39-c1112e766aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:23.955677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774da05-86be-44ac-ba39-c1112e766aa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:23.956411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774da05-86be-44ac-ba39-c1112e766aa5 None admin] RBAC: Adding query filter params (group.id=49fa5674d4b04c9aa57560b968e9a289, role.id=fbc3d149dd894c219e21c220b192281a, scope.project.id=1bd737f4546c4cc9b891a21ee738540f) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:23.956710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774da05-86be-44ac-ba39-c1112e766aa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:23.958124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774da05-86be-44ac-ba39-c1112e766aa5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:23.963658 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 231/451] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 18 06:11:23 2022] GET /identity/v3/role_assignments?group.id=49fa5674d4b04c9aa57560b968e9a289&scope.project.id=1bd737f4546c4cc9b891a21ee738540f&role.id=fbc3d149dd894c219e21c220b192281a => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:23.969365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b956-4d59-4415-a109-0e5dc04bef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:23.970508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b956-4d59-4415-a109-0e5dc04bef53 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:23.970782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b956-4d59-4415-a109-0e5dc04bef53 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:23.971053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448b956-4d59-4415-a109-0e5dc04bef53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:23.975590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:24.043474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448b956-4d59-4415-a109-0e5dc04bef53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:24.044996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448b956-4d59-4415-a109-0e5dc04bef53 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:24.147813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 221/452] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:24.153546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774da05-86be-44ac-ba39-c1112e766aa5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:24.258952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774da05-86be-44ac-ba39-c1112e766aa5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:24.296331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55512f-2d11-414d-9dcb-8910b764bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:24.296961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55512f-2d11-414d-9dcb-8910b764bd8c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:24.297235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55512f-2d11-414d-9dcb-8910b764bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:24.297505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55512f-2d11-414d-9dcb-8910b764bd8c None admin] PATH_INFO: `/v3/projects/51a6b33098764a2dacc62af886817c55` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:24.298806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55512f-2d11-414d-9dcb-8910b764bd8c None admin] RBAC: Authorizing `identity:get_project(project_id=51a6b33098764a2dacc62af886817c55)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:24.300262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55512f-2d11-414d-9dcb-8910b764bd8c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:24.302033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 232/453] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:11:24 2022] GET /identity/v3/projects/51a6b33098764a2dacc62af886817c55 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:24.307400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b956-4d59-4415-a109-0e5dc04bef53 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:24.342762 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:24.405532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448b956-4d59-4415-a109-0e5dc04bef53 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:24.438233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4338d8-91fe-415d-8982-d3fcd9497e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:24.438864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4338d8-91fe-415d-8982-d3fcd9497e0c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:24.439140 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4338d8-91fe-415d-8982-d3fcd9497e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:24.439409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4338d8-91fe-415d-8982-d3fcd9497e0c None admin] PATH_INFO: `/v3/groups/842040fcb72d4b00935495a6e1f721bb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:24.440502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4338d8-91fe-415d-8982-d3fcd9497e0c None admin] RBAC: Authorizing `identity:get_group(group_id=842040fcb72d4b00935495a6e1f721bb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:24.441914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4338d8-91fe-415d-8982-d3fcd9497e0c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:24.443444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 222/454] 10.222.0.16 () {56 vars in 1180 bytes} [Sun Sep 18 06:11:24 2022] GET /identity/v3/groups/842040fcb72d4b00935495a6e1f721bb => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:24.449312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55512f-2d11-414d-9dcb-8910b764bd8c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:24.491487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:24.546765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55512f-2d11-414d-9dcb-8910b764bd8c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:24.579832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb1624-176e-4fc2-adc7-6ea2ed0a9812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:24.580441 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1624-176e-4fc2-adc7-6ea2ed0a9812 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:24.580717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1624-176e-4fc2-adc7-6ea2ed0a9812 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:24.580988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb1624-176e-4fc2-adc7-6ea2ed0a9812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:24.581701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb1624-176e-4fc2-adc7-6ea2ed0a9812 None admin] RBAC: Adding query filter params (group.id=842040fcb72d4b00935495a6e1f721bb, role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=51a6b33098764a2dacc62af886817c55) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:24.582005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb1624-176e-4fc2-adc7-6ea2ed0a9812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:24.583433 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb1624-176e-4fc2-adc7-6ea2ed0a9812 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:24.589178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 233/455] 10.222.0.16 () {56 vars in 1376 bytes} [Sun Sep 18 06:11:24 2022] GET /identity/v3/role_assignments?group.id=842040fcb72d4b00935495a6e1f721bb&scope.project.id=51a6b33098764a2dacc62af886817c55&role.id=4494ba66c3f649febc69511a47e27b67 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:27.179144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc944e1f-2fef-4d09-a626-482be0159262 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:27.180117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc944e1f-2fef-4d09-a626-482be0159262 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:27.180568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc944e1f-2fef-4d09-a626-482be0159262 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:27.182305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 223/456] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:27.188199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87559b0e-8ea1-4d81-805e-76c1d4545f30 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:27.189292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87559b0e-8ea1-4d81-805e-76c1d4545f30 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:27.189778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87559b0e-8ea1-4d81-805e-76c1d4545f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:27.216933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-87559b0e-8ea1-4d81-805e-76c1d4545f30 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:27.218522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-87559b0e-8ea1-4d81-805e-76c1d4545f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:27.309483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 234/457] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:27.486015 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753234c9-478b-419a-883c-4b3d69d16691 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:27.486585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753234c9-478b-419a-883c-4b3d69d16691 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:27.487039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753234c9-478b-419a-883c-4b3d69d16691 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:27.488811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 224/458] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:27.494520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ee5e-207d-49e1-869e-86f0a315dda3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:27.494803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ee5e-207d-49e1-869e-86f0a315dda3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:27.495075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ee5e-207d-49e1-869e-86f0a315dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:27.521102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-99b3ee5e-207d-49e1-869e-86f0a315dda3 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:27.522302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-99b3ee5e-207d-49e1-869e-86f0a315dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:27.568869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:27.619854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 235/459] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:27.678964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a487-c7b8-4fba-880a-7c3fc49caf0d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:27.679611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a487-c7b8-4fba-880a-7c3fc49caf0d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:27.680117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a487-c7b8-4fba-880a-7c3fc49caf0d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:27.681889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 225/460] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:27.686927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e067ed-2dc8-4e70-ba81-76586f795ea3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:27.687219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e067ed-2dc8-4e70-ba81-76586f795ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:27.687490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e067ed-2dc8-4e70-ba81-76586f795ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:27.711529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a487-c7b8-4fba-880a-7c3fc49caf0d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:27.715702 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-66e067ed-2dc8-4e70-ba81-76586f795ea3 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:27.721812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-66e067ed-2dc8-4e70-ba81-76586f795ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:27.835976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 236/461] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:27.924024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a487-c7b8-4fba-880a-7c3fc49caf0d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:27.926548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:27.961200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e067ed-2dc8-4e70-ba81-76586f795ea3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:27.973427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f49c63-e5c9-4bf1-b7f7-0a343d878e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:27.974053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f49c63-e5c9-4bf1-b7f7-0a343d878e59 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:27.974326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f49c63-e5c9-4bf1-b7f7-0a343d878e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:27.974595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f49c63-e5c9-4bf1-b7f7-0a343d878e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:27.990026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f49c63-e5c9-4bf1-b7f7-0a343d878e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:27.991463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f49c63-e5c9-4bf1-b7f7-0a343d878e59 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-17f49c63-e5c9-4bf1-b7f7-0a343d878e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:28.015463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:28.017247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:28.018177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:28.018177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:28.018177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:28.018177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 226/462] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:28.018857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c9866-29f3-48cf-9bd0-1706356428a4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:28.018952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c9866-29f3-48cf-9bd0-1706356428a4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:28.020405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c9866-29f3-48cf-9bd0-1706356428a4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:28.020784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 227/463] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:28.026028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92d18f-a4c0-4465-b12f-c347f8804d8c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:28.026309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92d18f-a4c0-4465-b12f-c347f8804d8c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:28.026583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92d18f-a4c0-4465-b12f-c347f8804d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:28.047318 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8f92d18f-a4c0-4465-b12f-c347f8804d8c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:28.049178 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8f92d18f-a4c0-4465-b12f-c347f8804d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:28.092949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:28.101537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e067ed-2dc8-4e70-ba81-76586f795ea3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:28.132008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 228/464] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:28.133133 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92d18f-a4c0-4465-b12f-c347f8804d8c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:28.159889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd554b-3e88-42f3-9f98-f2107d9ab867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:28.160542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd554b-3e88-42f3-9f98-f2107d9ab867 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:28.160815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd554b-3e88-42f3-9f98-f2107d9ab867 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:28.161083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd554b-3e88-42f3-9f98-f2107d9ab867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:28.179545 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd554b-3e88-42f3-9f98-f2107d9ab867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:28.183198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd554b-3e88-42f3-9f98-f2107d9ab867 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-35bd554b-3e88-42f3-9f98-f2107d9ab867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:28.215869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:28.218474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:28.220760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:28.220760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:28.220760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:28.220760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 237/465] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:28.220760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd554b-3e88-42f3-9f98-f2107d9ab867 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:28.268317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:28.284772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92d18f-a4c0-4465-b12f-c347f8804d8c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:28.325857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf39f54-6d6d-436a-abcf-b7906ab58717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:28.326827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf39f54-6d6d-436a-abcf-b7906ab58717 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:28.327331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf39f54-6d6d-436a-abcf-b7906ab58717 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:28.327702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf39f54-6d6d-436a-abcf-b7906ab58717 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:28.328460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf39f54-6d6d-436a-abcf-b7906ab58717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:28.329509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf39f54-6d6d-436a-abcf-b7906ab58717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:28.330994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf39f54-6d6d-436a-abcf-b7906ab58717 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:28.343486 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 229/466] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:28.344462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf39f54-6d6d-436a-abcf-b7906ab58717 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:28.347694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd554b-3e88-42f3-9f98-f2107d9ab867 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:28.388708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fafe8-4c6f-4d4b-b43c-6d09de1bedb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:28.389860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fafe8-4c6f-4d4b-b43c-6d09de1bedb5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:28.390322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fafe8-4c6f-4d4b-b43c-6d09de1bedb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:28.390768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fafe8-4c6f-4d4b-b43c-6d09de1bedb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:28.402972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fafe8-4c6f-4d4b-b43c-6d09de1bedb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:28.404535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fafe8-4c6f-4d4b-b43c-6d09de1bedb5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:28.414404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-104fafe8-4c6f-4d4b-b43c-6d09de1bedb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:28.421279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:28.422381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:28.423423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:28.423423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:28.423423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:28.423833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 238/467] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:28.424704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fafe8-4c6f-4d4b-b43c-6d09de1bedb5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:28.452977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf39f54-6d6d-436a-abcf-b7906ab58717 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:28.491080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096163-3cb9-45c8-9f43-4807d72b41a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:28.491791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096163-3cb9-45c8-9f43-4807d72b41a2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:28.492163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096163-3cb9-45c8-9f43-4807d72b41a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:28.492520 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096163-3cb9-45c8-9f43-4807d72b41a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:28.493333 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4096163-3cb9-45c8-9f43-4807d72b41a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:28.493595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4096163-3cb9-45c8-9f43-4807d72b41a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:28.494966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4096163-3cb9-45c8-9f43-4807d72b41a2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:28.511957 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 230/468] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:28.511957 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096163-3cb9-45c8-9f43-4807d72b41a2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:28.520303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:28.536340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fafe8-4c6f-4d4b-b43c-6d09de1bedb5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:28.572185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ffa45-feb3-4a28-9c65-20b70cc663df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:28.573006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ffa45-feb3-4a28-9c65-20b70cc663df None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:28.573438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ffa45-feb3-4a28-9c65-20b70cc663df None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:28.573904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ffa45-feb3-4a28-9c65-20b70cc663df None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:28.574549 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ffa45-feb3-4a28-9c65-20b70cc663df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:28.576017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ffa45-feb3-4a28-9c65-20b70cc663df None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:28.612373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 239/469] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:11:28 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:11:28.613297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ffa45-feb3-4a28-9c65-20b70cc663df None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:28.630537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096163-3cb9-45c8-9f43-4807d72b41a2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:28.678236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:28.683693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb36949-680c-4a6f-b155-9cf936ebdb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:28.685446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb36949-680c-4a6f-b155-9cf936ebdb92 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:28.686228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb36949-680c-4a6f-b155-9cf936ebdb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:28.686812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb36949-680c-4a6f-b155-9cf936ebdb92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:28.707342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb36949-680c-4a6f-b155-9cf936ebdb92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:28.709907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb36949-680c-4a6f-b155-9cf936ebdb92 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:28.733636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ffa45-feb3-4a28-9c65-20b70cc663df None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-cbb36949-680c-4a6f-b155-9cf936ebdb92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:28.734372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:28.735818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:28.743118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:28.743118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:28.743118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:28.743118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 231/470] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:28.743118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb36949-680c-4a6f-b155-9cf936ebdb92 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:28.791187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7782f2-bf66-42b3-85a3-17d4960d0480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:28.792117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7782f2-bf66-42b3-85a3-17d4960d0480 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:28.792586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7782f2-bf66-42b3-85a3-17d4960d0480 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:28.793003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7782f2-bf66-42b3-85a3-17d4960d0480 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:28.793843 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7782f2-bf66-42b3-85a3-17d4960d0480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:28.794292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7782f2-bf66-42b3-85a3-17d4960d0480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:28.795925 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7782f2-bf66-42b3-85a3-17d4960d0480 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:28.814518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:28.815608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 240/471] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:28.816624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7782f2-bf66-42b3-85a3-17d4960d0480 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:28.873796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb36949-680c-4a6f-b155-9cf936ebdb92 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:28.915868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c59f-fd3f-4b88-b95f-546e686e7050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:28.916518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c59f-fd3f-4b88-b95f-546e686e7050 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:28.916799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c59f-fd3f-4b88-b95f-546e686e7050 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:28.917075 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c59f-fd3f-4b88-b95f-546e686e7050 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:28.917725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461c59f-fd3f-4b88-b95f-546e686e7050 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:28.919159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461c59f-fd3f-4b88-b95f-546e686e7050 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:28.941937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7782f2-bf66-42b3-85a3-17d4960d0480 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:28.942335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 232/472] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:11:28 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:11:28.943339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c59f-fd3f-4b88-b95f-546e686e7050 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:28.961868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:28.981983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786b7c4-41b5-4809-a125-aff93e78e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:28.982764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786b7c4-41b5-4809-a125-aff93e78e587 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:28.983145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786b7c4-41b5-4809-a125-aff93e78e587 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:28.983519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786b7c4-41b5-4809-a125-aff93e78e587 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:28.984353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786b7c4-41b5-4809-a125-aff93e78e587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:28.984758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786b7c4-41b5-4809-a125-aff93e78e587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:28.987318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786b7c4-41b5-4809-a125-aff93e78e587 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:29.000482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 241/473] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:29.002243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c4e2-9b4c-472e-8a03-c5bd7bbf1012 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:29.002625 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c4e2-9b4c-472e-8a03-c5bd7bbf1012 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:29.003001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71c4e2-9b4c-472e-8a03-c5bd7bbf1012 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:29.004412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 242/474] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:29.006101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71c4e2-9b4c-472e-8a03-c5bd7bbf1012 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:29.074350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c59f-fd3f-4b88-b95f-546e686e7050 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:29.092630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:29.117194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd50ee-65eb-4daf-82b9-b378680f6441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:29.117944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd50ee-65eb-4daf-82b9-b378680f6441 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:29.118227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd50ee-65eb-4daf-82b9-b378680f6441 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:29.118502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd50ee-65eb-4daf-82b9-b378680f6441 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:29.119154 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd50ee-65eb-4daf-82b9-b378680f6441 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:29.120688 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd50ee-65eb-4daf-82b9-b378680f6441 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:29.137908 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71c4e2-9b4c-472e-8a03-c5bd7bbf1012 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:29.150265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 233/475] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:11:28 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:11:29.151567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dccf3-ad22-4b1b-b4e2-2566557fc7f8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:29.151848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dccf3-ad22-4b1b-b4e2-2566557fc7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:29.152494 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dccf3-ad22-4b1b-b4e2-2566557fc7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:29.178277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4d0dccf3-ad22-4b1b-b4e2-2566557fc7f8 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:29.180018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4d0dccf3-ad22-4b1b-b4e2-2566557fc7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:29.193405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067efcdc-642a-4043-8d43-a4af9bc53f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:29.194027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067efcdc-642a-4043-8d43-a4af9bc53f98 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:29.194309 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067efcdc-642a-4043-8d43-a4af9bc53f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:29.194582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067efcdc-642a-4043-8d43-a4af9bc53f98 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:29.195233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067efcdc-642a-4043-8d43-a4af9bc53f98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:29.196997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067efcdc-642a-4043-8d43-a4af9bc53f98 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:29.227361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 243/476] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:11:29 2022] POST /identity/v3/users => generated 249 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:11:29.280941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 234/477] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:29.564999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067efcdc-642a-4043-8d43-a4af9bc53f98 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:29.602665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:29.690366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067efcdc-642a-4043-8d43-a4af9bc53f98 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:29.732205 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89558a77-e308-4d0a-9e37-1998981387ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:29.732812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89558a77-e308-4d0a-9e37-1998981387ab None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:29.733089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89558a77-e308-4d0a-9e37-1998981387ab None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:29.733360 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89558a77-e308-4d0a-9e37-1998981387ab None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:29.734023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89558a77-e308-4d0a-9e37-1998981387ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:29.736230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89558a77-e308-4d0a-9e37-1998981387ab None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:29.752209 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.sql.core [None req-89558a77-e308-4d0a-9e37-1998981387ab None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 18 06:11:29.752209 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 18 06:11:29.752209 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [parameters: {'id': '81e331dbdbb34f838a4fa74d5597ebb3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 18 06:11:29.752209 dv-cinder-855359-3-smb devstack@keystone.service[81384]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81384) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-89558a77-e308-4d0a-9e37-1998981387ab None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application conn.query(q) Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application result.read() Sep 18 06:11:29.773981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return ref.to_dict() Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 06:11:29.774883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application next(self.gen) Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application yield resource Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application next(self.gen) Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self.session.rollback() Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self.force_reraise() Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise self.value Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application session.commit() Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 18 06:11:29.776482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._prepare_impl() Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self.session.flush() Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._flush(objects) Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application compat.raise_( Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application flush_context.execute() Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rec.execute(self) Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 18 06:11:29.777337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 06:11:29.778183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application conn.query(q) Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application result.read() Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 06:11:29.778991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [parameters: {'id': '81e331dbdbb34f838a4fa74d5597ebb3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:29.780745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 18 06:11:29.782825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:29.789181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 244/478] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 18 06:11:29 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:29.789342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dccf3-ad22-4b1b-b4e2-2566557fc7f8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:29.901046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:29.908345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dccf3-ad22-4b1b-b4e2-2566557fc7f8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:29.950118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cee44-8bfb-4334-9078-d6f5754c89ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:29.950748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cee44-8bfb-4334-9078-d6f5754c89ce None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:29.951022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cee44-8bfb-4334-9078-d6f5754c89ce None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:29.951295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cee44-8bfb-4334-9078-d6f5754c89ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:29.962105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cee44-8bfb-4334-9078-d6f5754c89ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-747cee44-8bfb-4334-9078-d6f5754c89ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:29.966834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:29.967785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:29.968611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 235/479] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:11:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:29.974409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89558a77-e308-4d0a-9e37-1998981387ab None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:30.127784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:30.133878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89558a77-e308-4d0a-9e37-1998981387ab None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:30.190379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee548976-f10c-4d57-81a7-51dcf1780d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:30.191019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee548976-f10c-4d57-81a7-51dcf1780d0f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:30.191292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee548976-f10c-4d57-81a7-51dcf1780d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:30.191561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee548976-f10c-4d57-81a7-51dcf1780d0f None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:30.192275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee548976-f10c-4d57-81a7-51dcf1780d0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:30.192572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee548976-f10c-4d57-81a7-51dcf1780d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:30.193996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee548976-f10c-4d57-81a7-51dcf1780d0f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:30.203803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 245/480] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:31.217567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18cc00-203f-4439-bc16-e05b277f3c97 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:31.218084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18cc00-203f-4439-bc16-e05b277f3c97 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:31.218084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18cc00-203f-4439-bc16-e05b277f3c97 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:31.220404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 236/481] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:31.226134 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bdf5d-b654-42f5-a423-5aaadc446506 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:31.226661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bdf5d-b654-42f5-a423-5aaadc446506 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:31.226661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bdf5d-b654-42f5-a423-5aaadc446506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:31.253491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-910bdf5d-b654-42f5-a423-5aaadc446506 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:31.254674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-910bdf5d-b654-42f5-a423-5aaadc446506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:31.340415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 246/482] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:31.650210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c910-c474-4f0d-b94d-b48342a19779 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:31.650563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c910-c474-4f0d-b94d-b48342a19779 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:31.650757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c910-c474-4f0d-b94d-b48342a19779 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:31.652971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 237/483] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:31.659234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49bcd1-4719-44fb-87e3-abfaf82c66f6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:31.659516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49bcd1-4719-44fb-87e3-abfaf82c66f6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:31.659787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49bcd1-4719-44fb-87e3-abfaf82c66f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:31.688324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1e49bcd1-4719-44fb-87e3-abfaf82c66f6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:31.689513 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1e49bcd1-4719-44fb-87e3-abfaf82c66f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:31.730796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0c910-c474-4f0d-b94d-b48342a19779 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:31.787368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 247/484] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:31.871206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d412cd-ab59-4a10-8dca-e85e690c06a9 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:31.871518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d412cd-ab59-4a10-8dca-e85e690c06a9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:31.871749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d412cd-ab59-4a10-8dca-e85e690c06a9 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:31.873092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 248/485] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:31.880565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019bea8-d707-4d58-93f3-947f93584be6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:31.880840 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019bea8-d707-4d58-93f3-947f93584be6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:31.881115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019bea8-d707-4d58-93f3-947f93584be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:31.898206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0c910-c474-4f0d-b94d-b48342a19779 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:31.915702 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7019bea8-d707-4d58-93f3-947f93584be6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:31.917885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7019bea8-d707-4d58-93f3-947f93584be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:31.944406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08acf36-d9be-4d01-89ca-1c2b883b1e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:31.944634 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:31.945496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08acf36-d9be-4d01-89ca-1c2b883b1e44 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:31.945972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08acf36-d9be-4d01-89ca-1c2b883b1e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:31.946447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08acf36-d9be-4d01-89ca-1c2b883b1e44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:31.958462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08acf36-d9be-4d01-89ca-1c2b883b1e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f08acf36-d9be-4d01-89ca-1c2b883b1e44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:31.963670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:31.964573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:31.965366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:31.967886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 238/486] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:31.973586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08acf36-d9be-4d01-89ca-1c2b883b1e44 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:32.019869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:32.039312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 249/487] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:32.113141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08acf36-d9be-4d01-89ca-1c2b883b1e44 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:32.143751 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019bea8-d707-4d58-93f3-947f93584be6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:32.149465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4be83-022f-4d45-bf2a-1f41f116f1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:32.150232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4be83-022f-4d45-bf2a-1f41f116f1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:32.150639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4be83-022f-4d45-bf2a-1f41f116f1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:32.151046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4be83-022f-4d45-bf2a-1f41f116f1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:32.151866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4be83-022f-4d45-bf2a-1f41f116f1b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:32.152323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4be83-022f-4d45-bf2a-1f41f116f1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:32.153831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4be83-022f-4d45-bf2a-1f41f116f1b7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:32.163479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 239/488] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:32.169294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4be83-022f-4d45-bf2a-1f41f116f1b7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:32.305817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:32.326761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4be83-022f-4d45-bf2a-1f41f116f1b7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:32.361759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019bea8-d707-4d58-93f3-947f93584be6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:32.369233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc8f6b-bf99-4d37-91f6-4db1482d6004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:32.374390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8f6b-bf99-4d37-91f6-4db1482d6004 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:32.374676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8f6b-bf99-4d37-91f6-4db1482d6004 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:32.374953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc8f6b-bf99-4d37-91f6-4db1482d6004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:32.397644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8f6b-bf99-4d37-91f6-4db1482d6004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:32.399098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc8f6b-bf99-4d37-91f6-4db1482d6004 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-05bc8f6b-bf99-4d37-91f6-4db1482d6004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:32.414541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:32.415501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:32.416378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:32.416378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:32.416378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:32.416378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 240/489] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:32.417093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58742eb9-2627-40c0-8a17-75c622486ddd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:32.417093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58742eb9-2627-40c0-8a17-75c622486ddd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:32.417330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58742eb9-2627-40c0-8a17-75c622486ddd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:32.418690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 241/490] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:32.419270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58742eb9-2627-40c0-8a17-75c622486ddd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:32.427465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb27da-ce0f-4717-8d58-1c4306bda42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:32.428075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb27da-ce0f-4717-8d58-1c4306bda42d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:32.428358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb27da-ce0f-4717-8d58-1c4306bda42d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:32.428630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb27da-ce0f-4717-8d58-1c4306bda42d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:32.440356 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb27da-ce0f-4717-8d58-1c4306bda42d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d8eb27da-ce0f-4717-8d58-1c4306bda42d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:32.445119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:32.446231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:32.447026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 250/491] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:32.447782 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb27da-ce0f-4717-8d58-1c4306bda42d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:32.462056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:32.540614 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58742eb9-2627-40c0-8a17-75c622486ddd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:32.557515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb27da-ce0f-4717-8d58-1c4306bda42d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:32.576325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f5508-c066-4650-864a-e7497b3e6174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:32.577234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5508-c066-4650-864a-e7497b3e6174 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:32.577813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5508-c066-4650-864a-e7497b3e6174 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:32.578092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f5508-c066-4650-864a-e7497b3e6174 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:32.580661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:32.592242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f5508-c066-4650-864a-e7497b3e6174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:32.592719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59eb03a-08b1-4b6c-85a6-557249d06c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:32.593326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb03a-08b1-4b6c-85a6-557249d06c93 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:32.593608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb03a-08b1-4b6c-85a6-557249d06c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:32.593884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb03a-08b1-4b6c-85a6-557249d06c93 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:32.594605 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59eb03a-08b1-4b6c-85a6-557249d06c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:32.594963 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59eb03a-08b1-4b6c-85a6-557249d06c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:32.596379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59eb03a-08b1-4b6c-85a6-557249d06c93 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-484f5508-c066-4650-864a-e7497b3e6174 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:32.597416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:32.598287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:32.599081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 242/492] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:32.600420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0534f1b-fa2c-4332-8e31-8be47919a004 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:32.600420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0534f1b-fa2c-4332-8e31-8be47919a004 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:32.600420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0534f1b-fa2c-4332-8e31-8be47919a004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:32.614424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 251/493] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:32.619747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59eb03a-08b1-4b6c-85a6-557249d06c93 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:32.620002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a0534f1b-fa2c-4332-8e31-8be47919a004 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:32.621116 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a0534f1b-fa2c-4332-8e31-8be47919a004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:32.685760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:32.696841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 243/494] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:32.697512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0534f1b-fa2c-4332-8e31-8be47919a004 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:32.733123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59eb03a-08b1-4b6c-85a6-557249d06c93 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:32.779173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fee97f-f835-4e6d-8cf9-a9adc34a0783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:32.780044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fee97f-f835-4e6d-8cf9-a9adc34a0783 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:32.780469 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fee97f-f835-4e6d-8cf9-a9adc34a0783 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:32.780890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fee97f-f835-4e6d-8cf9-a9adc34a0783 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:32.782420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fee97f-f835-4e6d-8cf9-a9adc34a0783 None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:32.782906 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fee97f-f835-4e6d-8cf9-a9adc34a0783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:32.784924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fee97f-f835-4e6d-8cf9-a9adc34a0783 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:32.800882 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 252/495] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:32.801956 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fee97f-f835-4e6d-8cf9-a9adc34a0783 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:32.810144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0534f1b-fa2c-4332-8e31-8be47919a004 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:32.847347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:32.859699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e71f6-a621-4608-bc85-ab4f98ee5b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:32.860390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e71f6-a621-4608-bc85-ab4f98ee5b0a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:32.860671 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e71f6-a621-4608-bc85-ab4f98ee5b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:32.860947 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e71f6-a621-4608-bc85-ab4f98ee5b0a None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:32.861612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e71f6-a621-4608-bc85-ab4f98ee5b0a None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:32.861915 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e71f6-a621-4608-bc85-ab4f98ee5b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:32.863465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e71f6-a621-4608-bc85-ab4f98ee5b0a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:32.872839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 244/496] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:32.873666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e71f6-a621-4608-bc85-ab4f98ee5b0a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:32.943191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fee97f-f835-4e6d-8cf9-a9adc34a0783 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:32.977140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:32.983505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe3ff7-c888-4495-bf91-6e57eb322c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:32.984217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe3ff7-c888-4495-bf91-6e57eb322c79 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:32.984555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe3ff7-c888-4495-bf91-6e57eb322c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:32.984852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe3ff7-c888-4495-bf91-6e57eb322c79 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:32.993133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe3ff7-c888-4495-bf91-6e57eb322c79 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:32.994588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe3ff7-c888-4495-bf91-6e57eb322c79 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:32.994828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e71f6-a621-4608-bc85-ab4f98ee5b0a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-cabe3ff7-c888-4495-bf91-6e57eb322c79 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:33.008279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:33.009230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 253/497] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 18 06:11:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:33.010153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe3ff7-c888-4495-bf91-6e57eb322c79 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:33.038929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257261bb-47d8-4ebe-81f7-89df4db4adc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:33.039557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257261bb-47d8-4ebe-81f7-89df4db4adc9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.039831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257261bb-47d8-4ebe-81f7-89df4db4adc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.040145 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257261bb-47d8-4ebe-81f7-89df4db4adc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.051483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257261bb-47d8-4ebe-81f7-89df4db4adc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:33.052968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257261bb-47d8-4ebe-81f7-89df4db4adc9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-257261bb-47d8-4ebe-81f7-89df4db4adc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:33.067110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:33.068125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:33.069008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:33.069008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:33.069008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:33.069008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 245/498] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:33.069424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257261bb-47d8-4ebe-81f7-89df4db4adc9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:33.107841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:33.116931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe3ff7-c888-4495-bf91-6e57eb322c79 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:33.149061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb8d25-c817-43b7-a8a7-59148c8bc1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:33.149682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb8d25-c817-43b7-a8a7-59148c8bc1ba None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.149963 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb8d25-c817-43b7-a8a7-59148c8bc1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.150236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb8d25-c817-43b7-a8a7-59148c8bc1ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.161703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb8d25-c817-43b7-a8a7-59148c8bc1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:33.163169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb8d25-c817-43b7-a8a7-59148c8bc1ba None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:33.170368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257261bb-47d8-4ebe-81f7-89df4db4adc9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-fefb8d25-c817-43b7-a8a7-59148c8bc1ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:33.177592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:33.178703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:33.179689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:33.179689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:33.179689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:33.179689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 254/499] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:33.179689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb8d25-c817-43b7-a8a7-59148c8bc1ba None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:33.207191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11051290-7294-49ff-947f-55c5253027b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:33.207743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11051290-7294-49ff-947f-55c5253027b2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.208057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11051290-7294-49ff-947f-55c5253027b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.208321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11051290-7294-49ff-947f-55c5253027b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.218331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11051290-7294-49ff-947f-55c5253027b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-11051290-7294-49ff-947f-55c5253027b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:33.224493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:33.225549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:33.226372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:33.226979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:33.227051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 246/500] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:33.227051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff090061-b39c-4d67-ae2e-18dbeb00b590 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.227257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff090061-b39c-4d67-ae2e-18dbeb00b590 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.227533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff090061-b39c-4d67-ae2e-18dbeb00b590 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.228782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 247/501] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:33.229476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff090061-b39c-4d67-ae2e-18dbeb00b590 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:33.289096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb8d25-c817-43b7-a8a7-59148c8bc1ba None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:33.321238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fe6ba-03c3-4911-a847-26b3d87054b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:33.321824 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fe6ba-03c3-4911-a847-26b3d87054b4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.322101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fe6ba-03c3-4911-a847-26b3d87054b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.322368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fe6ba-03c3-4911-a847-26b3d87054b4 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.323078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fe6ba-03c3-4911-a847-26b3d87054b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:33.323379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fe6ba-03c3-4911-a847-26b3d87054b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:33.324833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fe6ba-03c3-4911-a847-26b3d87054b4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:33.329603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:33.335076 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff090061-b39c-4d67-ae2e-18dbeb00b590 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:33.361955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 255/502] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 18 06:11:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:33.362789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fe6ba-03c3-4911-a847-26b3d87054b4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:33.370009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798a88d-f9cf-4934-ad5a-9502840fb860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:33.370605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798a88d-f9cf-4934-ad5a-9502840fb860 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.371287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798a88d-f9cf-4934-ad5a-9502840fb860 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.371565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798a88d-f9cf-4934-ad5a-9502840fb860 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.372239 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798a88d-f9cf-4934-ad5a-9502840fb860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:33.372542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798a88d-f9cf-4934-ad5a-9502840fb860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:33.374304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798a88d-f9cf-4934-ad5a-9502840fb860 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:33.390390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 248/503] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:33.390390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798a88d-f9cf-4934-ad5a-9502840fb860 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:33.461590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:33.465000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fe6ba-03c3-4911-a847-26b3d87054b4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:33.487633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798a88d-f9cf-4934-ad5a-9502840fb860 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:33.498264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0df69-8734-4c3b-8b69-2f4ef39b31a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:33.498863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0df69-8734-4c3b-8b69-2f4ef39b31a3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.499141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0df69-8734-4c3b-8b69-2f4ef39b31a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.499416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0df69-8734-4c3b-8b69-2f4ef39b31a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.500111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0df69-8734-4c3b-8b69-2f4ef39b31a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:33.500625 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0df69-8734-4c3b-8b69-2f4ef39b31a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:33.502062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0df69-8734-4c3b-8b69-2f4ef39b31a3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:33.513373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 256/504] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:33.514566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354288bd-fbe4-4aa3-a5c7-48f37331a437 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.514846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354288bd-fbe4-4aa3-a5c7-48f37331a437 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.515385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354288bd-fbe4-4aa3-a5c7-48f37331a437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.522293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ed8b-4406-4bbc-b551-55c42b3a9807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:33.522885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ed8b-4406-4bbc-b551-55c42b3a9807 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.523158 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ed8b-4406-4bbc-b551-55c42b3a9807 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.523424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ed8b-4406-4bbc-b551-55c42b3a9807 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.524101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3ed8b-4406-4bbc-b551-55c42b3a9807 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:33.524399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3ed8b-4406-4bbc-b551-55c42b3a9807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:33.525749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3ed8b-4406-4bbc-b551-55c42b3a9807 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:33.534247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-354288bd-fbe4-4aa3-a5c7-48f37331a437 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:33.534621 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 249/505] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:33.535421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ed8b-4406-4bbc-b551-55c42b3a9807 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:33.535517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-354288bd-fbe4-4aa3-a5c7-48f37331a437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:33.556407 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:33.603942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 257/506] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:33.604728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354288bd-fbe4-4aa3-a5c7-48f37331a437 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:33.634598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ed8b-4406-4bbc-b551-55c42b3a9807 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:33.669099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3c006-124f-4f0b-8cf3-3d61050dcdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:33.669689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3c006-124f-4f0b-8cf3-3d61050dcdcf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.669962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3c006-124f-4f0b-8cf3-3d61050dcdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.670227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3c006-124f-4f0b-8cf3-3d61050dcdcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.724801 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:33.735727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354288bd-fbe4-4aa3-a5c7-48f37331a437 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:33.741756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3c006-124f-4f0b-8cf3-3d61050dcdcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:33.743196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3c006-124f-4f0b-8cf3-3d61050dcdcf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:33.765429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:33.769805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80955385-2752-441d-8107-6fa9c44deb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:33.770434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80955385-2752-441d-8107-6fa9c44deb42 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.770710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80955385-2752-441d-8107-6fa9c44deb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.770980 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80955385-2752-441d-8107-6fa9c44deb42 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.777927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80955385-2752-441d-8107-6fa9c44deb42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:33.779352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80955385-2752-441d-8107-6fa9c44deb42 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-80955385-2752-441d-8107-6fa9c44deb42 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:33.791157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:33.792129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 258/507] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:33.797792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80955385-2752-441d-8107-6fa9c44deb42 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:33.860197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 250/508] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:33.861309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3c006-124f-4f0b-8cf3-3d61050dcdcf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:33.908367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80955385-2752-441d-8107-6fa9c44deb42 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:33.940718 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdcbf6-378f-4bdb-a12b-d47b1a81617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:33.941333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcbf6-378f-4bdb-a12b-d47b1a81617e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:33.941604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcbf6-378f-4bdb-a12b-d47b1a81617e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:33.941872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcbf6-378f-4bdb-a12b-d47b1a81617e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:33.948997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdcbf6-378f-4bdb-a12b-d47b1a81617e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:33.950417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdcbf6-378f-4bdb-a12b-d47b1a81617e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-f8cdcbf6-378f-4bdb-a12b-d47b1a81617e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:33.961764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:33.967487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:33.968691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:33.968691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:33.968691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:33.968691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:33.968691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:33.968691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:33.968691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:33.968691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:33.968691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 06:11:33.968691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:33.969466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3c006-124f-4f0b-8cf3-3d61050dcdcf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:33.969552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 259/509] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:33.969552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdcbf6-378f-4bdb-a12b-d47b1a81617e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:33.978456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:33.988179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:34.003645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed6269-a24c-4608-9aec-f1c8d6595287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:34.004298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed6269-a24c-4608-9aec-f1c8d6595287 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:34.004574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed6269-a24c-4608-9aec-f1c8d6595287 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:34.004842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed6269-a24c-4608-9aec-f1c8d6595287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:34.014732 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed6269-a24c-4608-9aec-f1c8d6595287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:34.016229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed6269-a24c-4608-9aec-f1c8d6595287 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-13ed6269-a24c-4608-9aec-f1c8d6595287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:34.031056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:34.032149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:34.033697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:34.033697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:34.033697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:34.033697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 251/510] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:34.033697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed6269-a24c-4608-9aec-f1c8d6595287 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:34.067602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdcbf6-378f-4bdb-a12b-d47b1a81617e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:34.099826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee28ee3-f2f8-4aa5-869b-4a7281d4dd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:34.100445 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28ee3-f2f8-4aa5-869b-4a7281d4dd0d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:34.100725 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28ee3-f2f8-4aa5-869b-4a7281d4dd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:34.101000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28ee3-f2f8-4aa5-869b-4a7281d4dd0d None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:34.101725 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee28ee3-f2f8-4aa5-869b-4a7281d4dd0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:34.102034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee28ee3-f2f8-4aa5-869b-4a7281d4dd0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:34.103469 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee28ee3-f2f8-4aa5-869b-4a7281d4dd0d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:34.120428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 260/511] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 18 06:11:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:34.121221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee28ee3-f2f8-4aa5-869b-4a7281d4dd0d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:34.133395 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed6269-a24c-4608-9aec-f1c8d6595287 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:34.170119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee24da-caca-4c27-a56e-1efc8794caa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:34.170735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee24da-caca-4c27-a56e-1efc8794caa0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:34.171014 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee24da-caca-4c27-a56e-1efc8794caa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:34.171295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee24da-caca-4c27-a56e-1efc8794caa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:34.182150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee24da-caca-4c27-a56e-1efc8794caa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:34.183579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee24da-caca-4c27-a56e-1efc8794caa0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:34.191208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-32ee24da-caca-4c27-a56e-1efc8794caa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:34.197667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:34.198769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:34.199831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:34.199831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:34.199831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:34.204056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 252/512] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:34.204892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee24da-caca-4c27-a56e-1efc8794caa0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:34.226037 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee28ee3-f2f8-4aa5-869b-4a7281d4dd0d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:34.229516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:34.259153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc1f91-96c3-44ee-a8e0-8abb3ae54c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:34.259774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1f91-96c3-44ee-a8e0-8abb3ae54c69 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:34.260082 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1f91-96c3-44ee-a8e0-8abb3ae54c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:34.260357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1f91-96c3-44ee-a8e0-8abb3ae54c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:34.271220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc1f91-96c3-44ee-a8e0-8abb3ae54c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:34.272690 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc1f91-96c3-44ee-a8e0-8abb3ae54c69 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-b0bc1f91-96c3-44ee-a8e0-8abb3ae54c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:34.288414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:34.289415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:34.293038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:34.293038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:34.293038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:34.293038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 261/513] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:34.293038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc1f91-96c3-44ee-a8e0-8abb3ae54c69 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:34.304225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee24da-caca-4c27-a56e-1efc8794caa0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:34.338044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dc1ad-9e30-402a-b715-eb6524cb85ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:34.338657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dc1ad-9e30-402a-b715-eb6524cb85ff None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:34.338898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dc1ad-9e30-402a-b715-eb6524cb85ff None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:34.339165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dc1ad-9e30-402a-b715-eb6524cb85ff None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:34.339882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dc1ad-9e30-402a-b715-eb6524cb85ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:34.340209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dc1ad-9e30-402a-b715-eb6524cb85ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:34.341633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dc1ad-9e30-402a-b715-eb6524cb85ff None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:34.378594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 253/514] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 18 06:11:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:34.379423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dc1ad-9e30-402a-b715-eb6524cb85ff None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:34.389793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc1f91-96c3-44ee-a8e0-8abb3ae54c69 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:34.409431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:34.423600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106de808-e0ab-43f4-9c33-6790cb0c48e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:34.424443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de808-e0ab-43f4-9c33-6790cb0c48e5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:34.424723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de808-e0ab-43f4-9c33-6790cb0c48e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:34.424999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de808-e0ab-43f4-9c33-6790cb0c48e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:34.425631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106de808-e0ab-43f4-9c33-6790cb0c48e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:34.425932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106de808-e0ab-43f4-9c33-6790cb0c48e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:34.427301 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106de808-e0ab-43f4-9c33-6790cb0c48e5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:34.439121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 262/515] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:34.439913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106de808-e0ab-43f4-9c33-6790cb0c48e5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:34.461172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:34.479612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dc1ad-9e30-402a-b715-eb6524cb85ff None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:34.513279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ef654-ed78-4c23-b4f5-0c4ee6bc1534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:34.513923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef654-ed78-4c23-b4f5-0c4ee6bc1534 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:34.514205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef654-ed78-4c23-b4f5-0c4ee6bc1534 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:34.514521 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef654-ed78-4c23-b4f5-0c4ee6bc1534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:34.538516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106de808-e0ab-43f4-9c33-6790cb0c48e5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:34.571454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c6cdf-69f1-4f75-b37c-c51e6c4fa974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:34.572074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c6cdf-69f1-4f75-b37c-c51e6c4fa974 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:34.572626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c6cdf-69f1-4f75-b37c-c51e6c4fa974 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:34.572899 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c6cdf-69f1-4f75-b37c-c51e6c4fa974 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:34.573524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c6cdf-69f1-4f75-b37c-c51e6c4fa974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:34.573827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c6cdf-69f1-4f75-b37c-c51e6c4fa974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:34.575175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c6cdf-69f1-4f75-b37c-c51e6c4fa974 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:34.583922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ef654-ed78-4c23-b4f5-0c4ee6bc1534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:34.585394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ef654-ed78-4c23-b4f5-0c4ee6bc1534 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:34.586161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 263/516] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:34.586956 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c6cdf-69f1-4f75-b37c-c51e6c4fa974 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:34.633246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:34.670070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:34.689710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 254/517] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:34.689710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ef654-ed78-4c23-b4f5-0c4ee6bc1534 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:34.695010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c6cdf-69f1-4f75-b37c-c51e6c4fa974 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:34.728685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9125c-f1fd-4fc8-98c2-e39e692ab95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:34.729283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9125c-f1fd-4fc8-98c2-e39e692ab95f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:34.729563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9125c-f1fd-4fc8-98c2-e39e692ab95f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:34.729884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9125c-f1fd-4fc8-98c2-e39e692ab95f None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:34.730495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9125c-f1fd-4fc8-98c2-e39e692ab95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:34.730794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9125c-f1fd-4fc8-98c2-e39e692ab95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:34.732245 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9125c-f1fd-4fc8-98c2-e39e692ab95f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:34.744184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 264/518] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:34.745085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9125c-f1fd-4fc8-98c2-e39e692ab95f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:34.790041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ef654-ed78-4c23-b4f5-0c4ee6bc1534 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:34.824081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e210e6e-9c22-45b1-aa33-f923eb63d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:34.826892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e210e6e-9c22-45b1-aa33-f923eb63d3cd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:34.826892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e210e6e-9c22-45b1-aa33-f923eb63d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:34.826892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e210e6e-9c22-45b1-aa33-f923eb63d3cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:34.842968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:34.846773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9125c-f1fd-4fc8-98c2-e39e692ab95f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:34.877810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:34.880110 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8013f25-17bc-4221-afd6-c22a1d86cd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:34.880761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8013f25-17bc-4221-afd6-c22a1d86cd88 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:34.881043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8013f25-17bc-4221-afd6-c22a1d86cd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:34.881314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8013f25-17bc-4221-afd6-c22a1d86cd88 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:34.888543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8013f25-17bc-4221-afd6-c22a1d86cd88 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:34.890127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8013f25-17bc-4221-afd6-c22a1d86cd88 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:34.897203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e210e6e-9c22-45b1-aa33-f923eb63d3cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:34.898638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e210e6e-9c22-45b1-aa33-f923eb63d3cd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-e8013f25-17bc-4221-afd6-c22a1d86cd88 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:34.901947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:34.902989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 265/519] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:34.909078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8013f25-17bc-4221-afd6-c22a1d86cd88 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:34.996722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 255/520] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:34.997583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e210e6e-9c22-45b1-aa33-f923eb63d3cd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:35.011016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8013f25-17bc-4221-afd6-c22a1d86cd88 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:35.044767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b939-60ac-4737-a04d-66e5e45a2746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:35.045382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b939-60ac-4737-a04d-66e5e45a2746 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:35.045660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b939-60ac-4737-a04d-66e5e45a2746 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:35.045932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b939-60ac-4737-a04d-66e5e45a2746 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:35.052496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494b939-60ac-4737-a04d-66e5e45a2746 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:35.053923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494b939-60ac-4737-a04d-66e5e45a2746 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-3494b939-60ac-4737-a04d-66e5e45a2746 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:35.065663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:35.066685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:35.067729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:35.067729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:35.067729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:35.067729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:35.067729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:35.067729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:35.067729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:35.067729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:35.067729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 266/521] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:35.067729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b939-60ac-4737-a04d-66e5e45a2746 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:35.080931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:35.090320 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:35.100321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e210e6e-9c22-45b1-aa33-f923eb63d3cd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:35.135580 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb66b-1cee-4452-bab9-fa6b11ac88a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:35.136231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb66b-1cee-4452-bab9-fa6b11ac88a5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:35.136510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb66b-1cee-4452-bab9-fa6b11ac88a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:35.136787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb66b-1cee-4452-bab9-fa6b11ac88a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:35.147779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adb66b-1cee-4452-bab9-fa6b11ac88a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:35.149256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adb66b-1cee-4452-bab9-fa6b11ac88a5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b7adb66b-1cee-4452-bab9-fa6b11ac88a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:35.164052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:35.169806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:35.170894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:35.170894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:35.170894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:35.170894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 256/522] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:35.170894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb66b-1cee-4452-bab9-fa6b11ac88a5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:35.171231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b939-60ac-4737-a04d-66e5e45a2746 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:35.201295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad0d13-a701-4cbc-a695-48f28eeefdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:35.201888 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad0d13-a701-4cbc-a695-48f28eeefdb9 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:35.202162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad0d13-a701-4cbc-a695-48f28eeefdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:35.202437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad0d13-a701-4cbc-a695-48f28eeefdb9 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:35.203065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad0d13-a701-4cbc-a695-48f28eeefdb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:35.204675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad0d13-a701-4cbc-a695-48f28eeefdb9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:35.225197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 267/523] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:11:35 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:11:35.225992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad0d13-a701-4cbc-a695-48f28eeefdb9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:35.280715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb66b-1cee-4452-bab9-fa6b11ac88a5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:35.314353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:35.324772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ec283-6572-4a28-9f69-2084694beee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:35.325383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ec283-6572-4a28-9f69-2084694beee9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:35.325657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ec283-6572-4a28-9f69-2084694beee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:35.325926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ec283-6572-4a28-9f69-2084694beee9 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:35.326669 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ec283-6572-4a28-9f69-2084694beee9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:35.326971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ec283-6572-4a28-9f69-2084694beee9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:35.329079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ec283-6572-4a28-9f69-2084694beee9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:35.331207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:35.345570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad0d13-a701-4cbc-a695-48f28eeefdb9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:35.354156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 257/524] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 18 06:11:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:35.354156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ec283-6572-4a28-9f69-2084694beee9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:35.386418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e343603-b86f-42af-8dcc-654a02a56741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:35.387066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e343603-b86f-42af-8dcc-654a02a56741 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:35.387343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e343603-b86f-42af-8dcc-654a02a56741 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:35.387615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e343603-b86f-42af-8dcc-654a02a56741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:35.399948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e343603-b86f-42af-8dcc-654a02a56741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:35.401424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e343603-b86f-42af-8dcc-654a02a56741 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-1e343603-b86f-42af-8dcc-654a02a56741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:35.418064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:35.419019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:35.420188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:35.420188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:35.420188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:35.420188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 268/525] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:35.420460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e343603-b86f-42af-8dcc-654a02a56741 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:35.471781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ec283-6572-4a28-9f69-2084694beee9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:35.509671 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b46c6-4f8b-4ca5-ac9c-bf4ae07721b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:35.510654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b46c6-4f8b-4ca5-ac9c-bf4ae07721b5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:35.511130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b46c6-4f8b-4ca5-ac9c-bf4ae07721b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:35.511602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b46c6-4f8b-4ca5-ac9c-bf4ae07721b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:35.512533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b46c6-4f8b-4ca5-ac9c-bf4ae07721b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:35.513036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b46c6-4f8b-4ca5-ac9c-bf4ae07721b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:35.514631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b46c6-4f8b-4ca5-ac9c-bf4ae07721b5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:35.532986 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e343603-b86f-42af-8dcc-654a02a56741 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:35.534526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 258/526] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:35.535159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b46c6-4f8b-4ca5-ac9c-bf4ae07721b5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:35.565015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:35.574730 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f80dd-c036-454e-b343-c64fe5181eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:35.575340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f80dd-c036-454e-b343-c64fe5181eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:35.575621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f80dd-c036-454e-b343-c64fe5181eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:35.575893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f80dd-c036-454e-b343-c64fe5181eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:35.576560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f80dd-c036-454e-b343-c64fe5181eb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:35.576865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f80dd-c036-454e-b343-c64fe5181eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:35.579219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f80dd-c036-454e-b343-c64fe5181eb0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:35.591284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:35.592515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 269/527] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:35.593256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f80dd-c036-454e-b343-c64fe5181eb0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:35.648898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b46c6-4f8b-4ca5-ac9c-bf4ae07721b5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:35.684013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb5ec3-2079-4630-8265-3cd29bf01c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:35.684619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb5ec3-2079-4630-8265-3cd29bf01c2c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:35.684918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb5ec3-2079-4630-8265-3cd29bf01c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:35.685164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb5ec3-2079-4630-8265-3cd29bf01c2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:35.705516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f80dd-c036-454e-b343-c64fe5181eb0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:35.742996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca317ba-8862-4493-9692-38205751b9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:35.743603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca317ba-8862-4493-9692-38205751b9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:35.743886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca317ba-8862-4493-9692-38205751b9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:35.744194 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca317ba-8862-4493-9692-38205751b9f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:35.744836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca317ba-8862-4493-9692-38205751b9f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:35.745136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca317ba-8862-4493-9692-38205751b9f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:35.746557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca317ba-8862-4493-9692-38205751b9f0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:35.759319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 270/528] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:35.760152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca317ba-8862-4493-9692-38205751b9f0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:35.764964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb5ec3-2079-4630-8265-3cd29bf01c2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:35.766463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb5ec3-2079-4630-8265-3cd29bf01c2c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:35.810354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:35.820662 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:35.874649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca317ba-8862-4493-9692-38205751b9f0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:35.884461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 259/529] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:35.884461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb5ec3-2079-4630-8265-3cd29bf01c2c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:35.914035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da16f43-d69a-4dbb-841f-4dc9ff52eead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:35.914698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da16f43-d69a-4dbb-841f-4dc9ff52eead None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:35.915023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da16f43-d69a-4dbb-841f-4dc9ff52eead None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:35.915349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da16f43-d69a-4dbb-841f-4dc9ff52eead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:35.916107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da16f43-d69a-4dbb-841f-4dc9ff52eead None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=9b5585d29bcb4b03a1902fbf113f48e8) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:35.916415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da16f43-d69a-4dbb-841f-4dc9ff52eead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:35.917837 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da16f43-d69a-4dbb-841f-4dc9ff52eead None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:35.931955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 271/530] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:35 2022] GET /identity/v3/role_assignments?user.id=9b5585d29bcb4b03a1902fbf113f48e8&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:35.931955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da16f43-d69a-4dbb-841f-4dc9ff52eead None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:36.010751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb5ec3-2079-4630-8265-3cd29bf01c2c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:36.057399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff63be-06e2-42bf-aa99-925495b0abe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:36.058145 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff63be-06e2-42bf-aa99-925495b0abe1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:36.058433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff63be-06e2-42bf-aa99-925495b0abe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:36.058713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff63be-06e2-42bf-aa99-925495b0abe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:36.068745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff63be-06e2-42bf-aa99-925495b0abe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:36.069998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da16f43-d69a-4dbb-841f-4dc9ff52eead None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:36.070186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff63be-06e2-42bf-aa99-925495b0abe1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:36.087342 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-61ff63be-06e2-42bf-aa99-925495b0abe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:36.091368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:36.092321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:36.093173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:36.093173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:36.093173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:36.093173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:36.093173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:36.093173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:36.093173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:36.093173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:36.096063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 260/531] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:36.097251 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff63be-06e2-42bf-aa99-925495b0abe1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:36.118528 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:36.129349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915a822-236b-4106-aa74-884a13588d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:36.130100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915a822-236b-4106-aa74-884a13588d99 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:36.130375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915a822-236b-4106-aa74-884a13588d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:36.130689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915a822-236b-4106-aa74-884a13588d99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:36.138161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915a822-236b-4106-aa74-884a13588d99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:36.139666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915a822-236b-4106-aa74-884a13588d99 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7915a822-236b-4106-aa74-884a13588d99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:36.152304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:36.153268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:36.154150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:36.154150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:36.154150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:36.154150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:36.154150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:36.154150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:36.154150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:36.154150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:36.158667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 272/532] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:36.159680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915a822-236b-4106-aa74-884a13588d99 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:36.236271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff63be-06e2-42bf-aa99-925495b0abe1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:36.280993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3882316-cd43-4806-bad4-6cad9df30b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:36.282071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3882316-cd43-4806-bad4-6cad9df30b4c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:36.282578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3882316-cd43-4806-bad4-6cad9df30b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:36.282778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915a822-236b-4106-aa74-884a13588d99 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:36.283243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3882316-cd43-4806-bad4-6cad9df30b4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:36.298373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3882316-cd43-4806-bad4-6cad9df30b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:36.300456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3882316-cd43-4806-bad4-6cad9df30b4c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d3882316-cd43-4806-bad4-6cad9df30b4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:36.320921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:36.321848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:36.322712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:36.322712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:36.322712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:36.329476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 261/533] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:36.329476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3882316-cd43-4806-bad4-6cad9df30b4c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:36.336996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739a82c-335c-4d4a-b14f-a2a749022490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:36.337962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739a82c-335c-4d4a-b14f-a2a749022490 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:36.338290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739a82c-335c-4d4a-b14f-a2a749022490 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:36.338570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739a82c-335c-4d4a-b14f-a2a749022490 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:36.339270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739a82c-335c-4d4a-b14f-a2a749022490 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:36.339574 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739a82c-335c-4d4a-b14f-a2a749022490 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:36.341108 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739a82c-335c-4d4a-b14f-a2a749022490 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:36.366668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 273/534] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:36.367563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739a82c-335c-4d4a-b14f-a2a749022490 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:36.402482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:36.420210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:36.470053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3882316-cd43-4806-bad4-6cad9df30b4c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:36.487061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739a82c-335c-4d4a-b14f-a2a749022490 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:36.507585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3fe38-227f-4687-a9b4-8e1376c8e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:36.508388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3fe38-227f-4687-a9b4-8e1376c8e8ce None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:36.508758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3fe38-227f-4687-a9b4-8e1376c8e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:36.509123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3fe38-227f-4687-a9b4-8e1376c8e8ce None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:36.509909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3fe38-227f-4687-a9b4-8e1376c8e8ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:36.510308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3fe38-227f-4687-a9b4-8e1376c8e8ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:36.511805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3fe38-227f-4687-a9b4-8e1376c8e8ce None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:36.526276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 262/535] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:36.529885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fb820-8873-4d2a-8064-d69d4283ae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:36.530669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fb820-8873-4d2a-8064-d69d4283ae63 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:36.531074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fb820-8873-4d2a-8064-d69d4283ae63 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:36.531540 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fb820-8873-4d2a-8064-d69d4283ae63 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:36.532258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3fe38-227f-4687-a9b4-8e1376c8e8ce None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:36.532513 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fb820-8873-4d2a-8064-d69d4283ae63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:36.533141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fb820-8873-4d2a-8064-d69d4283ae63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:36.534673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fb820-8873-4d2a-8064-d69d4283ae63 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:36.552444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 274/536] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:36.553557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fb820-8873-4d2a-8064-d69d4283ae63 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:36.639459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3fe38-227f-4687-a9b4-8e1376c8e8ce None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:36.657592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:36.668650 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:36.669937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fb820-8873-4d2a-8064-d69d4283ae63 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:36.681171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855daf92-2ab4-4494-a595-69f694105d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:36.681905 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855daf92-2ab4-4494-a595-69f694105d54 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:36.682280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855daf92-2ab4-4494-a595-69f694105d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:36.682646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855daf92-2ab4-4494-a595-69f694105d54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:36.683468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855daf92-2ab4-4494-a595-69f694105d54 None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=03c498b5857f42f2ab84423f8f4ea11a) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:36.683890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855daf92-2ab4-4494-a595-69f694105d54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:36.685447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855daf92-2ab4-4494-a595-69f694105d54 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:36.700407 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 263/537] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:36 2022] GET /identity/v3/role_assignments?user.id=03c498b5857f42f2ab84423f8f4ea11a&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:36.701530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855daf92-2ab4-4494-a595-69f694105d54 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:36.710206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b6e03-61e1-4d29-97dd-01ef2e20215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:36.711102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b6e03-61e1-4d29-97dd-01ef2e20215c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:36.711521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b6e03-61e1-4d29-97dd-01ef2e20215c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:36.711951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b6e03-61e1-4d29-97dd-01ef2e20215c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:36.712936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b6e03-61e1-4d29-97dd-01ef2e20215c None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=1bb483203d3b4210a53a317443206d35) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:36.713391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b6e03-61e1-4d29-97dd-01ef2e20215c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:36.715078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b6e03-61e1-4d29-97dd-01ef2e20215c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:36.722812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 275/538] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:36 2022] GET /identity/v3/role_assignments?user.id=1bb483203d3b4210a53a317443206d35&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:36.846763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855daf92-2ab4-4494-a595-69f694105d54 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:36.899599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddd568-16ca-4cb9-8fe1-e797c96f109b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:36.900437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddd568-16ca-4cb9-8fe1-e797c96f109b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:36.900811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddd568-16ca-4cb9-8fe1-e797c96f109b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:36.901196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddd568-16ca-4cb9-8fe1-e797c96f109b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:36.912489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddd568-16ca-4cb9-8fe1-e797c96f109b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:36.914866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddd568-16ca-4cb9-8fe1-e797c96f109b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d8ddd568-16ca-4cb9-8fe1-e797c96f109b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:36.927960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:36.929041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:36.930068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:36.930068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:36.930068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:36.930068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:36.930068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:36.930068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:36.930068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:36.930068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:36.931821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 264/539] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:36.937955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b6e03-61e1-4d29-97dd-01ef2e20215c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:37.083928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b6e03-61e1-4d29-97dd-01ef2e20215c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:37.119819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eebdce-6fdb-4bb1-a9f9-52d234e66a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:37.120790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eebdce-6fdb-4bb1-a9f9-52d234e66a19 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:37.121216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eebdce-6fdb-4bb1-a9f9-52d234e66a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:37.121629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eebdce-6fdb-4bb1-a9f9-52d234e66a19 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:37.122556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eebdce-6fdb-4bb1-a9f9-52d234e66a19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:37.123000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eebdce-6fdb-4bb1-a9f9-52d234e66a19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:37.124606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eebdce-6fdb-4bb1-a9f9-52d234e66a19 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:37.139207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 276/540] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:37.145877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddd568-16ca-4cb9-8fe1-e797c96f109b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:37.212165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:37.284159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddd568-16ca-4cb9-8fe1-e797c96f109b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:37.326845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894eeb-b63d-4ee8-98cc-f5af13ab1839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:37.327687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894eeb-b63d-4ee8-98cc-f5af13ab1839 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:37.328171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894eeb-b63d-4ee8-98cc-f5af13ab1839 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:37.328592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894eeb-b63d-4ee8-98cc-f5af13ab1839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:37.329477 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12894eeb-b63d-4ee8-98cc-f5af13ab1839 None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=1d78e909fc894ddd9b35ead5fe68b898) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:37.329943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12894eeb-b63d-4ee8-98cc-f5af13ab1839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:37.331516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12894eeb-b63d-4ee8-98cc-f5af13ab1839 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:37.337831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 265/541] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:37 2022] GET /identity/v3/role_assignments?user.id=1d78e909fc894ddd9b35ead5fe68b898&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:37.599649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b374c-0121-459f-a1ef-4895de150a76 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:37.600530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b374c-0121-459f-a1ef-4895de150a76 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:37.600972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b374c-0121-459f-a1ef-4895de150a76 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:37.602890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 277/542] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:37.608390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2996be-728e-450d-9808-f9577f200c65 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:37.609308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2996be-728e-450d-9808-f9577f200c65 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:37.609749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2996be-728e-450d-9808-f9577f200c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:37.633771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8d2996be-728e-450d-9808-f9577f200c65 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:37.635286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8d2996be-728e-450d-9808-f9577f200c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:37.710156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 266/543] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:38.039792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b374c-0121-459f-a1ef-4895de150a76 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:38.065162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:38.156916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b374c-0121-459f-a1ef-4895de150a76 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:38.202189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff50c1a-2a0e-4737-b183-010c9be454b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:38.203156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff50c1a-2a0e-4737-b183-010c9be454b4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:38.203655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff50c1a-2a0e-4737-b183-010c9be454b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:38.204095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff50c1a-2a0e-4737-b183-010c9be454b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:38.220659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff50c1a-2a0e-4737-b183-010c9be454b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-aff50c1a-2a0e-4737-b183-010c9be454b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:38.225763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:38.226818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:38.227804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:38.229949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 278/544] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:38.235658 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2996be-728e-450d-9808-f9577f200c65 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:38.331631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:38.416392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2996be-728e-450d-9808-f9577f200c65 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:38.432476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e8fe-dba3-4312-ae36-741ade907ce8 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:38.432775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e8fe-dba3-4312-ae36-741ade907ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:38.433048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e8fe-dba3-4312-ae36-741ade907ce8 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:38.434688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 279/545] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:38.441490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf942f1-724e-4355-9aa7-4a49f83ed2e3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:38.441778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf942f1-724e-4355-9aa7-4a49f83ed2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:38.442050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf942f1-724e-4355-9aa7-4a49f83ed2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:38.462737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7bf942f1-724e-4355-9aa7-4a49f83ed2e3 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:38.463962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7bf942f1-724e-4355-9aa7-4a49f83ed2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:38.490209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d7b48-d65a-436b-8738-210e64be0fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:38.490824 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7b48-d65a-436b-8738-210e64be0fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:38.491110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7b48-d65a-436b-8738-210e64be0fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:38.491384 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7b48-d65a-436b-8738-210e64be0fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:38.492081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d7b48-d65a-436b-8738-210e64be0fe8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:38.492387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d7b48-d65a-436b-8738-210e64be0fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:38.493749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d7b48-d65a-436b-8738-210e64be0fe8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:38.506436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 267/546] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:38.511995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d7b48-d65a-436b-8738-210e64be0fe8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:38.566672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 280/547] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:38.677718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d7b48-d65a-436b-8738-210e64be0fe8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:38.680867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:38.720966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc62c3-7163-42f2-a080-aa01805098f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:38.721588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc62c3-7163-42f2-a080-aa01805098f0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:38.721869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc62c3-7163-42f2-a080-aa01805098f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:38.722146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc62c3-7163-42f2-a080-aa01805098f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:38.741427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc62c3-7163-42f2-a080-aa01805098f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:38.742870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc62c3-7163-42f2-a080-aa01805098f0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4ddc62c3-7163-42f2-a080-aa01805098f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:38.757817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:38.758892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:38.759842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:38.759842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:38.759842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:38.759842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 268/548] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:38.764401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf942f1-724e-4355-9aa7-4a49f83ed2e3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:38.773976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:38.902805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc62c3-7163-42f2-a080-aa01805098f0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:38.912572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf942f1-724e-4355-9aa7-4a49f83ed2e3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:38.947251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacce770-6143-4e12-bc6e-77b1565e1047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:38.947794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacce770-6143-4e12-bc6e-77b1565e1047 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:38.948575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacce770-6143-4e12-bc6e-77b1565e1047 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:38.948858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacce770-6143-4e12-bc6e-77b1565e1047 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:38.949505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacce770-6143-4e12-bc6e-77b1565e1047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:38.949811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacce770-6143-4e12-bc6e-77b1565e1047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:38.951279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacce770-6143-4e12-bc6e-77b1565e1047 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:38.964722 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 281/549] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:38.970231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacce770-6143-4e12-bc6e-77b1565e1047 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:39.069514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:39.080411 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc62c3-7163-42f2-a080-aa01805098f0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:39.113927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacce770-6143-4e12-bc6e-77b1565e1047 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:39.118659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4b24d-b535-482f-9fb9-0c4d3f86fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:39.119549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b24d-b535-482f-9fb9-0c4d3f86fab2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:39.120059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b24d-b535-482f-9fb9-0c4d3f86fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:39.120523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b24d-b535-482f-9fb9-0c4d3f86fab2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:39.133018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4b24d-b535-482f-9fb9-0c4d3f86fab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-49e4b24d-b535-482f-9fb9-0c4d3f86fab2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:39.139314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:39.140867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:39.142012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:39.144929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 269/550] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:39.151540 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4b24d-b535-482f-9fb9-0c4d3f86fab2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:39.155011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d87bc-6c71-4b05-83fb-88775c7ee4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:39.155655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d87bc-6c71-4b05-83fb-88775c7ee4dc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:39.156601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d87bc-6c71-4b05-83fb-88775c7ee4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:39.156902 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d87bc-6c71-4b05-83fb-88775c7ee4dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:39.165823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d87bc-6c71-4b05-83fb-88775c7ee4dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:39.167366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d87bc-6c71-4b05-83fb-88775c7ee4dc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-fa2d87bc-6c71-4b05-83fb-88775c7ee4dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:39.181650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:39.182601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:39.183672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:39.183672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:39.183672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:39.183672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:39.183672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:39.183672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:39.183672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:39.183672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:39.183672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:11:39.183672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:39.183672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 282/551] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:11:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:39.189155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d87bc-6c71-4b05-83fb-88775c7ee4dc None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:39.198334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:39.362865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d87bc-6c71-4b05-83fb-88775c7ee4dc None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:39.398124 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4b24d-b535-482f-9fb9-0c4d3f86fab2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:39.398714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:39.414738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee875db8-6a73-4fad-b247-fa87a8194a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:39.415447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee875db8-6a73-4fad-b247-fa87a8194a10 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:39.415800 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee875db8-6a73-4fad-b247-fa87a8194a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:39.416189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee875db8-6a73-4fad-b247-fa87a8194a10 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:39.416990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee875db8-6a73-4fad-b247-fa87a8194a10 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:39.417370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee875db8-6a73-4fad-b247-fa87a8194a10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:39.420454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee875db8-6a73-4fad-b247-fa87a8194a10 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:39.450891 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 283/552] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 18 06:11:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:39.456912 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee875db8-6a73-4fad-b247-fa87a8194a10 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:39.462476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b8827-d09a-4870-ab96-ddc2116791a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:39.463145 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b8827-d09a-4870-ab96-ddc2116791a7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:39.463471 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b8827-d09a-4870-ab96-ddc2116791a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:39.463812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b8827-d09a-4870-ab96-ddc2116791a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:39.464511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b8827-d09a-4870-ab96-ddc2116791a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:39.464812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b8827-d09a-4870-ab96-ddc2116791a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:39.466181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b8827-d09a-4870-ab96-ddc2116791a7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:39.484662 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 270/553] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:39.490820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b8827-d09a-4870-ab96-ddc2116791a7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:39.612704 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:39.639018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b8827-d09a-4870-ab96-ddc2116791a7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:39.649584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee875db8-6a73-4fad-b247-fa87a8194a10 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:39.679356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1f5cc-8ab3-4f04-b712-a1830d02a9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:39.680950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1f5cc-8ab3-4f04-b712-a1830d02a9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:39.681524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1f5cc-8ab3-4f04-b712-a1830d02a9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:39.681989 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1f5cc-8ab3-4f04-b712-a1830d02a9d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:39.686527 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64095ba-8c62-436b-a1ab-8a0702436fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:39.687656 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64095ba-8c62-436b-a1ab-8a0702436fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:39.688051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64095ba-8c62-436b-a1ab-8a0702436fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:39.688329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64095ba-8c62-436b-a1ab-8a0702436fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:39.695875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1f5cc-8ab3-4f04-b712-a1830d02a9d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:39.697723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1f5cc-8ab3-4f04-b712-a1830d02a9d7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a7d1f5cc-8ab3-4f04-b712-a1830d02a9d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:39.713500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:39.714434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:39.715294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:39.715294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:39.715294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:39.716768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 271/554] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:39.718044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57af36-33f8-455f-b6bd-a16e1589d47c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:39.718507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57af36-33f8-455f-b6bd-a16e1589d47c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:39.719186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57af36-33f8-455f-b6bd-a16e1589d47c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:39.720591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 272/555] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:39.721723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367dcb-a877-4728-9862-1f413ef9c0ed None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:39.722131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367dcb-a877-4728-9862-1f413ef9c0ed None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:39.722537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a367dcb-a877-4728-9862-1f413ef9c0ed None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:39.723678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 273/556] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:39.724576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367dcb-a877-4728-9862-1f413ef9c0ed None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:39.751830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:39.771247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64095ba-8c62-436b-a1ab-8a0702436fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:39.772793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64095ba-8c62-436b-a1ab-8a0702436fb5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:39.837473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a367dcb-a877-4728-9862-1f413ef9c0ed None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:39.869222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:39.877034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b084a9-a12d-440a-ac69-fd0e88d9f070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:39.877638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b084a9-a12d-440a-ac69-fd0e88d9f070 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:39.877917 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b084a9-a12d-440a-ac69-fd0e88d9f070 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:39.878277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b084a9-a12d-440a-ac69-fd0e88d9f070 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:39.878820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b084a9-a12d-440a-ac69-fd0e88d9f070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:39.879128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b084a9-a12d-440a-ac69-fd0e88d9f070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:39.881283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b084a9-a12d-440a-ac69-fd0e88d9f070 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:39.891983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 284/557] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:39.891983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff684a-3819-4488-93b2-4b437b847f28 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:39.891983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff684a-3819-4488-93b2-4b437b847f28 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:39.891983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff684a-3819-4488-93b2-4b437b847f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:39.895769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 274/558] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:39.895883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884defe-81d6-49e4-8602-77e913b8db79 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:39.899294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884defe-81d6-49e4-8602-77e913b8db79 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:39.899294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884defe-81d6-49e4-8602-77e913b8db79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:39.909595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9cff684a-3819-4488-93b2-4b437b847f28 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:39.910795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9cff684a-3819-4488-93b2-4b437b847f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:39.917194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9884defe-81d6-49e4-8602-77e913b8db79 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:39.918368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9884defe-81d6-49e4-8602-77e913b8db79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:39.996012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 285/559] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:39.996012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff684a-3819-4488-93b2-4b437b847f28 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.002488 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:40.005789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 275/560] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:40.007162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884defe-81d6-49e4-8602-77e913b8db79 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.120594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884defe-81d6-49e4-8602-77e913b8db79 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:40.134966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff684a-3819-4488-93b2-4b437b847f28 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:40.147663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:40.168992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7982c-b045-4408-bd62-e14717c5b04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:40.169878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7982c-b045-4408-bd62-e14717c5b04f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.170331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7982c-b045-4408-bd62-e14717c5b04f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.170607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7982c-b045-4408-bd62-e14717c5b04f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.173711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4015c-9935-42f5-967b-9f6416b1b55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:40.174580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4015c-9935-42f5-967b-9f6416b1b55d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.175057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4015c-9935-42f5-967b-9f6416b1b55d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.175593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4015c-9935-42f5-967b-9f6416b1b55d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.178806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7982c-b045-4408-bd62-e14717c5b04f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:40.180435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7982c-b045-4408-bd62-e14717c5b04f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:40.186700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4015c-9935-42f5-967b-9f6416b1b55d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:40.188514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4015c-9935-42f5-967b-9f6416b1b55d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e4a7982c-b045-4408-bd62-e14717c5b04f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:40.197449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:40.198386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:40.199412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:40.199412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:40.199412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:40.199412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:40.199412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:40.199412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:40.199412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:40.199412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:40.199412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:11:40.199412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:40.199412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 276/561] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 18 06:11:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:40.200032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea7554-06db-4916-8f24-c997adb9f526 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.200032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea7554-06db-4916-8f24-c997adb9f526 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.200032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea7554-06db-4916-8f24-c997adb9f526 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.206049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 277/562] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:40.207257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5ce2-e957-49ce-b0da-7b74f5f908c1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.207535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5ce2-e957-49ce-b0da-7b74f5f908c1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.207805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d5ce2-e957-49ce-b0da-7b74f5f908c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-baf4015c-9935-42f5-967b-9f6416b1b55d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:40.208875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:40.209789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:40.210721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:40.210721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:40.210721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:40.212679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 286/563] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:40.213729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4015c-9935-42f5-967b-9f6416b1b55d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.229806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1c4d5ce2-e957-49ce-b0da-7b74f5f908c1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:40.231126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1c4d5ce2-e957-49ce-b0da-7b74f5f908c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:40.285472 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:40.314112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 278/564] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:40.314968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5ce2-e957-49ce-b0da-7b74f5f908c1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.328319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4015c-9935-42f5-967b-9f6416b1b55d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:40.372153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54267fee-50b7-46d2-8707-58577d654d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:40.373094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54267fee-50b7-46d2-8707-58577d654d5b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.374026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54267fee-50b7-46d2-8707-58577d654d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.374524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54267fee-50b7-46d2-8707-58577d654d5b None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.376458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54267fee-50b7-46d2-8707-58577d654d5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:40.377539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54267fee-50b7-46d2-8707-58577d654d5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:40.380730 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54267fee-50b7-46d2-8707-58577d654d5b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:40.398973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 287/565] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 18 06:11:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:40.399685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54267fee-50b7-46d2-8707-58577d654d5b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.429905 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d5ce2-e957-49ce-b0da-7b74f5f908c1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:40.441310 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:40.468969 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e36b-58dd-4055-882b-23c7d81ca73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:40.469649 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e36b-58dd-4055-882b-23c7d81ca73d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.469930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e36b-58dd-4055-882b-23c7d81ca73d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.470201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e36b-58dd-4055-882b-23c7d81ca73d None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.470833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368e36b-58dd-4055-882b-23c7d81ca73d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:40.471133 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368e36b-58dd-4055-882b-23c7d81ca73d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:40.472520 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368e36b-58dd-4055-882b-23c7d81ca73d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:40.483453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 279/566] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:40.484884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e36b-58dd-4055-882b-23c7d81ca73d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.514341 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54267fee-50b7-46d2-8707-58577d654d5b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:40.540868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:40.553360 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52362071-9aa4-4043-9cad-668a1a64607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:40.553980 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52362071-9aa4-4043-9cad-668a1a64607f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.554253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52362071-9aa4-4043-9cad-668a1a64607f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.554521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52362071-9aa4-4043-9cad-668a1a64607f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.565290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52362071-9aa4-4043-9cad-668a1a64607f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-52362071-9aa4-4043-9cad-668a1a64607f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:40.570334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:40.571279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 288/567] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:40.572524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52362071-9aa4-4043-9cad-668a1a64607f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.595387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e36b-58dd-4055-882b-23c7d81ca73d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:40.628423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3ee56-2063-44ab-aa36-ec173d220319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:40.629032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3ee56-2063-44ab-aa36-ec173d220319 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.629305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3ee56-2063-44ab-aa36-ec173d220319 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.629571 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3ee56-2063-44ab-aa36-ec173d220319 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.639816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3ee56-2063-44ab-aa36-ec173d220319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d5b3ee56-2063-44ab-aa36-ec173d220319 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:40.647049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:40.648204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 280/568] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:40.649037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3ee56-2063-44ab-aa36-ec173d220319 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.675794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52362071-9aa4-4043-9cad-668a1a64607f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:40.679718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:40.710389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f609-d899-452f-8516-89541b919bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:40.711022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f609-d899-452f-8516-89541b919bef None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.711303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f609-d899-452f-8516-89541b919bef None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.711568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f609-d899-452f-8516-89541b919bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.721794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65f609-d899-452f-8516-89541b919bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:40.723230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65f609-d899-452f-8516-89541b919bef None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-5d65f609-d899-452f-8516-89541b919bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:40.737689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:40.738640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:40.739546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:40.739546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:40.739546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:40.739546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 289/569] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:40.739546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f609-d899-452f-8516-89541b919bef None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.752764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3ee56-2063-44ab-aa36-ec173d220319 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:40.775389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:40.786978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffb728-a4ef-488d-9c74-7c25b497bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:40.787598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffb728-a4ef-488d-9c74-7c25b497bf22 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.787872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffb728-a4ef-488d-9c74-7c25b497bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.788168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffb728-a4ef-488d-9c74-7c25b497bf22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.794861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffb728-a4ef-488d-9c74-7c25b497bf22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:40.796261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffb728-a4ef-488d-9c74-7c25b497bf22 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-00ffb728-a4ef-488d-9c74-7c25b497bf22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:40.808294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:40.809297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:40.810587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:40.810587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:40.810587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:40.810587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:40.810587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:40.810587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:40.810587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:40.810587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:40.810587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 281/570] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:40.810587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffb728-a4ef-488d-9c74-7c25b497bf22 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.845759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f609-d899-452f-8516-89541b919bef None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:40.878505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4e8a9-8d32-4e2e-b2f0-967893ed1b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:40.879093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4e8a9-8d32-4e2e-b2f0-967893ed1b74 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.879372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4e8a9-8d32-4e2e-b2f0-967893ed1b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.879641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4e8a9-8d32-4e2e-b2f0-967893ed1b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.880323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4e8a9-8d32-4e2e-b2f0-967893ed1b74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:40.880621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4e8a9-8d32-4e2e-b2f0-967893ed1b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:40.882297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4e8a9-8d32-4e2e-b2f0-967893ed1b74 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:40.891216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 290/571] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:40.892054 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4e8a9-8d32-4e2e-b2f0-967893ed1b74 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.904484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:40.914794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffb728-a4ef-488d-9c74-7c25b497bf22 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:40.949165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97f416-977e-4a4c-b976-13ff9cb2167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:40.949797 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97f416-977e-4a4c-b976-13ff9cb2167d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:40.950068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97f416-977e-4a4c-b976-13ff9cb2167d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:40.950335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97f416-977e-4a4c-b976-13ff9cb2167d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:40.960883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97f416-977e-4a4c-b976-13ff9cb2167d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-fe97f416-977e-4a4c-b976-13ff9cb2167d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:40.966111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:40.967254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 282/572] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:40.968151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97f416-977e-4a4c-b976-13ff9cb2167d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:40.991687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:40.995406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4e8a9-8d32-4e2e-b2f0-967893ed1b74 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.029862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb3a06-bf56-4515-aafb-1f257b1adcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.030487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3a06-bf56-4515-aafb-1f257b1adcaa None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.030728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3a06-bf56-4515-aafb-1f257b1adcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.031239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3a06-bf56-4515-aafb-1f257b1adcaa None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.031893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb3a06-bf56-4515-aafb-1f257b1adcaa None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:41.032227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb3a06-bf56-4515-aafb-1f257b1adcaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.033589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb3a06-bf56-4515-aafb-1f257b1adcaa None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.041228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 291/573] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:41.042013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb3a06-bf56-4515-aafb-1f257b1adcaa None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:41.068177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97f416-977e-4a4c-b976-13ff9cb2167d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.101930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662c176-67aa-4d17-9c73-f6de31a310d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.102522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c176-67aa-4d17-9c73-f6de31a310d8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.102796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c176-67aa-4d17-9c73-f6de31a310d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.103065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c176-67aa-4d17-9c73-f6de31a310d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.103697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662c176-67aa-4d17-9c73-f6de31a310d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:41.104128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662c176-67aa-4d17-9c73-f6de31a310d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.105386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662c176-67aa-4d17-9c73-f6de31a310d8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.116655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 283/574] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:41.117444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662c176-67aa-4d17-9c73-f6de31a310d8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:41.131043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:41.143450 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb3a06-bf56-4515-aafb-1f257b1adcaa None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.176304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1e00b-da74-4b4e-97af-537a47d00700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.177093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1e00b-da74-4b4e-97af-537a47d00700 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.177375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1e00b-da74-4b4e-97af-537a47d00700 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.177650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1e00b-da74-4b4e-97af-537a47d00700 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.178327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1e00b-da74-4b4e-97af-537a47d00700 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:41.178626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1e00b-da74-4b4e-97af-537a47d00700 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.180071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1e00b-da74-4b4e-97af-537a47d00700 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.192207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 292/575] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:41.193310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1e00b-da74-4b4e-97af-537a47d00700 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:41.214821 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:41.223893 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662c176-67aa-4d17-9c73-f6de31a310d8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.257765 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05efb0f-9719-46cd-8621-89f237b502c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.258389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05efb0f-9719-46cd-8621-89f237b502c8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.258732 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05efb0f-9719-46cd-8621-89f237b502c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.259004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05efb0f-9719-46cd-8621-89f237b502c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.270206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05efb0f-9719-46cd-8621-89f237b502c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.271665 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05efb0f-9719-46cd-8621-89f237b502c8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a05efb0f-9719-46cd-8621-89f237b502c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:41.286362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:41.287386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:41.288337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:41.288337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:41.288337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:41.288337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 284/576] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:41.289088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05efb0f-9719-46cd-8621-89f237b502c8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:41.292198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1e00b-da74-4b4e-97af-537a47d00700 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.327348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bef25-4477-44b8-ba03-9a0a776046f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.328047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bef25-4477-44b8-ba03-9a0a776046f2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.328495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bef25-4477-44b8-ba03-9a0a776046f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.328772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bef25-4477-44b8-ba03-9a0a776046f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.329424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bef25-4477-44b8-ba03-9a0a776046f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:41.329725 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bef25-4477-44b8-ba03-9a0a776046f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.331088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bef25-4477-44b8-ba03-9a0a776046f2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.338898 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 293/577] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:41.339674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bef25-4477-44b8-ba03-9a0a776046f2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:41.353808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:41.393160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05efb0f-9719-46cd-8621-89f237b502c8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.422757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:41.431642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2442e0-f308-40f0-971f-c6d947328847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.432477 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2442e0-f308-40f0-971f-c6d947328847 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.432907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2442e0-f308-40f0-971f-c6d947328847 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.433333 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2442e0-f308-40f0-971f-c6d947328847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.441547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bef25-4477-44b8-ba03-9a0a776046f2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.445408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2442e0-f308-40f0-971f-c6d947328847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.446861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2442e0-f308-40f0-971f-c6d947328847 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-6b2442e0-f308-40f0-971f-c6d947328847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:41.461340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:41.462291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:41.463199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:41.463199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:41.463199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:41.463199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 285/578] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:41.463199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2442e0-f308-40f0-971f-c6d947328847 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:41.478682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8cc19-036c-494a-b5e1-4ea002bf3514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.479309 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8cc19-036c-494a-b5e1-4ea002bf3514 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.479589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8cc19-036c-494a-b5e1-4ea002bf3514 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.479862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8cc19-036c-494a-b5e1-4ea002bf3514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.487199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8cc19-036c-494a-b5e1-4ea002bf3514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.488677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8cc19-036c-494a-b5e1-4ea002bf3514 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-bea8cc19-036c-494a-b5e1-4ea002bf3514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:41.500382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:41.501437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:41.502452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:41.502452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:41.502452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:41.502452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:41.502452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:41.502452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:41.502452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:41.502452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:41.502452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 294/579] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:41.502938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8cc19-036c-494a-b5e1-4ea002bf3514 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:41.564909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2442e0-f308-40f0-971f-c6d947328847 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.578740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:41.600165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9023f-e08c-462a-a361-4bacb7b9ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.600752 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9023f-e08c-462a-a361-4bacb7b9ca30 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.601025 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9023f-e08c-462a-a361-4bacb7b9ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.601293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9023f-e08c-462a-a361-4bacb7b9ca30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.601997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9023f-e08c-462a-a361-4bacb7b9ca30 None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=3e0f04f474124698a46bed8dac01e30e) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:41.602299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9023f-e08c-462a-a361-4bacb7b9ca30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.602399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8cc19-036c-494a-b5e1-4ea002bf3514 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.603714 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9023f-e08c-462a-a361-4bacb7b9ca30 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.609401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 286/580] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/role_assignments?user.id=3e0f04f474124698a46bed8dac01e30e&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:41.610255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9023f-e08c-462a-a361-4bacb7b9ca30 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:41.639011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198d74d-abb2-441d-9a45-157c57762a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.639630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198d74d-abb2-441d-9a45-157c57762a1f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.639941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198d74d-abb2-441d-9a45-157c57762a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.640784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198d74d-abb2-441d-9a45-157c57762a1f None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.641828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198d74d-abb2-441d-9a45-157c57762a1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:41.642295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198d74d-abb2-441d-9a45-157c57762a1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.643568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198d74d-abb2-441d-9a45-157c57762a1f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.662734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 295/581] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:41.662734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198d74d-abb2-441d-9a45-157c57762a1f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:41.666732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:41.746026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9023f-e08c-462a-a361-4bacb7b9ca30 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.775860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198d74d-abb2-441d-9a45-157c57762a1f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.787851 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e796f-1748-4466-8216-e5222955ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.789125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e796f-1748-4466-8216-e5222955ff42 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.789125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e796f-1748-4466-8216-e5222955ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.789125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e796f-1748-4466-8216-e5222955ff42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.801181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e796f-1748-4466-8216-e5222955ff42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.802631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e796f-1748-4466-8216-e5222955ff42 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.812454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3467-eff6-4271-807b-0126fc9b6fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.813056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3467-eff6-4271-807b-0126fc9b6fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.813330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3467-eff6-4271-807b-0126fc9b6fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.813601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d3467-eff6-4271-807b-0126fc9b6fc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.814236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d3467-eff6-4271-807b-0126fc9b6fc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:41.814536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d3467-eff6-4271-807b-0126fc9b6fc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.815894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d3467-eff6-4271-807b-0126fc9b6fc8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-bf8e796f-1748-4466-8216-e5222955ff42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:41.817288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:41.818207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:41.819090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:41.819090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:41.819090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:41.819090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 287/582] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:41.819323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e796f-1748-4466-8216-e5222955ff42 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:41.836887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 296/583] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:41.837595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3467-eff6-4271-807b-0126fc9b6fc8 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:41.858670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:41.901285 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:41.936672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e796f-1748-4466-8216-e5222955ff42 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.945878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d3467-eff6-4271-807b-0126fc9b6fc8 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:41.974547 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b2535-dd7b-4bb6-b961-880bfc67ae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.975024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2535-dd7b-4bb6-b961-880bfc67ae2d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.975298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2535-dd7b-4bb6-b961-880bfc67ae2d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.975600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2535-dd7b-4bb6-b961-880bfc67ae2d None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.976275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b2535-dd7b-4bb6-b961-880bfc67ae2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:41.976577 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b2535-dd7b-4bb6-b961-880bfc67ae2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.977989 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b2535-dd7b-4bb6-b961-880bfc67ae2d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.982992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf5794-70a4-479f-944e-a326c426f38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:41.983608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf5794-70a4-479f-944e-a326c426f38e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:41.983930 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf5794-70a4-479f-944e-a326c426f38e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:41.984314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf5794-70a4-479f-944e-a326c426f38e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:41.992420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf5794-70a4-479f-944e-a326c426f38e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:41.993853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf5794-70a4-479f-944e-a326c426f38e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:41.999415 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 288/584] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:42.001185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b2535-dd7b-4bb6-b961-880bfc67ae2d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-5bcf5794-70a4-479f-944e-a326c426f38e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:42.006030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:42.007212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 297/585] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:42.013004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf5794-70a4-479f-944e-a326c426f38e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:42.097188 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:42.107416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b2535-dd7b-4bb6-b961-880bfc67ae2d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:42.118102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf5794-70a4-479f-944e-a326c426f38e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:42.142686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:42.146180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0daac-cc10-48a0-a5d6-eda92851039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:42.146942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0daac-cc10-48a0-a5d6-eda92851039a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:42.147206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0daac-cc10-48a0-a5d6-eda92851039a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:42.147475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0daac-cc10-48a0-a5d6-eda92851039a None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:42.148448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0daac-cc10-48a0-a5d6-eda92851039a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:42.148761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0daac-cc10-48a0-a5d6-eda92851039a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:42.150116 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0daac-cc10-48a0-a5d6-eda92851039a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:42.156341 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181025b-600b-4732-86ed-6a8ded748d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:42.157242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181025b-600b-4732-86ed-6a8ded748d7a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:42.157721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181025b-600b-4732-86ed-6a8ded748d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:42.158194 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181025b-600b-4732-86ed-6a8ded748d7a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:42.161793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 289/586] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:42.162569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0daac-cc10-48a0-a5d6-eda92851039a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:42.167413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181025b-600b-4732-86ed-6a8ded748d7a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:42.168903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181025b-600b-4732-86ed-6a8ded748d7a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-a181025b-600b-4732-86ed-6a8ded748d7a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:42.180600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:42.181594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 298/587] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:42.182548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181025b-600b-4732-86ed-6a8ded748d7a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:42.276936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0daac-cc10-48a0-a5d6-eda92851039a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:42.291426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181025b-600b-4732-86ed-6a8ded748d7a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:42.315221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc3ed2-6069-47ea-9740-0d25e3b85ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:42.316012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc3ed2-6069-47ea-9740-0d25e3b85ff1 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:42.316362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc3ed2-6069-47ea-9740-0d25e3b85ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:42.316719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc3ed2-6069-47ea-9740-0d25e3b85ff1 None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/9b5585d29bcb4b03a1902fbf113f48e8/roles/7a2c1ebe84c94165a42716d4de2d3290` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:42.327142 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9cf77-c4b0-4781-8de6-af11f914fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:42.328116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9cf77-c4b0-4781-8de6-af11f914fab4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:42.328573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9cf77-c4b0-4781-8de6-af11f914fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:42.328849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9cf77-c4b0-4781-8de6-af11f914fab4 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:42.329634 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9cf77-c4b0-4781-8de6-af11f914fab4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:42.329872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9cf77-c4b0-4781-8de6-af11f914fab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:42.331308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9cf77-c4b0-4781-8de6-af11f914fab4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:42.332815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc3ed2-6069-47ea-9740-0d25e3b85ff1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=9b5585d29bcb4b03a1902fbf113f48e8, role_id=7a2c1ebe84c94165a42716d4de2d3290)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:42.334328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc3ed2-6069-47ea-9740-0d25e3b85ff1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:42.344519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:42.354532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 299/588] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 18 06:11:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:42.354703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 290/589] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:11:42 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/9b5585d29bcb4b03a1902fbf113f48e8/roles/7a2c1ebe84c94165a42716d4de2d3290 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:11:42.354703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc3ed2-6069-47ea-9740-0d25e3b85ff1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:42.361225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9cf77-c4b0-4781-8de6-af11f914fab4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:42.423465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:42.496592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9cf77-c4b0-4781-8de6-af11f914fab4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:42.509455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc3ed2-6069-47ea-9740-0d25e3b85ff1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:42.548147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccddf9b-c91f-42b9-a73f-59a416aede9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:42.548788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccddf9b-c91f-42b9-a73f-59a416aede9b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:42.549062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccddf9b-c91f-42b9-a73f-59a416aede9b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:42.549331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccddf9b-c91f-42b9-a73f-59a416aede9b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:42.554415 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b1049-bf0b-4a5c-a107-c5a1b9dd7bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:42.555018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1049-bf0b-4a5c-a107-c5a1b9dd7bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:42.555290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1049-bf0b-4a5c-a107-c5a1b9dd7bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:42.555551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1049-bf0b-4a5c-a107-c5a1b9dd7bd4 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:42.556343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b1049-bf0b-4a5c-a107-c5a1b9dd7bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:42.556644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b1049-bf0b-4a5c-a107-c5a1b9dd7bd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:42.557797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccddf9b-c91f-42b9-a73f-59a416aede9b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:42.558077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b1049-bf0b-4a5c-a107-c5a1b9dd7bd4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:42.559331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccddf9b-c91f-42b9-a73f-59a416aede9b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-eccddf9b-c91f-42b9-a73f-59a416aede9b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:42.571828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:42.572913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:42.573844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:42.573844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:42.573844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:42.573844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:42.573844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:42.573844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:42.573844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:42.573844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:42.573844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 06:11:42.573844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:42.573844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 300/590] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:42.574436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccddf9b-c91f-42b9-a73f-59a416aede9b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:42.582788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 291/591] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 18 06:11:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:42.583631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b1049-bf0b-4a5c-a107-c5a1b9dd7bd4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:42.660195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:42.695947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:42.700147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccddf9b-c91f-42b9-a73f-59a416aede9b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:42.713404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b1049-bf0b-4a5c-a107-c5a1b9dd7bd4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:42.744915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7d13-a816-4ab3-8e1e-2d2bb03ff36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:42.746163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7d13-a816-4ab3-8e1e-2d2bb03ff36f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:42.746459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7d13-a816-4ab3-8e1e-2d2bb03ff36f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:42.746737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7d13-a816-4ab3-8e1e-2d2bb03ff36f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:42.754831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368289c-ab28-4b6d-b279-d9099b1e286d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:42.755696 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368289c-ab28-4b6d-b279-d9099b1e286d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:42.756109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368289c-ab28-4b6d-b279-d9099b1e286d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:42.756483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368289c-ab28-4b6d-b279-d9099b1e286d None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:42.757739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368289c-ab28-4b6d-b279-d9099b1e286d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:42.758150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368289c-ab28-4b6d-b279-d9099b1e286d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:42.759674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a7d13-a816-4ab3-8e1e-2d2bb03ff36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:42.759865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368289c-ab28-4b6d-b279-d9099b1e286d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:42.761217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a7d13-a816-4ab3-8e1e-2d2bb03ff36f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0c4a7d13-a816-4ab3-8e1e-2d2bb03ff36f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:42.779558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:42.782135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:42.783427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:42.783427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:42.783427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:42.783427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 301/592] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:42.783427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7d13-a816-4ab3-8e1e-2d2bb03ff36f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:42.788160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 292/593] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 18 06:11:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:42.788160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368289c-ab28-4b6d-b279-d9099b1e286d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:42.909803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368289c-ab28-4b6d-b279-d9099b1e286d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:42.912021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7d13-a816-4ab3-8e1e-2d2bb03ff36f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:42.928944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:42.950144 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190618f-a41a-477c-9eff-0b3c1b8a9cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:42.950821 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190618f-a41a-477c-9eff-0b3c1b8a9cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:42.951101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190618f-a41a-477c-9eff-0b3c1b8a9cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:42.951510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190618f-a41a-477c-9eff-0b3c1b8a9cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:42.952186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef770e85-713f-4dfe-be6e-a9cb1dcffce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:42.953112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef770e85-713f-4dfe-be6e-a9cb1dcffce6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:42.953753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef770e85-713f-4dfe-be6e-a9cb1dcffce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:42.954128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef770e85-713f-4dfe-be6e-a9cb1dcffce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:42.964439 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190618f-a41a-477c-9eff-0b3c1b8a9cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:42.966228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef770e85-713f-4dfe-be6e-a9cb1dcffce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:42.966362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190618f-a41a-477c-9eff-0b3c1b8a9cd0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:42.967987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef770e85-713f-4dfe-be6e-a9cb1dcffce6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8190618f-a41a-477c-9eff-0b3c1b8a9cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:42.982474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:42.984983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:42.987161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:42.987161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:42.987161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:42.987161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 302/594] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:42.987161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190618f-a41a-477c-9eff-0b3c1b8a9cd0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ef770e85-713f-4dfe-be6e-a9cb1dcffce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:42.993282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:42.994530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:42.996715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:42.996715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:42.996715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:42.997112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:42.997258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 293/595] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:43.000159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef770e85-713f-4dfe-be6e-a9cb1dcffce6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:43.110014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190618f-a41a-477c-9eff-0b3c1b8a9cd0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:43.113692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef770e85-713f-4dfe-be6e-a9cb1dcffce6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:43.147135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527565a-2616-48ef-a937-e9399d684a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:43.147991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527565a-2616-48ef-a937-e9399d684a08 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:43.148574 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527565a-2616-48ef-a937-e9399d684a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:43.148869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527565a-2616-48ef-a937-e9399d684a08 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:43.149791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527565a-2616-48ef-a937-e9399d684a08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:43.150101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527565a-2616-48ef-a937-e9399d684a08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:43.151485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527565a-2616-48ef-a937-e9399d684a08 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:43.153399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e0eb9-2f9e-401f-9e81-5dd0c0d39e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:43.154598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0eb9-2f9e-401f-9e81-5dd0c0d39e31 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:43.154945 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0eb9-2f9e-401f-9e81-5dd0c0d39e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:43.155286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e0eb9-2f9e-401f-9e81-5dd0c0d39e31 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:43.156628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e0eb9-2f9e-401f-9e81-5dd0c0d39e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:43.157028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e0eb9-2f9e-401f-9e81-5dd0c0d39e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:43.158534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e0eb9-2f9e-401f-9e81-5dd0c0d39e31 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:43.172010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 303/596] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:43.173565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527565a-2616-48ef-a937-e9399d684a08 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:43.177087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 294/597] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:43.178043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e0eb9-2f9e-401f-9e81-5dd0c0d39e31 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:43.209311 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:43.275959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:43.323928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527565a-2616-48ef-a937-e9399d684a08 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:43.339937 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e0eb9-2f9e-401f-9e81-5dd0c0d39e31 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:43.371197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a090ea-8ade-4a16-8d92-b37ffb16c18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:43.373645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a090ea-8ade-4a16-8d92-b37ffb16c18d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:43.373645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a090ea-8ade-4a16-8d92-b37ffb16c18d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:43.373645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a090ea-8ade-4a16-8d92-b37ffb16c18d None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:43.373645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a090ea-8ade-4a16-8d92-b37ffb16c18d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:43.373645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a090ea-8ade-4a16-8d92-b37ffb16c18d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:43.374767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a090ea-8ade-4a16-8d92-b37ffb16c18d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:43.394001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 304/598] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:43.394001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a090ea-8ade-4a16-8d92-b37ffb16c18d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:43.411932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7dd97-ee82-495c-ad06-80c8105d07bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:43.411932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7dd97-ee82-495c-ad06-80c8105d07bf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:43.411932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7dd97-ee82-495c-ad06-80c8105d07bf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:43.411932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7dd97-ee82-495c-ad06-80c8105d07bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:43.423994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7dd97-ee82-495c-ad06-80c8105d07bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:43.423994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7dd97-ee82-495c-ad06-80c8105d07bf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-66c7dd97-ee82-495c-ad06-80c8105d07bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:43.445818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:43.448007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:43.450127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:43.450127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:43.450127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:43.450127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:43.450127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:43.450127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:43.450127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:43.450127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:43.450127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 295/599] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:43.451272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7dd97-ee82-495c-ad06-80c8105d07bf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:43.579370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a090ea-8ade-4a16-8d92-b37ffb16c18d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:43.619930 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:43.627931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:43.631927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad69b2f-cd91-4c8c-9bfb-241ffa4e0c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:43.631927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69b2f-cd91-4c8c-9bfb-241ffa4e0c02 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:43.631927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69b2f-cd91-4c8c-9bfb-241ffa4e0c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:43.631927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69b2f-cd91-4c8c-9bfb-241ffa4e0c02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:43.641387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad69b2f-cd91-4c8c-9bfb-241ffa4e0c02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:43.643191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad69b2f-cd91-4c8c-9bfb-241ffa4e0c02 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:43.653934 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7dd97-ee82-495c-ad06-80c8105d07bf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-5ad69b2f-cd91-4c8c-9bfb-241ffa4e0c02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:43.658160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:43.659598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:43.661510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:43.661510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:43.661510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:43.661510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:43.661510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:43.661510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:43.661510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:43.661510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:43.661510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 305/600] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:43.666331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad69b2f-cd91-4c8c-9bfb-241ffa4e0c02 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:43.742052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6aab52-d8a8-4cd3-8b51-e428080048cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:43.747952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6aab52-d8a8-4cd3-8b51-e428080048cf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:43.747952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6aab52-d8a8-4cd3-8b51-e428080048cf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:43.747952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6aab52-d8a8-4cd3-8b51-e428080048cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:43.767827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6aab52-d8a8-4cd3-8b51-e428080048cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:43.771991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6aab52-d8a8-4cd3-8b51-e428080048cf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:43.799933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad69b2f-cd91-4c8c-9bfb-241ffa4e0c02 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2b6aab52-d8a8-4cd3-8b51-e428080048cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:43.815928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:43.817508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:43.818652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:43.818652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:43.818652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:43.818652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:43.818652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:43.818652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:43.818652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:43.818652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:43.828057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 296/601] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:43.828057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6aab52-d8a8-4cd3-8b51-e428080048cf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:43.849628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f88d39-9bc6-406f-bace-4bd0bb6237e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:43.850744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f88d39-9bc6-406f-bace-4bd0bb6237e2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:43.851826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f88d39-9bc6-406f-bace-4bd0bb6237e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:43.852370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f88d39-9bc6-406f-bace-4bd0bb6237e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:43.853272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f88d39-9bc6-406f-bace-4bd0bb6237e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:43.853790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f88d39-9bc6-406f-bace-4bd0bb6237e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:43.855458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f88d39-9bc6-406f-bace-4bd0bb6237e2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:43.883735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 306/602] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:43.884737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f88d39-9bc6-406f-bace-4bd0bb6237e2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:43.942870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:43.974917 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6aab52-d8a8-4cd3-8b51-e428080048cf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:44.001017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f88d39-9bc6-406f-bace-4bd0bb6237e2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:44.014576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688f537-d1ed-42ad-8f4d-82c5d2501969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:44.015208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f537-d1ed-42ad-8f4d-82c5d2501969 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:44.015490 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f537-d1ed-42ad-8f4d-82c5d2501969 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:44.015767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f537-d1ed-42ad-8f4d-82c5d2501969 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:44.016617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688f537-d1ed-42ad-8f4d-82c5d2501969 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:44.016930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688f537-d1ed-42ad-8f4d-82c5d2501969 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:44.018407 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688f537-d1ed-42ad-8f4d-82c5d2501969 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:44.030964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 297/603] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:44.032504 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2c3bb-49c9-48fe-b90a-ba039179dfaf None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:44.032640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2c3bb-49c9-48fe-b90a-ba039179dfaf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:44.032839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2c3bb-49c9-48fe-b90a-ba039179dfaf None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:44.034744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 298/604] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:44.034984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2c3bb-49c9-48fe-b90a-ba039179dfaf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:44.037941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352f886-c702-4448-aa36-a3479d3147bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:44.038572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352f886-c702-4448-aa36-a3479d3147bf None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:44.038853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352f886-c702-4448-aa36-a3479d3147bf None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:44.039124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352f886-c702-4448-aa36-a3479d3147bf None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:44.039813 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352f886-c702-4448-aa36-a3479d3147bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:44.040139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352f886-c702-4448-aa36-a3479d3147bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:44.041559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352f886-c702-4448-aa36-a3479d3147bf None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:44.053208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:44.055149 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 307/605] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:44.056099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352f886-c702-4448-aa36-a3479d3147bf None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:44.158197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2c3bb-49c9-48fe-b90a-ba039179dfaf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:44.162470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352f886-c702-4448-aa36-a3479d3147bf None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:44.165570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:44.198666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc2faf-43e7-4dd2-96f0-f174be09992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:44.199706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc2faf-43e7-4dd2-96f0-f174be09992f None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:44.200183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc2faf-43e7-4dd2-96f0-f174be09992f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:44.200457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc2faf-43e7-4dd2-96f0-f174be09992f None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/03c498b5857f42f2ab84423f8f4ea11a/roles/7a2c1ebe84c94165a42716d4de2d3290` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:44.201500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcde99-d665-4a29-8a4b-87a92d28ed6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:44.202160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcde99-d665-4a29-8a4b-87a92d28ed6b None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:44.202441 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcde99-d665-4a29-8a4b-87a92d28ed6b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:44.202775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcde99-d665-4a29-8a4b-87a92d28ed6b None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/1bb483203d3b4210a53a317443206d35/roles/7a2c1ebe84c94165a42716d4de2d3290` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:44.216242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc2faf-43e7-4dd2-96f0-f174be09992f None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=03c498b5857f42f2ab84423f8f4ea11a, role_id=7a2c1ebe84c94165a42716d4de2d3290)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:44.217340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcde99-d665-4a29-8a4b-87a92d28ed6b None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=1bb483203d3b4210a53a317443206d35, role_id=7a2c1ebe84c94165a42716d4de2d3290)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:44.217728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc2faf-43e7-4dd2-96f0-f174be09992f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:44.219322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcde99-d665-4a29-8a4b-87a92d28ed6b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:44.243937 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 299/606] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:11:44 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/03c498b5857f42f2ab84423f8f4ea11a/roles/7a2c1ebe84c94165a42716d4de2d3290 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:11:44.244183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 308/607] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:11:44 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/1bb483203d3b4210a53a317443206d35/roles/7a2c1ebe84c94165a42716d4de2d3290 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:11:44.244309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbdfbd-8f51-4701-ad87-2db48d60c968 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:44.244403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcde99-d665-4a29-8a4b-87a92d28ed6b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:44.244489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbdfbd-8f51-4701-ad87-2db48d60c968 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:44.244489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbdfbd-8f51-4701-ad87-2db48d60c968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:44.266303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a3dbdfbd-8f51-4701-ad87-2db48d60c968 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:44.267741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a3dbdfbd-8f51-4701-ad87-2db48d60c968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:44.347343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:44.396638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 300/608] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:44.398887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcde99-d665-4a29-8a4b-87a92d28ed6b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:44.462731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d6a81-d208-4b53-908b-5dd6b04a5484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:44.463419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6a81-d208-4b53-908b-5dd6b04a5484 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:44.463696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6a81-d208-4b53-908b-5dd6b04a5484 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:44.464004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d6a81-d208-4b53-908b-5dd6b04a5484 None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/1d78e909fc894ddd9b35ead5fe68b898/roles/7a2c1ebe84c94165a42716d4de2d3290` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:44.487766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d6a81-d208-4b53-908b-5dd6b04a5484 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=1d78e909fc894ddd9b35ead5fe68b898, role_id=7a2c1ebe84c94165a42716d4de2d3290)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:44.489434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d6a81-d208-4b53-908b-5dd6b04a5484 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:44.508211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 309/609] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:11:44 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/1d78e909fc894ddd9b35ead5fe68b898/roles/7a2c1ebe84c94165a42716d4de2d3290 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:11:44.644447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e09360-3738-4713-bcb5-966f21246bf5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:44.644447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e09360-3738-4713-bcb5-966f21246bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:44.644447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e09360-3738-4713-bcb5-966f21246bf5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:44.645200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 301/610] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:11:44.649981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7d7b-27f4-46d8-8763-867f5205feb4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:44.650270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7d7b-27f4-46d8-8763-867f5205feb4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:44.650550 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e7d7b-27f4-46d8-8763-867f5205feb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:44.660298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:44.677373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-080e7d7b-27f4-46d8-8763-867f5205feb4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:44.678597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-080e7d7b-27f4-46d8-8763-867f5205feb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:44.717198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e09360-3738-4713-bcb5-966f21246bf5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:44.786830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 310/611] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:44.882465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e09360-3738-4713-bcb5-966f21246bf5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:44.933486 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068e18-263b-42db-865a-2f234e81d448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:44.934123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068e18-263b-42db-865a-2f234e81d448 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:44.934402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068e18-263b-42db-865a-2f234e81d448 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:44.934680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068e18-263b-42db-865a-2f234e81d448 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:44.950271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15068e18-263b-42db-865a-2f234e81d448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-15068e18-263b-42db-865a-2f234e81d448 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:44.955218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:44.956195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:44.957050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 302/612] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:44.962106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e7d7b-27f4-46d8-8763-867f5205feb4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:45.108931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068e18-263b-42db-865a-2f234e81d448 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:45.116810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e7d7b-27f4-46d8-8763-867f5205feb4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:45.173565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7b6fb-c523-40fb-a8b0-f26b51ef67ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:45.174182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7b6fb-c523-40fb-a8b0-f26b51ef67ae None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:45.174457 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7b6fb-c523-40fb-a8b0-f26b51ef67ae None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:45.174725 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7b6fb-c523-40fb-a8b0-f26b51ef67ae None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:45.175403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7b6fb-c523-40fb-a8b0-f26b51ef67ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:45.175703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7b6fb-c523-40fb-a8b0-f26b51ef67ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:45.177127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7b6fb-c523-40fb-a8b0-f26b51ef67ae None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:45.178887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:45.193633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 311/613] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:45.196262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:45.201051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7b6fb-c523-40fb-a8b0-f26b51ef67ae None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:45.306485 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068e18-263b-42db-865a-2f234e81d448 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:45.364725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e0ad9-a51b-4f6f-9a9c-182828daa6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:45.365346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e0ad9-a51b-4f6f-9a9c-182828daa6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:45.365625 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e0ad9-a51b-4f6f-9a9c-182828daa6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:45.365896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e0ad9-a51b-4f6f-9a9c-182828daa6c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:45.379930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e0ad9-a51b-4f6f-9a9c-182828daa6c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a92e0ad9-a51b-4f6f-9a9c-182828daa6c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:45.383751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:45.384806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:45.385683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 303/614] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:45.391461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e0ad9-a51b-4f6f-9a9c-182828daa6c7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:45.414740 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7b6fb-c523-40fb-a8b0-f26b51ef67ae None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:45.488246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45b493-eb92-4484-ae34-883ff3dc1a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:45.489274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45b493-eb92-4484-ae34-883ff3dc1a93 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:45.489767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45b493-eb92-4484-ae34-883ff3dc1a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:45.490243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45b493-eb92-4484-ae34-883ff3dc1a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:45.523443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45b493-eb92-4484-ae34-883ff3dc1a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:45.527450 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45b493-eb92-4484-ae34-883ff3dc1a93 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-2b45b493-eb92-4484-ae34-883ff3dc1a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:45.552865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:45.553952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:45.554875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:45.554875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:45.554875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:45.554875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 312/615] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:45.560059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e0ad9-a51b-4f6f-9a9c-182828daa6c7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:45.563178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45b493-eb92-4484-ae34-883ff3dc1a93 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:45.596146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:45.650100 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc55fa6-c29b-466c-81f5-a9b600a2b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:45.650714 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc55fa6-c29b-466c-81f5-a9b600a2b874 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:45.650993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc55fa6-c29b-466c-81f5-a9b600a2b874 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:45.651266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc55fa6-c29b-466c-81f5-a9b600a2b874 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:45.651949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc55fa6-c29b-466c-81f5-a9b600a2b874 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:45.652256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc55fa6-c29b-466c-81f5-a9b600a2b874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:45.654543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc55fa6-c29b-466c-81f5-a9b600a2b874 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:45.671288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:45.673461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 304/616] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:45.677546 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc55fa6-c29b-466c-81f5-a9b600a2b874 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:45.770922 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45b493-eb92-4484-ae34-883ff3dc1a93 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:45.855815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072478b-d03e-4a68-94d3-79f6c8aa033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:45.856432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072478b-d03e-4a68-94d3-79f6c8aa033e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:45.856709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072478b-d03e-4a68-94d3-79f6c8aa033e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:45.856982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072478b-d03e-4a68-94d3-79f6c8aa033e None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:45.857680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072478b-d03e-4a68-94d3-79f6c8aa033e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:45.857982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072478b-d03e-4a68-94d3-79f6c8aa033e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:45.859640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072478b-d03e-4a68-94d3-79f6c8aa033e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:45.879350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc55fa6-c29b-466c-81f5-a9b600a2b874 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:45.887861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 313/617] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:45.889491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072478b-d03e-4a68-94d3-79f6c8aa033e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:45.951397 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f2c8e-ae52-4999-bbe7-3bcb85ebfe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:45.952090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f2c8e-ae52-4999-bbe7-3bcb85ebfe4c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:45.952320 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f2c8e-ae52-4999-bbe7-3bcb85ebfe4c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:45.952654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f2c8e-ae52-4999-bbe7-3bcb85ebfe4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:45.976896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f2c8e-ae52-4999-bbe7-3bcb85ebfe4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:45.979445 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f2c8e-ae52-4999-bbe7-3bcb85ebfe4c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-339f2c8e-ae52-4999-bbe7-3bcb85ebfe4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:46.004493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:46.005503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:46.006398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:46.006398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:46.006398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:46.006398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 305/618] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:46.011521 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f2c8e-ae52-4999-bbe7-3bcb85ebfe4c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:46.056373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:46.094104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072478b-d03e-4a68-94d3-79f6c8aa033e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:46.124339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:46.166279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e1376-398c-41db-8705-ebca77b963d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:46.166910 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e1376-398c-41db-8705-ebca77b963d1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:46.167185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e1376-398c-41db-8705-ebca77b963d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:46.167456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e1376-398c-41db-8705-ebca77b963d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:46.181224 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e1376-398c-41db-8705-ebca77b963d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:46.182666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e1376-398c-41db-8705-ebca77b963d1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:46.203385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f2c8e-ae52-4999-bbe7-3bcb85ebfe4c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-540e1376-398c-41db-8705-ebca77b963d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:46.207176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:46.208305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:46.209437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:46.209437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:46.209437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:46.209437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:46.209437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:46.209437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:46.209437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:46.209437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:46.209437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:11:46.209437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:46.214569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 314/619] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:11:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:46.215418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e1376-398c-41db-8705-ebca77b963d1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:46.264542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec587cb-b440-4508-9138-58c0116fbdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:46.266175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec587cb-b440-4508-9138-58c0116fbdce None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:46.266460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec587cb-b440-4508-9138-58c0116fbdce None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:46.266740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec587cb-b440-4508-9138-58c0116fbdce None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:46.267384 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec587cb-b440-4508-9138-58c0116fbdce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:46.267691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec587cb-b440-4508-9138-58c0116fbdce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:46.269380 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec587cb-b440-4508-9138-58c0116fbdce None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:46.294457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 306/620] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:46.299038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec587cb-b440-4508-9138-58c0116fbdce None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:46.413534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e1376-398c-41db-8705-ebca77b963d1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:46.468853 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:46.487121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf96ad-0db1-4209-a68c-c57b862c434f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:46.487728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf96ad-0db1-4209-a68c-c57b862c434f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:46.488031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf96ad-0db1-4209-a68c-c57b862c434f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:46.488308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf96ad-0db1-4209-a68c-c57b862c434f None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:46.489036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf96ad-0db1-4209-a68c-c57b862c434f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:46.489336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf96ad-0db1-4209-a68c-c57b862c434f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:46.490772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf96ad-0db1-4209-a68c-c57b862c434f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:46.499041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec587cb-b440-4508-9138-58c0116fbdce None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:46.533103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 315/621] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 18 06:11:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:46.535393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf96ad-0db1-4209-a68c-c57b862c434f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:46.565267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeecfa6-343b-423b-bcc1-8384fe932d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:46.565901 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeecfa6-343b-423b-bcc1-8384fe932d59 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:46.566180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeecfa6-343b-423b-bcc1-8384fe932d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:46.566452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeecfa6-343b-423b-bcc1-8384fe932d59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:46.582069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeecfa6-343b-423b-bcc1-8384fe932d59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:46.583513 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeecfa6-343b-423b-bcc1-8384fe932d59 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:46.600289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-efeecfa6-343b-423b-bcc1-8384fe932d59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:46.605245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:46.606257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:46.607199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:46.607199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:46.607199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:46.607199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:46.607199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:46.607199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:46.607199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:46.607199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:46.607199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:11:46.607199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:46.616092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 307/622] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 18 06:11:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:46.626095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeecfa6-343b-423b-bcc1-8384fe932d59 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:46.733255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf96ad-0db1-4209-a68c-c57b862c434f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:46.774044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d811d-e215-46d3-951e-d11ec8273416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:46.774929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d811d-e215-46d3-951e-d11ec8273416 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:46.775354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d811d-e215-46d3-951e-d11ec8273416 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:46.775807 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d811d-e215-46d3-951e-d11ec8273416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:46.780070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeecfa6-343b-423b-bcc1-8384fe932d59 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:46.786822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d811d-e215-46d3-951e-d11ec8273416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:46.788631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d811d-e215-46d3-951e-d11ec8273416 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-448d811d-e215-46d3-951e-d11ec8273416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:46.805838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:46.807063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:46.808158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:46.808158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:46.808158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:46.809922 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 316/623] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:46.811421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e3f1-660e-4832-ac9e-b89b9f1d7040 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:46.812581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e3f1-660e-4832-ac9e-b89b9f1d7040 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:46.813176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e3f1-660e-4832-ac9e-b89b9f1d7040 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:46.818947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 317/624] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:46.820220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e3f1-660e-4832-ac9e-b89b9f1d7040 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:46.821808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c6676-531d-4c78-a8f3-c594d5f9fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:46.822412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c6676-531d-4c78-a8f3-c594d5f9fa65 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:46.822688 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c6676-531d-4c78-a8f3-c594d5f9fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:46.822960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c6676-531d-4c78-a8f3-c594d5f9fa65 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:46.824069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c6676-531d-4c78-a8f3-c594d5f9fa65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:46.824195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c6676-531d-4c78-a8f3-c594d5f9fa65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:46.825751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c6676-531d-4c78-a8f3-c594d5f9fa65 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:46.845278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:46.849952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 308/625] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 18 06:11:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:46.851252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f353a54-5afc-46e0-a1a4-f4d07b769ecc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:46.851535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f353a54-5afc-46e0-a1a4-f4d07b769ecc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:46.851810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f353a54-5afc-46e0-a1a4-f4d07b769ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:46.871700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3f353a54-5afc-46e0-a1a4-f4d07b769ecc None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:46.873150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3f353a54-5afc-46e0-a1a4-f4d07b769ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:46.929720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:46.959922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 309/626] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:46.960444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e3f1-660e-4832-ac9e-b89b9f1d7040 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:46.960527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f353a54-5afc-46e0-a1a4-f4d07b769ecc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:47.016485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739b61b-7f48-4cec-be2c-0fc83b00b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:47.017015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739b61b-7f48-4cec-be2c-0fc83b00b968 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.017293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739b61b-7f48-4cec-be2c-0fc83b00b968 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.017559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739b61b-7f48-4cec-be2c-0fc83b00b968 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.018196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739b61b-7f48-4cec-be2c-0fc83b00b968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:47.018492 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739b61b-7f48-4cec-be2c-0fc83b00b968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:47.020796 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739b61b-7f48-4cec-be2c-0fc83b00b968 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:47.036109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 318/627] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:47.037592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb049c8-333c-466a-bf22-7549736449cf None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.038075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb049c8-333c-466a-bf22-7549736449cf None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.038549 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb049c8-333c-466a-bf22-7549736449cf None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.044093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 319/628] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:47.045165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb049c8-333c-466a-bf22-7549736449cf None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:47.092172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f353a54-5afc-46e0-a1a4-f4d07b769ecc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:47.120332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:47.127846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bf0fe-3260-4eea-ab95-456217e2089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:47.128469 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bf0fe-3260-4eea-ab95-456217e2089c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.128747 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bf0fe-3260-4eea-ab95-456217e2089c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.129021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bf0fe-3260-4eea-ab95-456217e2089c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.152696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb049c8-333c-466a-bf22-7549736449cf None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:47.189407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69227f42-565a-487e-a144-b0590bfc6664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:47.190022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69227f42-565a-487e-a144-b0590bfc6664 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.190302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69227f42-565a-487e-a144-b0590bfc6664 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.190568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69227f42-565a-487e-a144-b0590bfc6664 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.197278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69227f42-565a-487e-a144-b0590bfc6664 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:47.198716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69227f42-565a-487e-a144-b0590bfc6664 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:47.198892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bf0fe-3260-4eea-ab95-456217e2089c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:47.200365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bf0fe-3260-4eea-ab95-456217e2089c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:47.200494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-69227f42-565a-487e-a144-b0590bfc6664 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:47.212130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:47.213156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:47.214055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:47.214055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:47.214055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:47.214055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:47.214055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:47.214055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:47.214055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:47.214055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:47.214055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 320/629] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:47.214559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85085788-b7b0-474e-8414-cf01fa0f1cad None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.214637 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85085788-b7b0-474e-8414-cf01fa0f1cad None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.215185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85085788-b7b0-474e-8414-cf01fa0f1cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.232735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-85085788-b7b0-474e-8414-cf01fa0f1cad None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:47.234058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-85085788-b7b0-474e-8414-cf01fa0f1cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:47.300624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 321/630] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:47.302126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7e051-ab63-43d7-b8c7-cefa0f362a21 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.302558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7e051-ab63-43d7-b8c7-cefa0f362a21 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.303028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7e051-ab63-43d7-b8c7-cefa0f362a21 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.304196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 322/631] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:47.310640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 310/632] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:47.310640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bf0fe-3260-4eea-ab95-456217e2089c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:47.310893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7e051-ab63-43d7-b8c7-cefa0f362a21 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:47.338061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:47.414911 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bf0fe-3260-4eea-ab95-456217e2089c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:47.418017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7e051-ab63-43d7-b8c7-cefa0f362a21 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:47.445620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:47.455430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584198cf-5ae1-40c7-a76c-df28ccfb49c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:47.455958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520723f-e115-49cb-849a-e484d50ca28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:47.456078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584198cf-5ae1-40c7-a76c-df28ccfb49c9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.456341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584198cf-5ae1-40c7-a76c-df28ccfb49c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.456559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520723f-e115-49cb-849a-e484d50ca28b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.456672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584198cf-5ae1-40c7-a76c-df28ccfb49c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.456870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520723f-e115-49cb-849a-e484d50ca28b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.457096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520723f-e115-49cb-849a-e484d50ca28b None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.457777 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520723f-e115-49cb-849a-e484d50ca28b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:47.458078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520723f-e115-49cb-849a-e484d50ca28b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:47.459622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520723f-e115-49cb-849a-e484d50ca28b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:47.466800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584198cf-5ae1-40c7-a76c-df28ccfb49c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:47.477006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 323/633] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-584198cf-5ae1-40c7-a76c-df28ccfb49c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:47.477184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:47.478080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:47.478918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:47.479561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e63477-4b71-4d65-8ffb-a47c2d2d21a7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.479561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e63477-4b71-4d65-8ffb-a47c2d2d21a7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.479694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 311/634] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:47.479764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e63477-4b71-4d65-8ffb-a47c2d2d21a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.479844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584198cf-5ae1-40c7-a76c-df28ccfb49c9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:47.496812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e5e63477-4b71-4d65-8ffb-a47c2d2d21a7 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:47.498080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e5e63477-4b71-4d65-8ffb-a47c2d2d21a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:47.568478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:47.569335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 324/635] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:47.573367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e63477-4b71-4d65-8ffb-a47c2d2d21a7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:47.581210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584198cf-5ae1-40c7-a76c-df28ccfb49c9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:47.617686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ef7ab-e7b0-4b14-9898-5671792ba978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:47.618715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef7ab-e7b0-4b14-9898-5671792ba978 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.618996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef7ab-e7b0-4b14-9898-5671792ba978 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.619272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef7ab-e7b0-4b14-9898-5671792ba978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.629788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ef7ab-e7b0-4b14-9898-5671792ba978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:47.631222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ef7ab-e7b0-4b14-9898-5671792ba978 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-da3ef7ab-e7b0-4b14-9898-5671792ba978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:47.646587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:47.647506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:47.648425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:47.648425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:47.648425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:47.648425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 312/636] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:47.649600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ef7ab-e7b0-4b14-9898-5671792ba978 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:47.686142 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e63477-4b71-4d65-8ffb-a47c2d2d21a7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:47.704334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:47.721322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0a51c-6fea-4fb3-a08d-f045e940496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:47.721978 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0a51c-6fea-4fb3-a08d-f045e940496a None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.722256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0a51c-6fea-4fb3-a08d-f045e940496a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.722537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0a51c-6fea-4fb3-a08d-f045e940496a None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/3e0f04f474124698a46bed8dac01e30e/roles/7a2c1ebe84c94165a42716d4de2d3290` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.738118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0a51c-6fea-4fb3-a08d-f045e940496a None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=3e0f04f474124698a46bed8dac01e30e, role_id=7a2c1ebe84c94165a42716d4de2d3290)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:47.739571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0a51c-6fea-4fb3-a08d-f045e940496a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:47.752174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 325/637] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:11:47 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/3e0f04f474124698a46bed8dac01e30e/roles/7a2c1ebe84c94165a42716d4de2d3290 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:11:47.753261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0a51c-6fea-4fb3-a08d-f045e940496a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:47.773670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ef7ab-e7b0-4b14-9898-5671792ba978 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:47.813692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5d8a-3958-4c8d-a2d6-2094e611af26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:47.814690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5d8a-3958-4c8d-a2d6-2094e611af26 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.815249 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5d8a-3958-4c8d-a2d6-2094e611af26 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.815750 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5d8a-3958-4c8d-a2d6-2094e611af26 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.816809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5d8a-3958-4c8d-a2d6-2094e611af26 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:47.817349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5d8a-3958-4c8d-a2d6-2094e611af26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:47.820135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5d8a-3958-4c8d-a2d6-2094e611af26 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:47.830882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 313/638] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:47.832225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5d8a-3958-4c8d-a2d6-2094e611af26 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:47.837432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:47.892988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0a51c-6fea-4fb3-a08d-f045e940496a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:47.928760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d6138-c349-4297-a2fb-9f0086727112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:47.929402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d6138-c349-4297-a2fb-9f0086727112 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.929679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d6138-c349-4297-a2fb-9f0086727112 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.929950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d6138-c349-4297-a2fb-9f0086727112 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.941748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d6138-c349-4297-a2fb-9f0086727112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-9c8d6138-c349-4297-a2fb-9f0086727112 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:47.947186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:47.948449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:47.949347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:47.949996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5d8a-3958-4c8d-a2d6-2094e611af26 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:47.950070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 326/639] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:47.950070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d6138-c349-4297-a2fb-9f0086727112 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:47.985617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:47.991359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed52ee-290d-4e32-9b15-b15a699927a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:47.992608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed52ee-290d-4e32-9b15-b15a699927a5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:47.992885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed52ee-290d-4e32-9b15-b15a699927a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:47.993155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed52ee-290d-4e32-9b15-b15a699927a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:47.993797 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed52ee-290d-4e32-9b15-b15a699927a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:47.994098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed52ee-290d-4e32-9b15-b15a699927a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:47.995452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed52ee-290d-4e32-9b15-b15a699927a5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:48.007842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 314/640] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:48.008706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed52ee-290d-4e32-9b15-b15a699927a5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:48.067540 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d6138-c349-4297-a2fb-9f0086727112 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:48.078918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:48.103601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef7ca-1d76-4b54-83e5-b3e3bb94bc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:48.104270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef7ca-1d76-4b54-83e5-b3e3bb94bc7c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:48.104537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef7ca-1d76-4b54-83e5-b3e3bb94bc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:48.104819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef7ca-1d76-4b54-83e5-b3e3bb94bc7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:48.114831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef7ca-1d76-4b54-83e5-b3e3bb94bc7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:48.116319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef7ca-1d76-4b54-83e5-b3e3bb94bc7c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:48.121569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed52ee-290d-4e32-9b15-b15a699927a5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-f97ef7ca-1d76-4b54-83e5-b3e3bb94bc7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:48.131291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:48.132616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:48.133514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:48.133514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:48.133514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:48.137381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 327/641] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:48.138056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef7ca-1d76-4b54-83e5-b3e3bb94bc7c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:48.161968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ffb62-4037-49e8-85fa-7356dd0b135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:48.162577 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ffb62-4037-49e8-85fa-7356dd0b135b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:48.162852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ffb62-4037-49e8-85fa-7356dd0b135b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:48.163121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ffb62-4037-49e8-85fa-7356dd0b135b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:48.174020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ffb62-4037-49e8-85fa-7356dd0b135b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-359ffb62-4037-49e8-85fa-7356dd0b135b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:48.178737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:48.179721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 315/642] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:48.180610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ffb62-4037-49e8-85fa-7356dd0b135b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:48.229014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:48.250050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef7ca-1d76-4b54-83e5-b3e3bb94bc7c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:48.286491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7d0b-83e0-495e-b4e0-d6251fde2a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:48.287100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7d0b-83e0-495e-b4e0-d6251fde2a66 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:48.287379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7d0b-83e0-495e-b4e0-d6251fde2a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:48.287655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7d0b-83e0-495e-b4e0-d6251fde2a66 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:48.288347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7d0b-83e0-495e-b4e0-d6251fde2a66 None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:48.288651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7d0b-83e0-495e-b4e0-d6251fde2a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:48.290015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7d0b-83e0-495e-b4e0-d6251fde2a66 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:48.294323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ffb62-4037-49e8-85fa-7356dd0b135b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:48.298564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 328/643] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:48.299298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7d0b-83e0-495e-b4e0-d6251fde2a66 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:48.326104 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:48.339949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cbf35-c8fd-4e53-a92f-62e2eb293617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:48.340905 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cbf35-c8fd-4e53-a92f-62e2eb293617 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:48.341190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cbf35-c8fd-4e53-a92f-62e2eb293617 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:48.341467 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cbf35-c8fd-4e53-a92f-62e2eb293617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:48.348932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cbf35-c8fd-4e53-a92f-62e2eb293617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:48.350832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cbf35-c8fd-4e53-a92f-62e2eb293617 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b09cbf35-c8fd-4e53-a92f-62e2eb293617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:48.362613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:48.363687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:48.364839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:48.364839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:48.364839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:48.364839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:48.364839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:48.364839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:48.364839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:48.364839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:48.364839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 316/644] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:48.364839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cbf35-c8fd-4e53-a92f-62e2eb293617 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:48.410312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7d0b-83e0-495e-b4e0-d6251fde2a66 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:48.451821 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccb2b7-3296-4d87-96ed-f2dc65cb582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:48.453492 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccb2b7-3296-4d87-96ed-f2dc65cb582d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:48.453929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccb2b7-3296-4d87-96ed-f2dc65cb582d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:48.454730 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccb2b7-3296-4d87-96ed-f2dc65cb582d None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:48.455524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbccb2b7-3296-4d87-96ed-f2dc65cb582d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:48.456010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbccb2b7-3296-4d87-96ed-f2dc65cb582d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:48.458082 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbccb2b7-3296-4d87-96ed-f2dc65cb582d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:48.469902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cbf35-c8fd-4e53-a92f-62e2eb293617 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:48.475170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 329/645] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:48.476195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccb2b7-3296-4d87-96ed-f2dc65cb582d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:48.482715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:48.506763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7d633-1d4b-4ab1-9952-0463432a1716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:48.507363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d633-1d4b-4ab1-9952-0463432a1716 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:48.507709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d633-1d4b-4ab1-9952-0463432a1716 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:48.507991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d633-1d4b-4ab1-9952-0463432a1716 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:48.508586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7d633-1d4b-4ab1-9952-0463432a1716 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:48.508883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7d633-1d4b-4ab1-9952-0463432a1716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:48.510312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7d633-1d4b-4ab1-9952-0463432a1716 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:48.519616 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 317/646] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:48.520202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7d633-1d4b-4ab1-9952-0463432a1716 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:48.573049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:48.592160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccb2b7-3296-4d87-96ed-f2dc65cb582d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:48.629021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cc2ef-59e9-4da4-993f-7dccc57bcab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:48.629654 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cc2ef-59e9-4da4-993f-7dccc57bcab0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:48.629931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cc2ef-59e9-4da4-993f-7dccc57bcab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:48.630033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7d633-1d4b-4ab1-9952-0463432a1716 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:48.630222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cc2ef-59e9-4da4-993f-7dccc57bcab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:48.641560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cc2ef-59e9-4da4-993f-7dccc57bcab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:48.643008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cc2ef-59e9-4da4-993f-7dccc57bcab0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-bb7cc2ef-59e9-4da4-993f-7dccc57bcab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:48.659097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:48.660178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:48.661117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:48.661117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:48.661117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:48.661117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 330/647] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:48.661117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cc2ef-59e9-4da4-993f-7dccc57bcab0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:48.673255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8625fc-9f7e-4b25-976d-2c912929b2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:48.673861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8625fc-9f7e-4b25-976d-2c912929b2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:48.674139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8625fc-9f7e-4b25-976d-2c912929b2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:48.674412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8625fc-9f7e-4b25-976d-2c912929b2e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:48.675100 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8625fc-9f7e-4b25-976d-2c912929b2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:48.675403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8625fc-9f7e-4b25-976d-2c912929b2e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:48.676860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8625fc-9f7e-4b25-976d-2c912929b2e3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:48.691699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 318/648] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:48.692828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8625fc-9f7e-4b25-976d-2c912929b2e3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:48.724263 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:48.770768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cc2ef-59e9-4da4-993f-7dccc57bcab0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:48.804324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f9dc6-9acd-4d6b-8413-48c6e85b963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:48.804947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f9dc6-9acd-4d6b-8413-48c6e85b963c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:48.805226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f9dc6-9acd-4d6b-8413-48c6e85b963c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:48.805503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f9dc6-9acd-4d6b-8413-48c6e85b963c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:48.806374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8625fc-9f7e-4b25-976d-2c912929b2e3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:48.813323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f9dc6-9acd-4d6b-8413-48c6e85b963c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:48.814766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f9dc6-9acd-4d6b-8413-48c6e85b963c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:48.816498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d86f9dc6-9acd-4d6b-8413-48c6e85b963c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:48.827099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:48.828949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:48.830133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:48.830133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:48.830133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:48.830133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:48.830133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:48.830133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:48.830133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:48.830133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:48.830133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 06:11:48.830133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:48.830706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 331/649] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:48.831369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f9dc6-9acd-4d6b-8413-48c6e85b963c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:48.857486 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e44bdb-e7b8-49e1-9403-d5df82e48456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:48.858048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e44bdb-e7b8-49e1-9403-d5df82e48456 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:48.858326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e44bdb-e7b8-49e1-9403-d5df82e48456 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:48.858660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e44bdb-e7b8-49e1-9403-d5df82e48456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:48.869297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e44bdb-e7b8-49e1-9403-d5df82e48456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:48.870735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e44bdb-e7b8-49e1-9403-d5df82e48456 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e2e44bdb-e7b8-49e1-9403-d5df82e48456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:48.886436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:48.887579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:48.888516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:48.888516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:48.888516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:48.888516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 319/650] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:48.888739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e44bdb-e7b8-49e1-9403-d5df82e48456 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:48.953619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f9dc6-9acd-4d6b-8413-48c6e85b963c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:48.966851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:48.990046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa31a-4e4d-4d19-8bc5-a4f77ec9241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:48.990673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa31a-4e4d-4d19-8bc5-a4f77ec9241b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:48.990950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa31a-4e4d-4d19-8bc5-a4f77ec9241b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:48.991220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5aa31a-4e4d-4d19-8bc5-a4f77ec9241b None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:48.991848 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5aa31a-4e4d-4d19-8bc5-a4f77ec9241b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:48.992171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5aa31a-4e4d-4d19-8bc5-a4f77ec9241b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:48.993534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5aa31a-4e4d-4d19-8bc5-a4f77ec9241b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:49.002623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e44bdb-e7b8-49e1-9403-d5df82e48456 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:49.006571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 332/651] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:49.007153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa31a-4e4d-4d19-8bc5-a4f77ec9241b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:49.041831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20613096-589b-4714-8fc5-68a2d4647075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:49.042437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613096-589b-4714-8fc5-68a2d4647075 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:49.042712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613096-589b-4714-8fc5-68a2d4647075 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:49.042983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613096-589b-4714-8fc5-68a2d4647075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:49.043701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20613096-589b-4714-8fc5-68a2d4647075 None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=9b5585d29bcb4b03a1902fbf113f48e8) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:49.044058 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20613096-589b-4714-8fc5-68a2d4647075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:49.045482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20613096-589b-4714-8fc5-68a2d4647075 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:49.059929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 320/652] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:48 2022] GET /identity/v3/role_assignments?user.id=9b5585d29bcb4b03a1902fbf113f48e8&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:49.059929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20613096-589b-4714-8fc5-68a2d4647075 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:49.090078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:49.133643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5aa31a-4e4d-4d19-8bc5-a4f77ec9241b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:49.182646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1843de-79e7-469b-ae7d-df33cd6c80ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:49.183516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1843de-79e7-469b-ae7d-df33cd6c80ce None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:49.183793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1843de-79e7-469b-ae7d-df33cd6c80ce None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:49.184094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1843de-79e7-469b-ae7d-df33cd6c80ce None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:49.185277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1843de-79e7-469b-ae7d-df33cd6c80ce None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:49.185846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1843de-79e7-469b-ae7d-df33cd6c80ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:49.187641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1843de-79e7-469b-ae7d-df33cd6c80ce None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:49.191733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20613096-589b-4714-8fc5-68a2d4647075 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:49.209825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 333/653] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 18 06:11:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:49.211078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1843de-79e7-469b-ae7d-df33cd6c80ce None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:49.239659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa005b-1abb-417d-864b-8b3b49616321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:49.240394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa005b-1abb-417d-864b-8b3b49616321 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:49.240670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa005b-1abb-417d-864b-8b3b49616321 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:49.240941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa005b-1abb-417d-864b-8b3b49616321 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:49.241851 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa005b-1abb-417d-864b-8b3b49616321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:49.242160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa005b-1abb-417d-864b-8b3b49616321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:49.244243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa005b-1abb-417d-864b-8b3b49616321 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:49.249587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:49.260588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 321/654] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:49.260787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa005b-1abb-417d-864b-8b3b49616321 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:49.336253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1843de-79e7-469b-ae7d-df33cd6c80ce None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:49.369396 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:49.384174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889dcd4-6459-46aa-9b0a-1277b110cf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:49.385029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889dcd4-6459-46aa-9b0a-1277b110cf2e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:49.385465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889dcd4-6459-46aa-9b0a-1277b110cf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:49.385877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889dcd4-6459-46aa-9b0a-1277b110cf2e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:49.394230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889dcd4-6459-46aa-9b0a-1277b110cf2e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:49.394389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa005b-1abb-417d-864b-8b3b49616321 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:49.395984 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889dcd4-6459-46aa-9b0a-1277b110cf2e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-1889dcd4-6459-46aa-9b0a-1277b110cf2e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:49.410886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:49.412012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:49.413072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:49.413072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:49.413072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:49.413072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:49.413072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:49.413072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:49.413072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:49.413072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:49.413072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 06:11:49.413072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:49.415308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 334/655] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:49.416381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889dcd4-6459-46aa-9b0a-1277b110cf2e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:49.439438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791aafb2-b3eb-4b4d-98c4-4155ae2f3817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:49.440221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791aafb2-b3eb-4b4d-98c4-4155ae2f3817 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:49.440570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791aafb2-b3eb-4b4d-98c4-4155ae2f3817 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:49.440918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791aafb2-b3eb-4b4d-98c4-4155ae2f3817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:49.519591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791aafb2-b3eb-4b4d-98c4-4155ae2f3817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:49.521296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791aafb2-b3eb-4b4d-98c4-4155ae2f3817 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:49.531521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:49.544506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889dcd4-6459-46aa-9b0a-1277b110cf2e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:49.580803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb1e66-c2a4-47bc-b7e1-fdb9d7c64a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:49.581760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb1e66-c2a4-47bc-b7e1-fdb9d7c64a2a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:49.582214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb1e66-c2a4-47bc-b7e1-fdb9d7c64a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:49.582683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb1e66-c2a4-47bc-b7e1-fdb9d7c64a2a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:49.591095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb1e66-c2a4-47bc-b7e1-fdb9d7c64a2a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:49.593373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb1e66-c2a4-47bc-b7e1-fdb9d7c64a2a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-ddfb1e66-c2a4-47bc-b7e1-fdb9d7c64a2a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:49.605684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:49.606678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:49.607624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:49.607624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:49.607624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:49.607624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:49.607624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:49.607624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:49.607624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:49.607624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:49.607624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 18 06:11:49.607624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:49.610333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 335/656] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:49.611348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb1e66-c2a4-47bc-b7e1-fdb9d7c64a2a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:49.630503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:49.653472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 322/657] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:49.654584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791aafb2-b3eb-4b4d-98c4-4155ae2f3817 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:49.756919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb1e66-c2a4-47bc-b7e1-fdb9d7c64a2a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:49.776544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791aafb2-b3eb-4b4d-98c4-4155ae2f3817 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:49.806196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cbd94-1904-4ffd-9e66-c6c65c3e4357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:49.807411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cbd94-1904-4ffd-9e66-c6c65c3e4357 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:49.808343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cbd94-1904-4ffd-9e66-c6c65c3e4357 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:49.809045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cbd94-1904-4ffd-9e66-c6c65c3e4357 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:49.810180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cbd94-1904-4ffd-9e66-c6c65c3e4357 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:49.811101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cbd94-1904-4ffd-9e66-c6c65c3e4357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:49.813384 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cbd94-1904-4ffd-9e66-c6c65c3e4357 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:49.815779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d008e-b2d6-41b0-b12c-72f8a6a1d982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:49.817320 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d008e-b2d6-41b0-b12c-72f8a6a1d982 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:49.817613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d008e-b2d6-41b0-b12c-72f8a6a1d982 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:49.817890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d008e-b2d6-41b0-b12c-72f8a6a1d982 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:49.818609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d008e-b2d6-41b0-b12c-72f8a6a1d982 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:49.818914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d008e-b2d6-41b0-b12c-72f8a6a1d982 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:49.820359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d008e-b2d6-41b0-b12c-72f8a6a1d982 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:49.847976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 336/658] 10.222.0.16 () {56 vars in 1139 bytes} [Sun Sep 18 06:11:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:49.847976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cbd94-1904-4ffd-9e66-c6c65c3e4357 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:49.849916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 323/659] 10.222.0.16 () {56 vars in 1137 bytes} [Sun Sep 18 06:11:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:49.852445 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d008e-b2d6-41b0-b12c-72f8a6a1d982 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:49.869159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:49.909932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:49.979444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d008e-b2d6-41b0-b12c-72f8a6a1d982 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:49.993411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cbd94-1904-4ffd-9e66-c6c65c3e4357 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:50.017068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e03e74-e06d-4615-88e8-1a1cb0a77ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:50.017753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e03e74-e06d-4615-88e8-1a1cb0a77ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:50.017950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e03e74-e06d-4615-88e8-1a1cb0a77ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:50.018218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e03e74-e06d-4615-88e8-1a1cb0a77ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:50.034116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca864a-5177-4107-97e9-72beb1db2aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:50.034850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca864a-5177-4107-97e9-72beb1db2aea None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:50.035129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca864a-5177-4107-97e9-72beb1db2aea None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:50.035398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca864a-5177-4107-97e9-72beb1db2aea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:50.045236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca864a-5177-4107-97e9-72beb1db2aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:50.047077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca864a-5177-4107-97e9-72beb1db2aea None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-cdca864a-5177-4107-97e9-72beb1db2aea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:50.062649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:50.063791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:50.064758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:50.064758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:50.064758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:50.064758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 337/660] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:50.064995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca864a-5177-4107-97e9-72beb1db2aea None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:50.093944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e03e74-e06d-4615-88e8-1a1cb0a77ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:50.095386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e03e74-e06d-4615-88e8-1a1cb0a77ed0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:50.127688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:50.141163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:50.168400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca864a-5177-4107-97e9-72beb1db2aea None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:50.204721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a44664-e4a9-471e-8d0c-dd70addeae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:50.205327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a44664-e4a9-471e-8d0c-dd70addeae9d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:50.205607 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a44664-e4a9-471e-8d0c-dd70addeae9d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:50.205882 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a44664-e4a9-471e-8d0c-dd70addeae9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:50.207174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 324/661] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:50.208679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3869f-1c79-4691-a1b3-421d0ebb531d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:50.209029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3869f-1c79-4691-a1b3-421d0ebb531d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:50.209374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3869f-1c79-4691-a1b3-421d0ebb531d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:50.210803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 325/662] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:50.215455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3869f-1c79-4691-a1b3-421d0ebb531d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:50.282837 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a44664-e4a9-471e-8d0c-dd70addeae9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:50.284319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a44664-e4a9-471e-8d0c-dd70addeae9d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:50.319730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3869f-1c79-4691-a1b3-421d0ebb531d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:50.349125 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:50.356323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783576e-a2dd-4f3f-a381-b14fe3b39da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:50.356954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783576e-a2dd-4f3f-a381-b14fe3b39da0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:50.357234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783576e-a2dd-4f3f-a381-b14fe3b39da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:50.357504 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783576e-a2dd-4f3f-a381-b14fe3b39da0 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:50.358141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783576e-a2dd-4f3f-a381-b14fe3b39da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:50.358532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783576e-a2dd-4f3f-a381-b14fe3b39da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:50.359988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783576e-a2dd-4f3f-a381-b14fe3b39da0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:50.368138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:50.371766 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 326/663] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:50.372670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783576e-a2dd-4f3f-a381-b14fe3b39da0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:50.403100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 338/664] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:50.404488 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1ec17-1d99-4c63-b5fa-3e5128f78ce3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:50.404841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1ec17-1d99-4c63-b5fa-3e5128f78ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:50.405446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1ec17-1d99-4c63-b5fa-3e5128f78ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:50.423051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1ff1ec17-1d99-4c63-b5fa-3e5128f78ce3 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:50.424201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1ff1ec17-1d99-4c63-b5fa-3e5128f78ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:50.490992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783576e-a2dd-4f3f-a381-b14fe3b39da0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:50.504310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 339/665] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:50.506085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1ec17-1d99-4c63-b5fa-3e5128f78ce3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:50.529747 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b79a9c-b7cf-40fe-a6e6-0e17285ead7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:50.530652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b79a9c-b7cf-40fe-a6e6-0e17285ead7c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:50.531162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b79a9c-b7cf-40fe-a6e6-0e17285ead7c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:50.531603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b79a9c-b7cf-40fe-a6e6-0e17285ead7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:50.545625 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b79a9c-b7cf-40fe-a6e6-0e17285ead7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:50.547704 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b79a9c-b7cf-40fe-a6e6-0e17285ead7c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-12b79a9c-b7cf-40fe-a6e6-0e17285ead7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:50.564326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:50.565283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:50.566186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:50.566186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:50.566186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:50.566186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 327/666] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:50.566843 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b79a9c-b7cf-40fe-a6e6-0e17285ead7c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:50.630001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:50.634412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:50.645277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1ec17-1d99-4c63-b5fa-3e5128f78ce3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:50.692489 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2532c1-207a-4dfa-a3fb-9c933fdcc957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:50.693976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2532c1-207a-4dfa-a3fb-9c933fdcc957 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:50.694436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2532c1-207a-4dfa-a3fb-9c933fdcc957 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:50.694885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2532c1-207a-4dfa-a3fb-9c933fdcc957 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:50.696157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b79a9c-b7cf-40fe-a6e6-0e17285ead7c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:50.703738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2532c1-207a-4dfa-a3fb-9c933fdcc957 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:50.705864 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2532c1-207a-4dfa-a3fb-9c933fdcc957 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-fe2532c1-207a-4dfa-a3fb-9c933fdcc957 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:50.723345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:50.724286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:50.725156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:50.725156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:50.725156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:50.725156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:50.725156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:50.725156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:50.725156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:50.725156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:50.726358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 340/667] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:50.726358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2532c1-207a-4dfa-a3fb-9c933fdcc957 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:50.736259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e033a9c-e0e3-4538-bfdc-e57bf7eab015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:50.737170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e033a9c-e0e3-4538-bfdc-e57bf7eab015 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:50.737170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e033a9c-e0e3-4538-bfdc-e57bf7eab015 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:50.737458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e033a9c-e0e3-4538-bfdc-e57bf7eab015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:50.748650 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e033a9c-e0e3-4538-bfdc-e57bf7eab015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:50.750745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e033a9c-e0e3-4538-bfdc-e57bf7eab015 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8e033a9c-e0e3-4538-bfdc-e57bf7eab015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:50.766574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:50.767510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:50.769011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:50.769011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:50.769011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:50.769011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 328/668] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:50.769011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e033a9c-e0e3-4538-bfdc-e57bf7eab015 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:50.847716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2532c1-207a-4dfa-a3fb-9c933fdcc957 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:50.881771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e033a9c-e0e3-4538-bfdc-e57bf7eab015 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:50.883859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af14d60-eb50-47d2-a862-d3d739af2d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:50.884490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af14d60-eb50-47d2-a862-d3d739af2d18 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:50.884761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af14d60-eb50-47d2-a862-d3d739af2d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:50.885029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af14d60-eb50-47d2-a862-d3d739af2d18 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:50.885129 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:50.885678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af14d60-eb50-47d2-a862-d3d739af2d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:50.885961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af14d60-eb50-47d2-a862-d3d739af2d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:50.887354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af14d60-eb50-47d2-a862-d3d739af2d18 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:50.899131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 341/669] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:50.899958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af14d60-eb50-47d2-a862-d3d739af2d18 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:50.916324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:50.930068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878f817-d85d-49ff-b736-1d498a58a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:50.930677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f817-d85d-49ff-b736-1d498a58a75a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:50.930958 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f817-d85d-49ff-b736-1d498a58a75a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:50.931233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f817-d85d-49ff-b736-1d498a58a75a None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:50.931983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878f817-d85d-49ff-b736-1d498a58a75a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:50.932385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878f817-d85d-49ff-b736-1d498a58a75a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:50.933719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878f817-d85d-49ff-b736-1d498a58a75a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:50.951130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 329/670] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:50.951130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878f817-d85d-49ff-b736-1d498a58a75a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:51.010131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af14d60-eb50-47d2-a862-d3d739af2d18 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:51.048049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af6e6b-ecea-429e-a41e-099b474be5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:51.048666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af6e6b-ecea-429e-a41e-099b474be5aa None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.048945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af6e6b-ecea-429e-a41e-099b474be5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.049221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af6e6b-ecea-429e-a41e-099b474be5aa None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.049861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af6e6b-ecea-429e-a41e-099b474be5aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:51.050167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af6e6b-ecea-429e-a41e-099b474be5aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:51.051539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af6e6b-ecea-429e-a41e-099b474be5aa None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:51.053426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878f817-d85d-49ff-b736-1d498a58a75a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:51.068449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 342/671] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:51.068449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af6e6b-ecea-429e-a41e-099b474be5aa None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:51.094150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321f728-d1ef-44ce-bef6-565e26a9982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:51.094777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321f728-d1ef-44ce-bef6-565e26a9982a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.095123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321f728-d1ef-44ce-bef6-565e26a9982a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.095367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321f728-d1ef-44ce-bef6-565e26a9982a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.106611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321f728-d1ef-44ce-bef6-565e26a9982a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9321f728-d1ef-44ce-bef6-565e26a9982a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:51.112180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:51.113109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:11:51.113983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:51.114699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 330/672] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:11:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:51.115266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321f728-d1ef-44ce-bef6-565e26a9982a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:51.145683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:51.146311 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:51.177261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af6e6b-ecea-429e-a41e-099b474be5aa None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:51.215418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1bf98-ec56-43bd-8e74-1dceb90ff1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:51.215997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bf98-ec56-43bd-8e74-1dceb90ff1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.216280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bf98-ec56-43bd-8e74-1dceb90ff1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.216546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bf98-ec56-43bd-8e74-1dceb90ff1c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.223495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1bf98-ec56-43bd-8e74-1dceb90ff1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:51.225004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1bf98-ec56-43bd-8e74-1dceb90ff1c8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:51.228963 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321f728-d1ef-44ce-bef6-565e26a9982a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-91b1bf98-ec56-43bd-8e74-1dceb90ff1c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:51.236732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:51.237646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:51.238555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:51.238555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:51.238555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:51.238555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:51.238555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:51.238555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:51.238555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:51.238555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:51.238555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 343/673] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:51.238555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1bf98-ec56-43bd-8e74-1dceb90ff1c8 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:51.269728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d8c6-cfe1-405f-a225-68747ac30a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:51.270331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d8c6-cfe1-405f-a225-68747ac30a4d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.270602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d8c6-cfe1-405f-a225-68747ac30a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.270867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d8c6-cfe1-405f-a225-68747ac30a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.271575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1d8c6-cfe1-405f-a225-68747ac30a4d None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=1bb483203d3b4210a53a317443206d35) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:51.271879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1d8c6-cfe1-405f-a225-68747ac30a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:51.273443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1d8c6-cfe1-405f-a225-68747ac30a4d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:51.284250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 331/674] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:51 2022] GET /identity/v3/role_assignments?user.id=1bb483203d3b4210a53a317443206d35&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:51.285533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d8c6-cfe1-405f-a225-68747ac30a4d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:51.368576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1bf98-ec56-43bd-8e74-1dceb90ff1c8 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:51.404916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:51.414180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:51.421578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527546c9-52a2-4730-85f4-d1eec78ab0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:51.423325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527546c9-52a2-4730-85f4-d1eec78ab0ba None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.423933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527546c9-52a2-4730-85f4-d1eec78ab0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.424400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527546c9-52a2-4730-85f4-d1eec78ab0ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.425611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d8c6-cfe1-405f-a225-68747ac30a4d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:51.437703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527546c9-52a2-4730-85f4-d1eec78ab0ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:51.440072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527546c9-52a2-4730-85f4-d1eec78ab0ba None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-527546c9-52a2-4730-85f4-d1eec78ab0ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:51.452564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:51.453582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:51.454499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:51.454499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:51.454499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:51.454499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:51.454499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:51.454499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:51.454499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:51.454499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:51.454499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 344/675] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:51.454499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527546c9-52a2-4730-85f4-d1eec78ab0ba None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:51.473921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c73d79-d915-45b0-9e56-f0bf92210358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:51.474455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c73d79-d915-45b0-9e56-f0bf92210358 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.474735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c73d79-d915-45b0-9e56-f0bf92210358 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.475010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c73d79-d915-45b0-9e56-f0bf92210358 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.475680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c73d79-d915-45b0-9e56-f0bf92210358 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:51.476013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c73d79-d915-45b0-9e56-f0bf92210358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:51.477394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c73d79-d915-45b0-9e56-f0bf92210358 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:51.487159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 332/676] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:11:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:51.487581 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b51b04-53ff-4a6a-a909-edb6a32ffcb9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.488594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b51b04-53ff-4a6a-a909-edb6a32ffcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.488594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b51b04-53ff-4a6a-a909-edb6a32ffcb9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.493488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 333/677] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:51.494271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b51b04-53ff-4a6a-a909-edb6a32ffcb9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:51.578990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527546c9-52a2-4730-85f4-d1eec78ab0ba None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:51.606214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b51b04-53ff-4a6a-a909-edb6a32ffcb9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:51.619541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf3bdc-cbf1-43f7-878c-57765a258414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:51.620551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf3bdc-cbf1-43f7-878c-57765a258414 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.621087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf3bdc-cbf1-43f7-878c-57765a258414 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.621364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf3bdc-cbf1-43f7-878c-57765a258414 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.622182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf3bdc-cbf1-43f7-878c-57765a258414 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:51.622495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf3bdc-cbf1-43f7-878c-57765a258414 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:51.625179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf3bdc-cbf1-43f7-878c-57765a258414 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:51.640768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e526f8-9249-4398-a24c-ebc878d48d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:51.646194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e526f8-9249-4398-a24c-ebc878d48d36 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.646325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 345/678] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:51.646419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e526f8-9249-4398-a24c-ebc878d48d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.646419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e526f8-9249-4398-a24c-ebc878d48d36 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.646597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf3bdc-cbf1-43f7-878c-57765a258414 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:51.646699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e526f8-9249-4398-a24c-ebc878d48d36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:51.646699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e526f8-9249-4398-a24c-ebc878d48d36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:51.646699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e526f8-9249-4398-a24c-ebc878d48d36 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:51.658074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 334/679] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:51.660030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a93d0-f211-4c81-94a1-166b6efbbd39 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.660613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a93d0-f211-4c81-94a1-166b6efbbd39 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.661059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a93d0-f211-4c81-94a1-166b6efbbd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.683761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-615a93d0-f211-4c81-94a1-166b6efbbd39 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:51.684969 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-615a93d0-f211-4c81-94a1-166b6efbbd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:51.688790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:51.704930 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:51.760732 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 335/680] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:51.761491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a93d0-f211-4c81-94a1-166b6efbbd39 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:51.762310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf3bdc-cbf1-43f7-878c-57765a258414 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:51.819729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e1f62-2f2a-48dc-a2d2-2ff9720a33be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:51.820479 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e1f62-2f2a-48dc-a2d2-2ff9720a33be None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.820838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e1f62-2f2a-48dc-a2d2-2ff9720a33be None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.821170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e1f62-2f2a-48dc-a2d2-2ff9720a33be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.841144 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e1f62-2f2a-48dc-a2d2-2ff9720a33be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:51.843267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e1f62-2f2a-48dc-a2d2-2ff9720a33be None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0f7e1f62-2f2a-48dc-a2d2-2ff9720a33be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:51.859987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:51.861184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:51.862345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:51.862345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:51.862345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:51.867134 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 346/681] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:51.867134 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e1f62-2f2a-48dc-a2d2-2ff9720a33be None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:51.902968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a93d0-f211-4c81-94a1-166b6efbbd39 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:51.949351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53028cef-c7f3-487c-83aa-9dd7eec3b578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:51.950672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53028cef-c7f3-487c-83aa-9dd7eec3b578 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:51.951105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53028cef-c7f3-487c-83aa-9dd7eec3b578 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:51.951964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53028cef-c7f3-487c-83aa-9dd7eec3b578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:51.953759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53028cef-c7f3-487c-83aa-9dd7eec3b578 None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=1d78e909fc894ddd9b35ead5fe68b898) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:51.954225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53028cef-c7f3-487c-83aa-9dd7eec3b578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:51.956603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53028cef-c7f3-487c-83aa-9dd7eec3b578 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:51.969284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 336/682] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:51 2022] GET /identity/v3/role_assignments?user.id=1d78e909fc894ddd9b35ead5fe68b898&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:51.969284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53028cef-c7f3-487c-83aa-9dd7eec3b578 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:51.977980 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:51.988643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e1f62-2f2a-48dc-a2d2-2ff9720a33be None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:52.002783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:52.053836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99799d93-e320-4d22-b7b3-1da38e76eaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:52.054375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99799d93-e320-4d22-b7b3-1da38e76eaca None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:52.055048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99799d93-e320-4d22-b7b3-1da38e76eaca None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:52.055334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99799d93-e320-4d22-b7b3-1da38e76eaca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:52.056468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99799d93-e320-4d22-b7b3-1da38e76eaca None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=03c498b5857f42f2ab84423f8f4ea11a) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:52.056785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99799d93-e320-4d22-b7b3-1da38e76eaca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:52.058565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99799d93-e320-4d22-b7b3-1da38e76eaca None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:52.067872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 347/683] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:51 2022] GET /identity/v3/role_assignments?user.id=03c498b5857f42f2ab84423f8f4ea11a&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:52.068857 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99799d93-e320-4d22-b7b3-1da38e76eaca None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:52.183144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53028cef-c7f3-487c-83aa-9dd7eec3b578 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:52.224701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b95503-be5f-4f92-90d1-5db4522192af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:52.224914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b95503-be5f-4f92-90d1-5db4522192af None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:52.225225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b95503-be5f-4f92-90d1-5db4522192af None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:52.225389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b95503-be5f-4f92-90d1-5db4522192af None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:52.226033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b95503-be5f-4f92-90d1-5db4522192af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:52.226335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b95503-be5f-4f92-90d1-5db4522192af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:52.227772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b95503-be5f-4f92-90d1-5db4522192af None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:52.243476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 337/684] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:52.251085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b95503-be5f-4f92-90d1-5db4522192af None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:52.273201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99799d93-e320-4d22-b7b3-1da38e76eaca None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:52.317960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc631ab-e05b-4894-8345-8659994876a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:52.318939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc631ab-e05b-4894-8345-8659994876a9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:52.319439 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc631ab-e05b-4894-8345-8659994876a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:52.319950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc631ab-e05b-4894-8345-8659994876a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:52.332025 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:52.335026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc631ab-e05b-4894-8345-8659994876a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6dc631ab-e05b-4894-8345-8659994876a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:52.341928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:52.342992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:52.344061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:52.346814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 348/685] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:11:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:52.353987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc631ab-e05b-4894-8345-8659994876a9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:52.384489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b95503-be5f-4f92-90d1-5db4522192af None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:52.392062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:52.426090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e4ee-9fb6-48c4-a1cf-1e761b89210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:52.426443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e4ee-9fb6-48c4-a1cf-1e761b89210c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:52.426646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e4ee-9fb6-48c4-a1cf-1e761b89210c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:52.426943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e4ee-9fb6-48c4-a1cf-1e761b89210c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:52.434522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421e4ee-9fb6-48c4-a1cf-1e761b89210c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:52.435969 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421e4ee-9fb6-48c4-a1cf-1e761b89210c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d421e4ee-9fb6-48c4-a1cf-1e761b89210c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:52.448726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:52.449689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:52.451286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:52.451286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:52.451286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:52.451286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:52.451286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:52.451286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:52.451286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:52.451286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:52.451286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:11:52.451286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:52.451286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 338/686] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:11:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:52.456426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e4ee-9fb6-48c4-a1cf-1e761b89210c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:52.499702 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc631ab-e05b-4894-8345-8659994876a9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:52.548267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a212a2-5491-4d68-9439-bc21988c46d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:52.549229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a212a2-5491-4d68-9439-bc21988c46d2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:52.549738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a212a2-5491-4d68-9439-bc21988c46d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:52.550622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a212a2-5491-4d68-9439-bc21988c46d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:52.551772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a212a2-5491-4d68-9439-bc21988c46d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:52.552328 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a212a2-5491-4d68-9439-bc21988c46d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:52.554761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a212a2-5491-4d68-9439-bc21988c46d2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:52.566939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 349/687] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:52.572508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a212a2-5491-4d68-9439-bc21988c46d2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:52.578271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e4ee-9fb6-48c4-a1cf-1e761b89210c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:52.629338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:52.665196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff1c88-7eba-4e81-8d6c-c2676fccc358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:52.665815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff1c88-7eba-4e81-8d6c-c2676fccc358 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:52.666095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff1c88-7eba-4e81-8d6c-c2676fccc358 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:52.666375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff1c88-7eba-4e81-8d6c-c2676fccc358 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:52.667109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff1c88-7eba-4e81-8d6c-c2676fccc358 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:52.667421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff1c88-7eba-4e81-8d6c-c2676fccc358 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:52.668883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff1c88-7eba-4e81-8d6c-c2676fccc358 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:52.677395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:52.685575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a212a2-5491-4d68-9439-bc21988c46d2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:52.714599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 339/688] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 18 06:11:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:52.720287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff1c88-7eba-4e81-8d6c-c2676fccc358 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:52.751520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d0a1c-b3a2-4cfd-9c8d-ed7acf36833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:52.752177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0a1c-b3a2-4cfd-9c8d-ed7acf36833a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:52.752451 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0a1c-b3a2-4cfd-9c8d-ed7acf36833a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:52.752719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d0a1c-b3a2-4cfd-9c8d-ed7acf36833a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:52.768162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d0a1c-b3a2-4cfd-9c8d-ed7acf36833a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:52.770570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d0a1c-b3a2-4cfd-9c8d-ed7acf36833a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-fd2d0a1c-b3a2-4cfd-9c8d-ed7acf36833a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:52.796606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:52.797742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:52.799233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:52.799233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:52.799233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:52.799233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 350/689] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:52.805289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d0a1c-b3a2-4cfd-9c8d-ed7acf36833a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:52.879201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff1c88-7eba-4e81-8d6c-c2676fccc358 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:52.934824 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39c2f8-143b-49ef-bedc-282dc82e3782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:52.935589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39c2f8-143b-49ef-bedc-282dc82e3782 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:52.935870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39c2f8-143b-49ef-bedc-282dc82e3782 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:52.940113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39c2f8-143b-49ef-bedc-282dc82e3782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:53.003381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:53.027682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39c2f8-143b-49ef-bedc-282dc82e3782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:53.029868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39c2f8-143b-49ef-bedc-282dc82e3782 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:53.035651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d0a1c-b3a2-4cfd-9c8d-ed7acf36833a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:53.097151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a5f06-b735-4ead-835e-fe88923f4c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:53.097746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a5f06-b735-4ead-835e-fe88923f4c47 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:53.098111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a5f06-b735-4ead-835e-fe88923f4c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:53.098387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a5f06-b735-4ead-835e-fe88923f4c47 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:53.099033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a5f06-b735-4ead-835e-fe88923f4c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:53.099334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a5f06-b735-4ead-835e-fe88923f4c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:53.100758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a5f06-b735-4ead-835e-fe88923f4c47 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:53.117486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 351/690] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:53.122791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a5f06-b735-4ead-835e-fe88923f4c47 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:53.135655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:53.220171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 340/691] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 18 06:11:53.226668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39c2f8-143b-49ef-bedc-282dc82e3782 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:53.307277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a5f06-b735-4ead-835e-fe88923f4c47 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:53.361935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091b13-d0e7-4ba5-8ab2-df1d01b413a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:53.362760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091b13-d0e7-4ba5-8ab2-df1d01b413a4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:53.363056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091b13-d0e7-4ba5-8ab2-df1d01b413a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:53.363315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091b13-d0e7-4ba5-8ab2-df1d01b413a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:53.376865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e091b13-d0e7-4ba5-8ab2-df1d01b413a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:53.378325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e091b13-d0e7-4ba5-8ab2-df1d01b413a4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:53.379705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7e091b13-d0e7-4ba5-8ab2-df1d01b413a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:53.400050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:53.401434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:53.402401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:53.402401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:53.402401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:53.402401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:53.402401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:53.402401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:53.402401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:53.402401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:53.402401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:11:53.402401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:53.406590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 352/692] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 18 06:11:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:53.413793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091b13-d0e7-4ba5-8ab2-df1d01b413a4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:53.426101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39c2f8-143b-49ef-bedc-282dc82e3782 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:53.500105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379be27-5847-4531-bec7-b24d85c8896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:53.500736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379be27-5847-4531-bec7-b24d85c8896c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:53.501010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379be27-5847-4531-bec7-b24d85c8896c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:53.501280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379be27-5847-4531-bec7-b24d85c8896c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:53.523866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379be27-5847-4531-bec7-b24d85c8896c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:53.525601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379be27-5847-4531-bec7-b24d85c8896c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:53.548424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e379be27-5847-4531-bec7-b24d85c8896c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:53.556371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:53.557421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:53.558314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:53.558314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:53.558314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:53.558314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 341/693] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:53.564116 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379be27-5847-4531-bec7-b24d85c8896c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:53.618827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091b13-d0e7-4ba5-8ab2-df1d01b413a4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:53.668323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fc3f7-ee93-4fcc-b803-1b297e61e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:53.669091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fc3f7-ee93-4fcc-b803-1b297e61e42a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:53.669695 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fc3f7-ee93-4fcc-b803-1b297e61e42a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:53.669972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fc3f7-ee93-4fcc-b803-1b297e61e42a None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:53.671774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fc3f7-ee93-4fcc-b803-1b297e61e42a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:53.672286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fc3f7-ee93-4fcc-b803-1b297e61e42a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:53.674374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fc3f7-ee93-4fcc-b803-1b297e61e42a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:53.697527 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 353/694] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 18 06:11:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:53.698848 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbfb34-a933-41b5-b156-219ae08bcc46 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:53.699131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbfb34-a933-41b5-b156-219ae08bcc46 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:53.699411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbfb34-a933-41b5-b156-219ae08bcc46 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:53.705423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 354/695] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:53.706240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbfb34-a933-41b5-b156-219ae08bcc46 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:53.718897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379be27-5847-4531-bec7-b24d85c8896c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:53.762243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c507dc-ceb3-4ea0-85c3-3568d10e9644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:53.762858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c507dc-ceb3-4ea0-85c3-3568d10e9644 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:53.763138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c507dc-ceb3-4ea0-85c3-3568d10e9644 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:53.763682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c507dc-ceb3-4ea0-85c3-3568d10e9644 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:53.765440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c507dc-ceb3-4ea0-85c3-3568d10e9644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:53.765764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c507dc-ceb3-4ea0-85c3-3568d10e9644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:53.767145 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c507dc-ceb3-4ea0-85c3-3568d10e9644 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:53.776609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:53.783023 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 342/696] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:53.784338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a5d96-7f51-4613-8344-2273a089c3c2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:53.784630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a5d96-7f51-4613-8344-2273a089c3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:53.784906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a5d96-7f51-4613-8344-2273a089c3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:53.805098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fb2a5d96-7f51-4613-8344-2273a089c3c2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:53.806306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fb2a5d96-7f51-4613-8344-2273a089c3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:53.829371 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbfb34-a933-41b5-b156-219ae08bcc46 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:53.852332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:53.868816 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e5b47-efc2-4cde-9eaf-8399b9b19e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:53.869691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e5b47-efc2-4cde-9eaf-8399b9b19e6f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:53.870129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e5b47-efc2-4cde-9eaf-8399b9b19e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:53.870579 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e5b47-efc2-4cde-9eaf-8399b9b19e6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:53.883702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 343/697] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:53.884696 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a5d96-7f51-4613-8344-2273a089c3c2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:53.948715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e5b47-efc2-4cde-9eaf-8399b9b19e6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:53.950517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e5b47-efc2-4cde-9eaf-8399b9b19e6f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:53.995661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a5d96-7f51-4613-8344-2273a089c3c2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:54.045100 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:54.064524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76893f18-9989-4c1d-a78f-c30d59ce9313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:54.065156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76893f18-9989-4c1d-a78f-c30d59ce9313 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:54.065434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76893f18-9989-4c1d-a78f-c30d59ce9313 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:54.065706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76893f18-9989-4c1d-a78f-c30d59ce9313 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:54.079451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76893f18-9989-4c1d-a78f-c30d59ce9313 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:54.080933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76893f18-9989-4c1d-a78f-c30d59ce9313 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-76893f18-9989-4c1d-a78f-c30d59ce9313 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:54.101412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:54.102500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:54.103394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:54.103394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:54.103394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:54.103394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:54.103394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:54.103394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:54.103394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:54.103394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:54.103394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 344/698] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:54.109378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76893f18-9989-4c1d-a78f-c30d59ce9313 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:54.118785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 355/699] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:54.125431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e5b47-efc2-4cde-9eaf-8399b9b19e6f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:54.149512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:54.278065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e5b47-efc2-4cde-9eaf-8399b9b19e6f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:54.283555 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76893f18-9989-4c1d-a78f-c30d59ce9313 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:54.322466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a9455-9614-4760-a496-d96f98bf6a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:54.323216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a9455-9614-4760-a496-d96f98bf6a96 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:54.323600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a9455-9614-4760-a496-d96f98bf6a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:54.324065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a9455-9614-4760-a496-d96f98bf6a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:54.326676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d7b4-dbed-4182-b89d-d920ca8e82b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:54.328237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d7b4-dbed-4182-b89d-d920ca8e82b8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:54.328515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d7b4-dbed-4182-b89d-d920ca8e82b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:54.328787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d7b4-dbed-4182-b89d-d920ca8e82b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:54.329482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068d7b4-dbed-4182-b89d-d920ca8e82b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:54.329785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068d7b4-dbed-4182-b89d-d920ca8e82b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:54.331228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068d7b4-dbed-4182-b89d-d920ca8e82b8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:54.336583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a9455-9614-4760-a496-d96f98bf6a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:54.338264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a9455-9614-4760-a496-d96f98bf6a96 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:54.348065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 345/700] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:54.349018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d7b4-dbed-4182-b89d-d920ca8e82b8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-801a9455-9614-4760-a496-d96f98bf6a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:54.365404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:54.366399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:54.367297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:54.367297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:54.367297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:54.367297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 356/701] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:54.367958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a9455-9614-4760-a496-d96f98bf6a96 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:54.406518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:54.466435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:54.469059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d7b4-dbed-4182-b89d-d920ca8e82b8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:54.505795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a9455-9614-4760-a496-d96f98bf6a96 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:54.512703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e728018-b6c5-499b-b079-75fb04478941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:54.514049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e728018-b6c5-499b-b079-75fb04478941 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:54.515189 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e728018-b6c5-499b-b079-75fb04478941 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:54.515678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e728018-b6c5-499b-b079-75fb04478941 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:54.516951 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e728018-b6c5-499b-b079-75fb04478941 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:54.519488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e728018-b6c5-499b-b079-75fb04478941 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7e728018-b6c5-499b-b079-75fb04478941 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:54.536413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:54.537779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 06:11:54.538833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:54.546372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 346/702] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 18 06:11:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:54.546372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e728018-b6c5-499b-b079-75fb04478941 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:54.556587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8055b-71b3-47cd-8272-d23affc5cd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:54.557490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8055b-71b3-47cd-8272-d23affc5cd1c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:54.557959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8055b-71b3-47cd-8272-d23affc5cd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:54.558387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8055b-71b3-47cd-8272-d23affc5cd1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:54.559823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8055b-71b3-47cd-8272-d23affc5cd1c None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=3e0f04f474124698a46bed8dac01e30e) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:54.560346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8055b-71b3-47cd-8272-d23affc5cd1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:54.562825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8055b-71b3-47cd-8272-d23affc5cd1c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:54.576329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 357/703] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:54 2022] GET /identity/v3/role_assignments?user.id=3e0f04f474124698a46bed8dac01e30e&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:54.577319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8055b-71b3-47cd-8272-d23affc5cd1c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:54.708669 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e728018-b6c5-499b-b079-75fb04478941 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:54.720077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:54.750252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b8b89-50c2-464e-9fe9-f5b922658b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:54.751028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8b89-50c2-464e-9fe9-f5b922658b6e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:54.751442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8b89-50c2-464e-9fe9-f5b922658b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:54.751815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8b89-50c2-464e-9fe9-f5b922658b6e None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:54.752607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8b89-50c2-464e-9fe9-f5b922658b6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:54.753005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8b89-50c2-464e-9fe9-f5b922658b6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:54.753116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8055b-71b3-47cd-8272-d23affc5cd1c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:54.754591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8b89-50c2-464e-9fe9-f5b922658b6e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:54.769487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 347/704] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:54.771019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23663b7-adc5-4869-b7e2-05ea1107f165 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:54.771476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23663b7-adc5-4869-b7e2-05ea1107f165 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:54.771935 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23663b7-adc5-4869-b7e2-05ea1107f165 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:54.773797 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 348/705] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:54.775027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23663b7-adc5-4869-b7e2-05ea1107f165 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:54.811184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f2e67-66ec-49be-b5fa-6b57c2f8b57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:54.812342 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f2e67-66ec-49be-b5fa-6b57c2f8b57e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:54.812555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f2e67-66ec-49be-b5fa-6b57c2f8b57e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:54.812830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f2e67-66ec-49be-b5fa-6b57c2f8b57e None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:54.813601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f2e67-66ec-49be-b5fa-6b57c2f8b57e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:54.813919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f2e67-66ec-49be-b5fa-6b57c2f8b57e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:54.815949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f2e67-66ec-49be-b5fa-6b57c2f8b57e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:54.818080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:54.822102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 358/706] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 18 06:11:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:54.824137 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e71bea-6f8f-4bde-bffe-984ac255013f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:54.824459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e71bea-6f8f-4bde-bffe-984ac255013f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:54.824758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e71bea-6f8f-4bde-bffe-984ac255013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:54.852700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-82e71bea-6f8f-4bde-bffe-984ac255013f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:54.854291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-82e71bea-6f8f-4bde-bffe-984ac255013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:54.911105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23663b7-adc5-4869-b7e2-05ea1107f165 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:54.940576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 359/707] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:54.941715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e71bea-6f8f-4bde-bffe-984ac255013f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:54.961698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0075c7-0d95-443a-afe9-fcf8a5867e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:54.962723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0075c7-0d95-443a-afe9-fcf8a5867e17 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:54.963798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0075c7-0d95-443a-afe9-fcf8a5867e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:54.964307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0075c7-0d95-443a-afe9-fcf8a5867e17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:54.975250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0075c7-0d95-443a-afe9-fcf8a5867e17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:54.977281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0075c7-0d95-443a-afe9-fcf8a5867e17 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7c0075c7-0d95-443a-afe9-fcf8a5867e17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:11:54.993267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:54.994193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:54.995081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:11:54.995081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:11:54.995081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:11:54.995081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:11:54.995081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:11:54.995081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:11:54.995081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:11:54.995081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:54.997485 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 349/708] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:54.999135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d4d6c-9f77-4fdb-831a-4b981c9b320a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:54.999671 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d4d6c-9f77-4fdb-831a-4b981c9b320a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:55.000184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d4d6c-9f77-4fdb-831a-4b981c9b320a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:55.006514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 350/709] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:55.006514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d4d6c-9f77-4fdb-831a-4b981c9b320a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:55.045316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:55.059430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e71bea-6f8f-4bde-bffe-984ac255013f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:55.090284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:55.097524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5e2fb-2d02-49b2-ad79-49b4dfa08dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:55.098130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e2fb-2d02-49b2-ad79-49b4dfa08dff None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:55.098454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e2fb-2d02-49b2-ad79-49b4dfa08dff None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:55.098736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e2fb-2d02-49b2-ad79-49b4dfa08dff None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:55.099360 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5e2fb-2d02-49b2-ad79-49b4dfa08dff None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:55.099659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5e2fb-2d02-49b2-ad79-49b4dfa08dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:55.101154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5e2fb-2d02-49b2-ad79-49b4dfa08dff None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:55.107823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 360/710] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 18 06:11:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:55.109832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51e39d-058a-4f3b-8632-8ff353d58dd8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:55.110032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51e39d-058a-4f3b-8632-8ff353d58dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:55.110298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51e39d-058a-4f3b-8632-8ff353d58dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:55.130973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cd51e39d-058a-4f3b-8632-8ff353d58dd8 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:55.132485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cd51e39d-058a-4f3b-8632-8ff353d58dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:55.166128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d4d6c-9f77-4fdb-831a-4b981c9b320a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:55.234681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03ac2b-1f3d-4c0f-8258-d188f84530b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:55.235212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03ac2b-1f3d-4c0f-8258-d188f84530b9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:55.235760 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03ac2b-1f3d-4c0f-8258-d188f84530b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:55.236065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03ac2b-1f3d-4c0f-8258-d188f84530b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:55.237244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03ac2b-1f3d-4c0f-8258-d188f84530b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:55.237834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03ac2b-1f3d-4c0f-8258-d188f84530b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:55.239363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03ac2b-1f3d-4c0f-8258-d188f84530b9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:55.241469 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 361/711] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:55.242358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51e39d-058a-4f3b-8632-8ff353d58dd8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:55.253753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 351/712] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:55.261597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03ac2b-1f3d-4c0f-8258-d188f84530b9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:55.384231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51e39d-058a-4f3b-8632-8ff353d58dd8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:55.410725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:55.419827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:55.431568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03ac2b-1f3d-4c0f-8258-d188f84530b9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:55.437846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1581-30f6-4080-b467-3333101a2e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:55.438779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1581-30f6-4080-b467-3333101a2e34 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:55.439292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1581-30f6-4080-b467-3333101a2e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:55.440393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa1581-30f6-4080-b467-3333101a2e34 None admin] PATH_INFO: `/v3/services/network` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:55.441200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa1581-30f6-4080-b467-3333101a2e34 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:55.443289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa1581-30f6-4080-b467-3333101a2e34 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-69fa1581-30f6-4080-b467-3333101a2e34 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:55.459268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:55.460399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 06:11:55.461340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:55.466329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 362/713] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:11:55 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:55.471980 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1581-30f6-4080-b467-3333101a2e34 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:55.497169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfb053-7d66-413b-94fa-9c9e54749df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:55.497677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfb053-7d66-413b-94fa-9c9e54749df5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:55.497943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfb053-7d66-413b-94fa-9c9e54749df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:55.498285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfb053-7d66-413b-94fa-9c9e54749df5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:55.499682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfb053-7d66-413b-94fa-9c9e54749df5 None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=9b5585d29bcb4b03a1902fbf113f48e8) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:55.500052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfb053-7d66-413b-94fa-9c9e54749df5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:55.501945 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfb053-7d66-413b-94fa-9c9e54749df5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:55.511961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 352/714] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:11:55 2022] GET /identity/v3/role_assignments?user.id=9b5585d29bcb4b03a1902fbf113f48e8&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=4494ba66c3f649febc69511a47e27b67 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:55.581478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfb053-7d66-413b-94fa-9c9e54749df5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:55.657566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa1581-30f6-4080-b467-3333101a2e34 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:55.729775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a5397-f6d1-408e-ae13-0bf86cd19def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:55.730409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a5397-f6d1-408e-ae13-0bf86cd19def None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:55.730696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a5397-f6d1-408e-ae13-0bf86cd19def None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:55.730973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a5397-f6d1-408e-ae13-0bf86cd19def None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:55.731623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a5397-f6d1-408e-ae13-0bf86cd19def None admin] RBAC: Adding query filter params (name=network) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:55.732047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a5397-f6d1-408e-ae13-0bf86cd19def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:55.734041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a5397-f6d1-408e-ae13-0bf86cd19def None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:55.751420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfb053-7d66-413b-94fa-9c9e54749df5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:55.753941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 363/715] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:11:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:55.759379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a5397-f6d1-408e-ae13-0bf86cd19def None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:55.791644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53396-66f0-4c0f-b47b-7902c4c89c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:55.792692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53396-66f0-4c0f-b47b-7902c4c89c25 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:55.793230 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53396-66f0-4c0f-b47b-7902c4c89c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:55.793681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53396-66f0-4c0f-b47b-7902c4c89c25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:55.806508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad53396-66f0-4c0f-b47b-7902c4c89c25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:55.808385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad53396-66f0-4c0f-b47b-7902c4c89c25 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-cad53396-66f0-4c0f-b47b-7902c4c89c25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:55.825955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:55.827701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:55.828991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:55.828991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:55.828991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:55.835870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 353/716] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:55.837352 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53396-66f0-4c0f-b47b-7902c4c89c25 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:55.843334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:55.931185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:56.011080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53396-66f0-4c0f-b47b-7902c4c89c25 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:56.026678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a5397-f6d1-408e-ae13-0bf86cd19def None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:56.065692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b26447-5a2f-4d3f-b2af-6751d4ef548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:56.066699 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b26447-5a2f-4d3f-b2af-6751d4ef548e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:56.067158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b26447-5a2f-4d3f-b2af-6751d4ef548e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:56.067624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b26447-5a2f-4d3f-b2af-6751d4ef548e None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:56.068480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b26447-5a2f-4d3f-b2af-6751d4ef548e None admin] RBAC: Adding query filter params (type=network) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:56.068830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964e0c3-57da-4d03-af12-ef6f47aa8f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:56.069186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b26447-5a2f-4d3f-b2af-6751d4ef548e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:56.069556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e0c3-57da-4d03-af12-ef6f47aa8f4e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:56.069898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e0c3-57da-4d03-af12-ef6f47aa8f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:56.070254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e0c3-57da-4d03-af12-ef6f47aa8f4e None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:56.070960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964e0c3-57da-4d03-af12-ef6f47aa8f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:56.071321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964e0c3-57da-4d03-af12-ef6f47aa8f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:56.071685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b26447-5a2f-4d3f-b2af-6751d4ef548e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:56.072803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964e0c3-57da-4d03-af12-ef6f47aa8f4e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:56.084081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 364/717] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:11:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:56.103847 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 354/718] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:56.109861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b26447-5a2f-4d3f-b2af-6751d4ef548e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:56.269464 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b26447-5a2f-4d3f-b2af-6751d4ef548e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:56.290942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:56.315417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9d22d-166a-4ec0-bb2f-a54b496b9578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:56.316623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d22d-166a-4ec0-bb2f-a54b496b9578 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:56.317114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d22d-166a-4ec0-bb2f-a54b496b9578 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:56.317608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d22d-166a-4ec0-bb2f-a54b496b9578 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:56.318493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9d22d-166a-4ec0-bb2f-a54b496b9578 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:56.320224 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9d22d-166a-4ec0-bb2f-a54b496b9578 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:56.351638 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 365/719] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:11:56 2022] POST /identity/v3/users => generated 254 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:11:57.456656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ba66-ca4b-413f-8886-4c86b5f82a6d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:57.457182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ba66-ca4b-413f-8886-4c86b5f82a6d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:57.457182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ba66-ca4b-413f-8886-4c86b5f82a6d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:57.458849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 355/720] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:57.464857 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769abe1-307d-4808-b67a-d05ed52da3be None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:57.464857 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769abe1-307d-4808-b67a-d05ed52da3be None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:57.465334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769abe1-307d-4808-b67a-d05ed52da3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:57.484991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e769abe1-307d-4808-b67a-d05ed52da3be None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:57.486169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e769abe1-307d-4808-b67a-d05ed52da3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:57.577065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 366/721] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:57.917271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2ba66-ca4b-413f-8886-4c86b5f82a6d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:57.927471 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3e83-9e1f-4526-9640-59315d75d5c7 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:57.930201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3e83-9e1f-4526-9640-59315d75d5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:57.930748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac3e83-9e1f-4526-9640-59315d75d5c7 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:57.934925 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 367/722] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:57 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:57.940096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f47a7c-50af-46c4-b451-a973dd21f3a4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:57.940692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f47a7c-50af-46c4-b451-a973dd21f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:57.941177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f47a7c-50af-46c4-b451-a973dd21f3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:57.970071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f7f47a7c-50af-46c4-b451-a973dd21f3a4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:57.972321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f7f47a7c-50af-46c4-b451-a973dd21f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:58.034315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:58.093168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 368/723] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:58.105782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2ba66-ca4b-413f-8886-4c86b5f82a6d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:58.140752 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a2496-361e-4c93-8ad4-f90ae424a623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:58.141368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2496-361e-4c93-8ad4-f90ae424a623 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:58.141641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2496-361e-4c93-8ad4-f90ae424a623 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:58.142001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a2496-361e-4c93-8ad4-f90ae424a623 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:58.152108 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a2496-361e-4c93-8ad4-f90ae424a623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e90a2496-361e-4c93-8ad4-f90ae424a623 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:58.157781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:58.158710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:58.160205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 356/724] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:11:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:58.164673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f47a7c-50af-46c4-b451-a973dd21f3a4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:58.209589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0d9d-2d66-4e66-ba0e-cfdc71806ea7 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:58.209916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0d9d-2d66-4e66-ba0e-cfdc71806ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:58.210150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a0d9d-2d66-4e66-ba0e-cfdc71806ea7 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:58.211739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 357/725] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:11:58.214078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:58.216606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688aeb3-4b4c-4511-a60d-ddec96516004 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:58.216918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688aeb3-4b4c-4511-a60d-ddec96516004 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:58.217224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688aeb3-4b4c-4511-a60d-ddec96516004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:58.245563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4688aeb3-4b4c-4511-a60d-ddec96516004 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:58.246763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4688aeb3-4b4c-4511-a60d-ddec96516004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:58.329071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f47a7c-50af-46c4-b451-a973dd21f3a4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:58.368466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef62993-9e25-40d7-96b1-1465aeefcda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:58.369436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62993-9e25-40d7-96b1-1465aeefcda1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:58.370854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 358/726] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 06:11:58.371412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62993-9e25-40d7-96b1-1465aeefcda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:58.372007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62993-9e25-40d7-96b1-1465aeefcda1 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:58.372883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef62993-9e25-40d7-96b1-1465aeefcda1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:58.373929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef62993-9e25-40d7-96b1-1465aeefcda1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:58.375601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef62993-9e25-40d7-96b1-1465aeefcda1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:58.385314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 369/727] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:58.391182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688aeb3-4b4c-4511-a60d-ddec96516004 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:58.474689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:58.491102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef62993-9e25-40d7-96b1-1465aeefcda1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:58.527543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688aeb3-4b4c-4511-a60d-ddec96516004 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:58.562557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fca9fa-c03e-4abd-9c04-29d71da52358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:58.563194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fca9fa-c03e-4abd-9c04-29d71da52358 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:58.563466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fca9fa-c03e-4abd-9c04-29d71da52358 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:58.563737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fca9fa-c03e-4abd-9c04-29d71da52358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:58.574027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fca9fa-c03e-4abd-9c04-29d71da52358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:58.575457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fca9fa-c03e-4abd-9c04-29d71da52358 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c0fca9fa-c03e-4abd-9c04-29d71da52358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:58.589731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:58.590717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:58.592613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:58.592613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:58.592613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:58.592613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 359/728] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:11:58.598011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fca9fa-c03e-4abd-9c04-29d71da52358 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:58.679155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:58.695735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef62993-9e25-40d7-96b1-1465aeefcda1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:58.706689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fca9fa-c03e-4abd-9c04-29d71da52358 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:58.716212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:58.743281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b40c2e-4f99-48cb-8bbf-fd77ee70807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:58.743897 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b40c2e-4f99-48cb-8bbf-fd77ee70807e None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:58.744212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b40c2e-4f99-48cb-8bbf-fd77ee70807e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:58.744483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b40c2e-4f99-48cb-8bbf-fd77ee70807e None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:58.745133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b40c2e-4f99-48cb-8bbf-fd77ee70807e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:58.746506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b40c2e-4f99-48cb-8bbf-fd77ee70807e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:58.747011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f886e-25fb-476a-a402-b159f20e84ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:58.747816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f886e-25fb-476a-a402-b159f20e84ee None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:58.749079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f886e-25fb-476a-a402-b159f20e84ee None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:58.749683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f886e-25fb-476a-a402-b159f20e84ee None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:58.750648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f886e-25fb-476a-a402-b159f20e84ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:58.751159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f886e-25fb-476a-a402-b159f20e84ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:58.752810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f886e-25fb-476a-a402-b159f20e84ee None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:58.768506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 370/729] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:11:58 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:11:58.769499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b40c2e-4f99-48cb-8bbf-fd77ee70807e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:58.770633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 360/730] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:58.776472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f886e-25fb-476a-a402-b159f20e84ee None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:58.914374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f886e-25fb-476a-a402-b159f20e84ee None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:58.968983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df738ed-695e-4484-b21e-0d3d75198ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:58.970128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df738ed-695e-4484-b21e-0d3d75198ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:58.970617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df738ed-695e-4484-b21e-0d3d75198ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:58.970791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b40c2e-4f99-48cb-8bbf-fd77ee70807e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:58.971269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df738ed-695e-4484-b21e-0d3d75198ff2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:58.980256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df738ed-695e-4484-b21e-0d3d75198ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:58.982079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df738ed-695e-4484-b21e-0d3d75198ff2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-2df738ed-695e-4484-b21e-0d3d75198ff2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:11:58.995597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:58.996894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:58.998084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:58.998084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:58.998084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:11:58.998084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:11:58.998084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:11:58.998084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:11:58.998084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:11:58.998084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:11:58.998084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:11:58.998084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:11:59.000237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 361/731] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:11:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:59.001538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05680594-5c1f-4a3f-8a9f-89ad047c9d2e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.001973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05680594-5c1f-4a3f-8a9f-89ad047c9d2e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.002316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05680594-5c1f-4a3f-8a9f-89ad047c9d2e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.003941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 362/732] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:59.006759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05680594-5c1f-4a3f-8a9f-89ad047c9d2e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:59.024852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44eb532-0d13-4d3d-b98a-2289ea4bb8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:59.027140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eb532-0d13-4d3d-b98a-2289ea4bb8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.027561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eb532-0d13-4d3d-b98a-2289ea4bb8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.028833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eb532-0d13-4d3d-b98a-2289ea4bb8a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.041091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44eb532-0d13-4d3d-b98a-2289ea4bb8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:11:59.044420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-a44eb532-0d13-4d3d-b98a-2289ea4bb8a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:11:59.047317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:59.048420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:11:59.049372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:59.051588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 371/733] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:59.053323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe8d1-3f39-441b-a6d6-696eb9c45bd6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.053323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe8d1-3f39-441b-a6d6-696eb9c45bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.053323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe8d1-3f39-441b-a6d6-696eb9c45bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.073138 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-37fbe8d1-3f39-441b-a6d6-696eb9c45bd6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:59.074716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-37fbe8d1-3f39-441b-a6d6-696eb9c45bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:59.078791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:59.156879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05680594-5c1f-4a3f-8a9f-89ad047c9d2e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:59.162832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 372/734] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 06:11:59.168037 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbe8d1-3f39-441b-a6d6-696eb9c45bd6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:59.196223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d96adc-dc8e-4b4a-ba73-d7bde8fba78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:59.196829 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d96adc-dc8e-4b4a-ba73-d7bde8fba78c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.197107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d96adc-dc8e-4b4a-ba73-d7bde8fba78c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.197379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d96adc-dc8e-4b4a-ba73-d7bde8fba78c None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.198613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d96adc-dc8e-4b4a-ba73-d7bde8fba78c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:59.198925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d96adc-dc8e-4b4a-ba73-d7bde8fba78c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:59.200677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d96adc-dc8e-4b4a-ba73-d7bde8fba78c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:59.222457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 363/735] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 18 06:11:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:11:59.230113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d96adc-dc8e-4b4a-ba73-d7bde8fba78c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:59.367933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbe8d1-3f39-441b-a6d6-696eb9c45bd6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:59.372086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:59.402750 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d96adc-dc8e-4b4a-ba73-d7bde8fba78c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:59.440791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b520081-194d-4d97-acd9-b8b4dfccf3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:59.441398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b520081-194d-4d97-acd9-b8b4dfccf3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.441676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b520081-194d-4d97-acd9-b8b4dfccf3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.441948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b520081-194d-4d97-acd9-b8b4dfccf3f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.450000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b077ac0-cbc4-4d98-97a1-60feef73490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:59.450722 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077ac0-cbc4-4d98-97a1-60feef73490e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.451006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077ac0-cbc4-4d98-97a1-60feef73490e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.451280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b077ac0-cbc4-4d98-97a1-60feef73490e None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.452522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b077ac0-cbc4-4d98-97a1-60feef73490e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:59.452827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b077ac0-cbc4-4d98-97a1-60feef73490e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:59.454310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b077ac0-cbc4-4d98-97a1-60feef73490e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:59.475809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 373/736] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:11:59.481181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b077ac0-cbc4-4d98-97a1-60feef73490e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:59.486358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:59.519476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b520081-194d-4d97-acd9-b8b4dfccf3f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:59.521188 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b520081-194d-4d97-acd9-b8b4dfccf3f2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:59.594229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b077ac0-cbc4-4d98-97a1-60feef73490e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:59.605691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:59.627872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 364/737] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:11:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 06:11:59.627872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b520081-194d-4d97-acd9-b8b4dfccf3f2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:59.635305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee53793-8dca-4bd0-9145-78eefb8731fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:59.635995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53793-8dca-4bd0-9145-78eefb8731fb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.636279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53793-8dca-4bd0-9145-78eefb8731fb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.636551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee53793-8dca-4bd0-9145-78eefb8731fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.649330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee53793-8dca-4bd0-9145-78eefb8731fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:59.651196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee53793-8dca-4bd0-9145-78eefb8731fb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6ee53793-8dca-4bd0-9145-78eefb8731fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:59.666601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:59.667788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:59.669048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:59.669048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:59.669048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:59.669048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 374/738] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:59.671946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afd7f-6150-4e3b-ba94-e8e362d1019a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.671946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afd7f-6150-4e3b-ba94-e8e362d1019a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.671946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afd7f-6150-4e3b-ba94-e8e362d1019a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.673260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 375/739] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:11:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:11:59.674270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afd7f-6150-4e3b-ba94-e8e362d1019a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:59.735457 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:59.737934 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b520081-194d-4d97-acd9-b8b4dfccf3f2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:59.775117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9a4d4-6edc-46a0-a24e-09c6ca6ad7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:59.775871 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9a4d4-6edc-46a0-a24e-09c6ca6ad7ad None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.776183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9a4d4-6edc-46a0-a24e-09c6ca6ad7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.776458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9a4d4-6edc-46a0-a24e-09c6ca6ad7ad None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.777098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9a4d4-6edc-46a0-a24e-09c6ca6ad7ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:59.778456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9a4d4-6edc-46a0-a24e-09c6ca6ad7ad None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:59.784469 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afd7f-6150-4e3b-ba94-e8e362d1019a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:59.794693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 365/740] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:11:59 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:11:59.796161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9a4d4-6edc-46a0-a24e-09c6ca6ad7ad None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:11:59.843862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee345e7-c82a-4d93-97b0-187580e0e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:59.844958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee345e7-c82a-4d93-97b0-187580e0e7ac None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.845481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee345e7-c82a-4d93-97b0-187580e0e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.847314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee345e7-c82a-4d93-97b0-187580e0e7ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.848673 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:11:59.868518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee345e7-c82a-4d93-97b0-187580e0e7ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:59.870598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee345e7-c82a-4d93-97b0-187580e0e7ac None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-2ee345e7-c82a-4d93-97b0-187580e0e7ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:11:59.892454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:11:59.893522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:11:59.894428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:11:59.894428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:11:59.894428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:11:59.898402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 376/741] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:11:59.899818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be684359-7f0c-47c9-bf82-7bb55af242db None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.900107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be684359-7f0c-47c9-bf82-7bb55af242db None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.900380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be684359-7f0c-47c9-bf82-7bb55af242db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.920970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-be684359-7f0c-47c9-bf82-7bb55af242db None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:11:59.922248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-be684359-7f0c-47c9-bf82-7bb55af242db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:11:59.943700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9a4d4-6edc-46a0-a24e-09c6ca6ad7ad None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:11:59.989778 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4617be-5f1e-4770-97a0-f83ff06898d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:11:59.989985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4617be-5f1e-4770-97a0-f83ff06898d8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:11:59.990263 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4617be-5f1e-4770-97a0-f83ff06898d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:11:59.990535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4617be-5f1e-4770-97a0-f83ff06898d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:11:59.991173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4617be-5f1e-4770-97a0-f83ff06898d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:11:59.991475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4617be-5f1e-4770-97a0-f83ff06898d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:11:59.994527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4617be-5f1e-4770-97a0-f83ff06898d8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:11:59.997568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 377/742] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:11:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:11:59.999116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be684359-7f0c-47c9-bf82-7bb55af242db None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:00.007051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 366/743] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:00.012336 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4617be-5f1e-4770-97a0-f83ff06898d8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:00.040962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:00.127154 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:00.131326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4617be-5f1e-4770-97a0-f83ff06898d8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:00.138036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be684359-7f0c-47c9-bf82-7bb55af242db None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:00.168595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b23ab-6c05-49d8-815b-d8b4d8a92acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:00.169368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b23ab-6c05-49d8-815b-d8b4d8a92acd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:00.169748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b23ab-6c05-49d8-815b-d8b4d8a92acd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:00.170220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b23ab-6c05-49d8-815b-d8b4d8a92acd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:00.178102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b23ab-6c05-49d8-815b-d8b4d8a92acd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:00.179933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b23ab-6c05-49d8-815b-d8b4d8a92acd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:00.181210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d10812-59ce-407e-bfc3-02d922bf6c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:00.182167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10812-59ce-407e-bfc3-02d922bf6c38 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:00.182600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10812-59ce-407e-bfc3-02d922bf6c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:00.183473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10812-59ce-407e-bfc3-02d922bf6c38 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:00.184346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d10812-59ce-407e-bfc3-02d922bf6c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:00.184814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d10812-59ce-407e-bfc3-02d922bf6c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:00.187001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d10812-59ce-407e-bfc3-02d922bf6c38 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a39b23ab-6c05-49d8-815b-d8b4d8a92acd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:00.198748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:00.199962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:00.201050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:00.201050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:00.201050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:00.201050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:00.201050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:00.201050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:00.201050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:00.201050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:00.201050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:12:00.201050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:00.202498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 378/744] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:00.204275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 367/745] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 18 06:12:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:00.208947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d10812-59ce-407e-bfc3-02d922bf6c38 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:00.213614 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b23ab-6c05-49d8-815b-d8b4d8a92acd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:00.346158 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b23ab-6c05-49d8-815b-d8b4d8a92acd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:00.397124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:00.400817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7129d-e3e5-4ce7-bb4f-1a9ef903e1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:00.401418 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7129d-e3e5-4ce7-bb4f-1a9ef903e1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:00.401794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7129d-e3e5-4ce7-bb4f-1a9ef903e1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:00.402336 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7129d-e3e5-4ce7-bb4f-1a9ef903e1d1 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:00.403066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7129d-e3e5-4ce7-bb4f-1a9ef903e1d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:00.403368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7129d-e3e5-4ce7-bb4f-1a9ef903e1d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:00.404602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d10812-59ce-407e-bfc3-02d922bf6c38 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:00.405189 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7129d-e3e5-4ce7-bb4f-1a9ef903e1d1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:00.425247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 368/746] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 18 06:12:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:00.430728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7129d-e3e5-4ce7-bb4f-1a9ef903e1d1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:00.440435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03612d3e-6e68-423e-92b9-0d5c27fd9539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:00.441308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03612d3e-6e68-423e-92b9-0d5c27fd9539 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:00.441738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03612d3e-6e68-423e-92b9-0d5c27fd9539 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:00.442159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03612d3e-6e68-423e-92b9-0d5c27fd9539 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:00.449402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03612d3e-6e68-423e-92b9-0d5c27fd9539 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:00.451010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03612d3e-6e68-423e-92b9-0d5c27fd9539 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:00.452813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-03612d3e-6e68-423e-92b9-0d5c27fd9539 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:00.464268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:00.465392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:00.466436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:00.466436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:00.466436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:00.466436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:00.466436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:00.466436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:00.466436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:00.466436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:00.468873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 379/747] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:00.469823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03612d3e-6e68-423e-92b9-0d5c27fd9539 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:00.549138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7129d-e3e5-4ce7-bb4f-1a9ef903e1d1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:00.583175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03612d3e-6e68-423e-92b9-0d5c27fd9539 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:00.586319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c43fa-0624-436e-a6a8-89184a241278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:00.586836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c43fa-0624-436e-a6a8-89184a241278 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:00.587119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c43fa-0624-436e-a6a8-89184a241278 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:00.587393 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c43fa-0624-436e-a6a8-89184a241278 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:00.598853 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c43fa-0624-436e-a6a8-89184a241278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c84c43fa-0624-436e-a6a8-89184a241278 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:00.604113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:00.605221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:00.606139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 369/748] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:12:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:00.606832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c43fa-0624-436e-a6a8-89184a241278 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:00.630225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc653a5-8409-4286-9b35-99017f1c67b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:00.631734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc653a5-8409-4286-9b35-99017f1c67b1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:00.632188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc653a5-8409-4286-9b35-99017f1c67b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:00.632606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc653a5-8409-4286-9b35-99017f1c67b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:00.644765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc653a5-8409-4286-9b35-99017f1c67b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:00.646435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc653a5-8409-4286-9b35-99017f1c67b1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6dc653a5-8409-4286-9b35-99017f1c67b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:00.662512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:00.663665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:00.664703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:00.664703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:00.664703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:00.670828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 380/749] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:00.672171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc653a5-8409-4286-9b35-99017f1c67b1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:00.676775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:00.695370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:00.731394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c43fa-0624-436e-a6a8-89184a241278 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:00.773157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b13ff-ddc8-4aa1-8c97-2a63119d3a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:00.773937 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b13ff-ddc8-4aa1-8c97-2a63119d3a14 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:00.774319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b13ff-ddc8-4aa1-8c97-2a63119d3a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:00.774701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b13ff-ddc8-4aa1-8c97-2a63119d3a14 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:00.775497 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b13ff-ddc8-4aa1-8c97-2a63119d3a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:00.775929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b13ff-ddc8-4aa1-8c97-2a63119d3a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:00.777566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b13ff-ddc8-4aa1-8c97-2a63119d3a14 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:00.790136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc653a5-8409-4286-9b35-99017f1c67b1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:00.793350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 370/750] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:00.793799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b13ff-ddc8-4aa1-8c97-2a63119d3a14 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:00.831877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9140fc4-f87d-4f1e-b2c2-c5ab6336b2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:00.832966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9140fc4-f87d-4f1e-b2c2-c5ab6336b2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:00.833430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9140fc4-f87d-4f1e-b2c2-c5ab6336b2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:00.833996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9140fc4-f87d-4f1e-b2c2-c5ab6336b2a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:00.834877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9140fc4-f87d-4f1e-b2c2-c5ab6336b2a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:00.835389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9140fc4-f87d-4f1e-b2c2-c5ab6336b2a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:00.837367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9140fc4-f87d-4f1e-b2c2-c5ab6336b2a9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:00.852422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 381/751] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:12:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:00.853665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9140fc4-f87d-4f1e-b2c2-c5ab6336b2a9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:00.919942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b13ff-ddc8-4aa1-8c97-2a63119d3a14 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:00.930267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:00.960583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed81e5-8701-411c-90f2-8b8cdb057222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:00.961433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed81e5-8701-411c-90f2-8b8cdb057222 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:00.961712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed81e5-8701-411c-90f2-8b8cdb057222 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:00.961985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed81e5-8701-411c-90f2-8b8cdb057222 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:00.962620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed81e5-8701-411c-90f2-8b8cdb057222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:00.962926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed81e5-8701-411c-90f2-8b8cdb057222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:00.964545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed81e5-8701-411c-90f2-8b8cdb057222 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:00.970650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9140fc4-f87d-4f1e-b2c2-c5ab6336b2a9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:00.972740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:00.984318 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 371/752] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:00.985873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed81e5-8701-411c-90f2-8b8cdb057222 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:01.016642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5196ec-677f-4e6b-973e-e121dad042cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:01.017248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5196ec-677f-4e6b-973e-e121dad042cf None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:01.017525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5196ec-677f-4e6b-973e-e121dad042cf None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:01.017797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5196ec-677f-4e6b-973e-e121dad042cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:01.018692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5196ec-677f-4e6b-973e-e121dad042cf None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=3e0f04f474124698a46bed8dac01e30e) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:01.018993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5196ec-677f-4e6b-973e-e121dad042cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:01.021043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5196ec-677f-4e6b-973e-e121dad042cf None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:01.027973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 382/753] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:00 2022] GET /identity/v3/role_assignments?user.id=3e0f04f474124698a46bed8dac01e30e&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=4494ba66c3f649febc69511a47e27b67 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:01.029029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5196ec-677f-4e6b-973e-e121dad042cf None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:01.143002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed81e5-8701-411c-90f2-8b8cdb057222 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:01.199513 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5196ec-677f-4e6b-973e-e121dad042cf None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:01.225431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995f2b3-fcab-413d-8d4e-6a4b9373fe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:01.226446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f2b3-fcab-413d-8d4e-6a4b9373fe79 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:01.226956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f2b3-fcab-413d-8d4e-6a4b9373fe79 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:01.227294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f2b3-fcab-413d-8d4e-6a4b9373fe79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:01.243427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:01.244068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995f2b3-fcab-413d-8d4e-6a4b9373fe79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:01.245519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995f2b3-fcab-413d-8d4e-6a4b9373fe79 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:01.256153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05bdd9-1289-4e17-b0dd-01b26f0ef78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:01.256153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05bdd9-1289-4e17-b0dd-01b26f0ef78f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:01.256153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05bdd9-1289-4e17-b0dd-01b26f0ef78f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:01.256153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05bdd9-1289-4e17-b0dd-01b26f0ef78f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:01.265509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05bdd9-1289-4e17-b0dd-01b26f0ef78f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-a995f2b3-fcab-413d-8d4e-6a4b9373fe79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:01.265931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:01.266858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:01.267745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:01.267745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:01.267745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:01.267745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 372/754] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:01.268017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05bdd9-1289-4e17-b0dd-01b26f0ef78f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:01.268524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3a52-6d73-4e3c-b1ad-54fac29779fd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:01.269233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3a52-6d73-4e3c-b1ad-54fac29779fd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:01.269233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3a52-6d73-4e3c-b1ad-54fac29779fd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:01.275029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 373/755] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:01.275832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c3a52-6d73-4e3c-b1ad-54fac29779fd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-cb05bdd9-1289-4e17-b0dd-01b26f0ef78f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:01.291339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:01.292314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:01.293216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:01.293216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:01.293216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:01.293216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:01.293216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:01.293216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:01.293216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:01.293216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:01.293216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 383/756] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:01.294095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d757bf7-07bc-4b69-b32c-e08347777903 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:01.294212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d757bf7-07bc-4b69-b32c-e08347777903 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:01.299938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d757bf7-07bc-4b69-b32c-e08347777903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:01.317191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4d757bf7-07bc-4b69-b32c-e08347777903 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:01.318411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4d757bf7-07bc-4b69-b32c-e08347777903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:01.348812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:01.395143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 384/757] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:01.396062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d757bf7-07bc-4b69-b32c-e08347777903 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:01.423744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c3a52-6d73-4e3c-b1ad-54fac29779fd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:01.490609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0b40c-b694-4e9d-b6c7-e1df88407559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:01.492047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0b40c-b694-4e9d-b6c7-e1df88407559 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:01.492329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0b40c-b694-4e9d-b6c7-e1df88407559 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:01.492601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0b40c-b694-4e9d-b6c7-e1df88407559 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:01.493906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0b40c-b694-4e9d-b6c7-e1df88407559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:01.494220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0b40c-b694-4e9d-b6c7-e1df88407559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:01.495835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0b40c-b694-4e9d-b6c7-e1df88407559 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:01.522152 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 374/758] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:01.528874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0b40c-b694-4e9d-b6c7-e1df88407559 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:01.590264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d757bf7-07bc-4b69-b32c-e08347777903 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:01.644262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:01.659362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0b40c-b694-4e9d-b6c7-e1df88407559 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:01.672067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:01.691720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231de220-7c9a-44a4-85d8-ccc6f559c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:01.692423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de220-7c9a-44a4-85d8-ccc6f559c6eb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:01.692706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de220-7c9a-44a4-85d8-ccc6f559c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:01.692979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de220-7c9a-44a4-85d8-ccc6f559c6eb None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:01.693676 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de220-7c9a-44a4-85d8-ccc6f559c6eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:01.693981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de220-7c9a-44a4-85d8-ccc6f559c6eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:01.695489 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de220-7c9a-44a4-85d8-ccc6f559c6eb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:01.712419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd339a3-916f-403c-9062-868b30c13fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:01.713055 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd339a3-916f-403c-9062-868b30c13fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:01.713333 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd339a3-916f-403c-9062-868b30c13fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:01.713606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd339a3-916f-403c-9062-868b30c13fd3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:01.721929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 385/759] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:01.725108 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231de220-7c9a-44a4-85d8-ccc6f559c6eb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:01.731120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd339a3-916f-403c-9062-868b30c13fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:01.733236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd339a3-916f-403c-9062-868b30c13fd3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3fd339a3-916f-403c-9062-868b30c13fd3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:01.751391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:01.752459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:01.753914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:01.753914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:01.753914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:01.753914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:01.753914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:01.753914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:01.753914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:01.753914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:01.753914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:01.753914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:01.753914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 375/760] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 18 06:12:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:01.754504 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd339a3-916f-403c-9062-868b30c13fd3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:01.867026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231de220-7c9a-44a4-85d8-ccc6f559c6eb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:01.885434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd339a3-916f-403c-9062-868b30c13fd3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:01.913221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec2084-6937-47b6-87f9-256f90913b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:01.914383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2084-6937-47b6-87f9-256f90913b24 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:01.915071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2084-6937-47b6-87f9-256f90913b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:01.915533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec2084-6937-47b6-87f9-256f90913b24 None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/9b5585d29bcb4b03a1902fbf113f48e8/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:01.918556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec2084-6937-47b6-87f9-256f90913b24 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=9b5585d29bcb4b03a1902fbf113f48e8, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:01.921605 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec2084-6937-47b6-87f9-256f90913b24 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:01.924642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b2d1c-519e-45ae-b463-6707ddef2b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:01.925729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b2d1c-519e-45ae-b463-6707ddef2b51 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:01.926086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b2d1c-519e-45ae-b463-6707ddef2b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:01.926553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b2d1c-519e-45ae-b463-6707ddef2b51 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:01.927245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b2d1c-519e-45ae-b463-6707ddef2b51 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:01.928937 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b2d1c-519e-45ae-b463-6707ddef2b51 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-375b2d1c-519e-45ae-b463-6707ddef2b51 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:01.939069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:01.940171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:01.941031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 376/761] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 18 06:12:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:01.941839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b2d1c-519e-45ae-b463-6707ddef2b51 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:01.952570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 386/762] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:12:01 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/9b5585d29bcb4b03a1902fbf113f48e8/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:12:01.953888 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec2084-6937-47b6-87f9-256f90913b24 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:02.006319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:02.044269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:02.135769 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec2084-6937-47b6-87f9-256f90913b24 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:02.165828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b2d1c-519e-45ae-b463-6707ddef2b51 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:02.191030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79eae0-1e34-4315-9b0b-300e44027196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:02.191653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79eae0-1e34-4315-9b0b-300e44027196 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:02.191944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79eae0-1e34-4315-9b0b-300e44027196 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:02.192221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79eae0-1e34-4315-9b0b-300e44027196 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:02.192855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79eae0-1e34-4315-9b0b-300e44027196 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:02.193157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79eae0-1e34-4315-9b0b-300e44027196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:02.197557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79eae0-1e34-4315-9b0b-300e44027196 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:02.204443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 387/763] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 18 06:12:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:02.209609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79eae0-1e34-4315-9b0b-300e44027196 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:02.227522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7f76-2dd8-4fad-8cdb-3a014d942822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:02.228170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7f76-2dd8-4fad-8cdb-3a014d942822 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:02.228475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7f76-2dd8-4fad-8cdb-3a014d942822 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:02.228859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7f76-2dd8-4fad-8cdb-3a014d942822 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:02.229716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc7f76-2dd8-4fad-8cdb-3a014d942822 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:02.230027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc7f76-2dd8-4fad-8cdb-3a014d942822 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:02.231478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc7f76-2dd8-4fad-8cdb-3a014d942822 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:02.254345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 377/764] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 18 06:12:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:02.261112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7f76-2dd8-4fad-8cdb-3a014d942822 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:02.377807 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79eae0-1e34-4315-9b0b-300e44027196 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:02.383003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:02.417553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84196888-3fe6-4160-8cd9-bc6b4bb3ab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:02.418185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196888-3fe6-4160-8cd9-bc6b4bb3ab2b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:02.418531 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196888-3fe6-4160-8cd9-bc6b4bb3ab2b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:02.418869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84196888-3fe6-4160-8cd9-bc6b4bb3ab2b None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:02.419661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84196888-3fe6-4160-8cd9-bc6b4bb3ab2b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:02.420678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84196888-3fe6-4160-8cd9-bc6b4bb3ab2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:02.421646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:02.423417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84196888-3fe6-4160-8cd9-bc6b4bb3ab2b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:02.430388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 388/765] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 18 06:12:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:02.431753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7f76-2dd8-4fad-8cdb-3a014d942822 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:02.432209 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ed53-4247-467f-962a-a2be9bf49bef None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:02.432711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ed53-4247-467f-962a-a2be9bf49bef None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:02.433289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ed53-4247-467f-962a-a2be9bf49bef None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:02.439201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 389/766] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:02.440376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51ed53-4247-467f-962a-a2be9bf49bef None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:02.469995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dd1d7-cc0d-4fb2-ba51-1752f4e23872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:02.470610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dd1d7-cc0d-4fb2-ba51-1752f4e23872 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:02.470902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dd1d7-cc0d-4fb2-ba51-1752f4e23872 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:02.471198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dd1d7-cc0d-4fb2-ba51-1752f4e23872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:02.550447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dd1d7-cc0d-4fb2-ba51-1752f4e23872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:02.551189 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dd1d7-cc0d-4fb2-ba51-1752f4e23872 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:02.590611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51ed53-4247-467f-962a-a2be9bf49bef None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:02.635307 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d45fa2-acc2-4473-9c3f-f423d0087a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:02.636547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45fa2-acc2-4473-9c3f-f423d0087a82 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:02.637042 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45fa2-acc2-4473-9c3f-f423d0087a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:02.637706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d45fa2-acc2-4473-9c3f-f423d0087a82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:02.639631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d45fa2-acc2-4473-9c3f-f423d0087a82 None admin] RBAC: Adding query filter params (interface=public, service_id=6ab37ce1254b42fea2f9362beb3edab5, region_id=RegionOne) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:02.640462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d45fa2-acc2-4473-9c3f-f423d0087a82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:02.642318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d45fa2-acc2-4473-9c3f-f423d0087a82 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:02.649588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:02.657328 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 390/767] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 18 06:12:02 2022] GET /identity/v3/endpoints?service_id=6ab37ce1254b42fea2f9362beb3edab5&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:02.659395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58301c-9cff-4437-8fec-52d77c0c6dd0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:02.659882 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58301c-9cff-4437-8fec-52d77c0c6dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:02.660478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58301c-9cff-4437-8fec-52d77c0c6dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:02.660869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 378/768] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:12:02.669104 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dd1d7-cc0d-4fb2-ba51-1752f4e23872 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:02.684431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-eb58301c-9cff-4437-8fec-52d77c0c6dd0 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:02.685812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-eb58301c-9cff-4437-8fec-52d77c0c6dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:02.714865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:02.764165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 391/769] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:02.764165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58301c-9cff-4437-8fec-52d77c0c6dd0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:02.805428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dd1d7-cc0d-4fb2-ba51-1752f4e23872 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:02.855526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f783184-725e-4abc-8e98-7c7f043ab984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:02.856566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f783184-725e-4abc-8e98-7c7f043ab984 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:02.857054 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f783184-725e-4abc-8e98-7c7f043ab984 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:02.857646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f783184-725e-4abc-8e98-7c7f043ab984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:02.878652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f783184-725e-4abc-8e98-7c7f043ab984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:02.882794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f783184-725e-4abc-8e98-7c7f043ab984 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-6f783184-725e-4abc-8e98-7c7f043ab984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:02.905589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:02.906592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:02.907500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:02.907500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:02.907500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:02.910186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 379/770] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:02.925327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f783184-725e-4abc-8e98-7c7f043ab984 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:02.976423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58301c-9cff-4437-8fec-52d77c0c6dd0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:03.013115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baba214-9592-426a-aa35-27b143d9af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:03.013894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baba214-9592-426a-aa35-27b143d9af5e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:03.014368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baba214-9592-426a-aa35-27b143d9af5e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:03.014794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baba214-9592-426a-aa35-27b143d9af5e None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:03.015396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baba214-9592-426a-aa35-27b143d9af5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:03.016907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baba214-9592-426a-aa35-27b143d9af5e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:03.021433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:03.023170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 392/771] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 18 06:12:02 2022] GET /identity/v3/services => generated 772 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:03.112556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baba214-9592-426a-aa35-27b143d9af5e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:03.132226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f783184-725e-4abc-8e98-7c7f043ab984 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:03.159734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:03.204835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde00a-2f3b-4039-b171-0dbb49b82ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:03.205381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde00a-2f3b-4039-b171-0dbb49b82ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:03.205663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde00a-2f3b-4039-b171-0dbb49b82ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:03.205938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde00a-2f3b-4039-b171-0dbb49b82ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:03.206593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde00a-2f3b-4039-b171-0dbb49b82ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:03.206898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde00a-2f3b-4039-b171-0dbb49b82ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:03.208310 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde00a-2f3b-4039-b171-0dbb49b82ed4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:03.228455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 380/772] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:03.236689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde00a-2f3b-4039-b171-0dbb49b82ed4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:03.259186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baba214-9592-426a-aa35-27b143d9af5e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:03.305832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d272dcc-2073-469d-bafe-b3c058c8e206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:03.306740 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d272dcc-2073-469d-bafe-b3c058c8e206 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:03.307270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d272dcc-2073-469d-bafe-b3c058c8e206 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:03.307774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d272dcc-2073-469d-bafe-b3c058c8e206 None admin] PATH_INFO: `/v3/services/network` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:03.308703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d272dcc-2073-469d-bafe-b3c058c8e206 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:03.310325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d272dcc-2073-469d-bafe-b3c058c8e206 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-1d272dcc-2073-469d-bafe-b3c058c8e206 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:03.321326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:03.322585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 06:12:03.323598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:03.326693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 393/773] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:03 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:03.332458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d272dcc-2073-469d-bafe-b3c058c8e206 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:03.363741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde00a-2f3b-4039-b171-0dbb49b82ed4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:03.366161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:03.402213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82bf67-f443-4f5a-af18-afbf83b1e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:03.402834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82bf67-f443-4f5a-af18-afbf83b1e06b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:03.403326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82bf67-f443-4f5a-af18-afbf83b1e06b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:03.403443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82bf67-f443-4f5a-af18-afbf83b1e06b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:03.412160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82bf67-f443-4f5a-af18-afbf83b1e06b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:03.413800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82bf67-f443-4f5a-af18-afbf83b1e06b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7f82bf67-f443-4f5a-af18-afbf83b1e06b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:03.427931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:03.429057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:03.430135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:03.430135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:03.430135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:03.430135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:03.430135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:03.430135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:03.430135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:03.430135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:03.431967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 381/774] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:03.437088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82bf67-f443-4f5a-af18-afbf83b1e06b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:03.448982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:03.466379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d272dcc-2073-469d-bafe-b3c058c8e206 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:03.515383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cda051-34a5-4b56-9aa1-e4ebcc9320b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:03.517001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cda051-34a5-4b56-9aa1-e4ebcc9320b8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:03.517505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cda051-34a5-4b56-9aa1-e4ebcc9320b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:03.518233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cda051-34a5-4b56-9aa1-e4ebcc9320b8 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:03.519259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cda051-34a5-4b56-9aa1-e4ebcc9320b8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:03.520105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cda051-34a5-4b56-9aa1-e4ebcc9320b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:03.522812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cda051-34a5-4b56-9aa1-e4ebcc9320b8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:03.528999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 394/775] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:12:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:03.531437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f1ce-6046-4cb1-8080-e1f767b16538 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:03.531888 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f1ce-6046-4cb1-8080-e1f767b16538 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:03.532345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f1ce-6046-4cb1-8080-e1f767b16538 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:03.533948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 395/776] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:03.535618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389f1ce-6046-4cb1-8080-e1f767b16538 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:03.567744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82bf67-f443-4f5a-af18-afbf83b1e06b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:03.609672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ea29a-5f30-418d-bede-bb5223bb492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:03.610506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ea29a-5f30-418d-bede-bb5223bb492c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:03.610942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ea29a-5f30-418d-bede-bb5223bb492c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:03.611370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ea29a-5f30-418d-bede-bb5223bb492c None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:03.612226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ea29a-5f30-418d-bede-bb5223bb492c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:03.612670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ea29a-5f30-418d-bede-bb5223bb492c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:03.614392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ea29a-5f30-418d-bede-bb5223bb492c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:03.628515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 382/777] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:03.629945 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daa94f-ad0a-46a2-9d3f-cc3df1399835 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:03.630373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daa94f-ad0a-46a2-9d3f-cc3df1399835 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:03.631236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daa94f-ad0a-46a2-9d3f-cc3df1399835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:03.651820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-68daa94f-ad0a-46a2-9d3f-cc3df1399835 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:03.652061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389f1ce-6046-4cb1-8080-e1f767b16538 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:03.653381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-68daa94f-ad0a-46a2-9d3f-cc3df1399835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:03.673403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:03.689738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da5cc6-def1-40b9-b522-7a9fc5aab4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:03.690714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da5cc6-def1-40b9-b522-7a9fc5aab4ed None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:03.690856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da5cc6-def1-40b9-b522-7a9fc5aab4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:03.691230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da5cc6-def1-40b9-b522-7a9fc5aab4ed None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:03.691979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da5cc6-def1-40b9-b522-7a9fc5aab4ed None admin] RBAC: Adding query filter params (type=network) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:03.692374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da5cc6-def1-40b9-b522-7a9fc5aab4ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:03.693854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da5cc6-def1-40b9-b522-7a9fc5aab4ed None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:03.704112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 396/778] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:12:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:03.705203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da5cc6-def1-40b9-b522-7a9fc5aab4ed None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:03.726964 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:03.741402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 383/779] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:03.741402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daa94f-ad0a-46a2-9d3f-cc3df1399835 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:03.864113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da5cc6-def1-40b9-b522-7a9fc5aab4ed None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:03.927040 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73f7cb-45ba-4734-b2df-d97ae81e49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:03.930990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73f7cb-45ba-4734-b2df-d97ae81e49f0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:03.931473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73f7cb-45ba-4734-b2df-d97ae81e49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:03.931965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73f7cb-45ba-4734-b2df-d97ae81e49f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:03.932905 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73f7cb-45ba-4734-b2df-d97ae81e49f0 None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=4734057fc039462d8d04b5dbee141fac) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:03.933544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73f7cb-45ba-4734-b2df-d97ae81e49f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:03.936468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73f7cb-45ba-4734-b2df-d97ae81e49f0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:03.949790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 397/780] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:03 2022] GET /identity/v3/role_assignments?user.id=4734057fc039462d8d04b5dbee141fac&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:03.955564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daa94f-ad0a-46a2-9d3f-cc3df1399835 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:03.995774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20589a-39e3-4940-82fb-998b53e681e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:03.996633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20589a-39e3-4940-82fb-998b53e681e0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:03.997057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20589a-39e3-4940-82fb-998b53e681e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:03.997473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20589a-39e3-4940-82fb-998b53e681e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:03.998424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20589a-39e3-4940-82fb-998b53e681e0 None admin] RBAC: Adding query filter params (interface=public, service_id=eaa77997d3234396acde15ed4d2d6792, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:03.999203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20589a-39e3-4940-82fb-998b53e681e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:04.000777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20589a-39e3-4940-82fb-998b53e681e0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:04.010322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 384/781] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 18 06:12:03 2022] GET /identity/v3/endpoints?service_id=eaa77997d3234396acde15ed4d2d6792&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:04.016438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73f7cb-45ba-4734-b2df-d97ae81e49f0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:04.056185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20589a-39e3-4940-82fb-998b53e681e0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:04.100801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:04.136180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:04.174088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73f7cb-45ba-4734-b2df-d97ae81e49f0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:04.227945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c702ef4-20b4-4301-83ce-161484ef72e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:04.228827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c702ef4-20b4-4301-83ce-161484ef72e3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:04.229289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c702ef4-20b4-4301-83ce-161484ef72e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:04.229720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c702ef4-20b4-4301-83ce-161484ef72e3 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:04.230571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c702ef4-20b4-4301-83ce-161484ef72e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:04.232228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c702ef4-20b4-4301-83ce-161484ef72e3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:04.238924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 398/782] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 18 06:12:04 2022] GET /identity/v3/services => generated 772 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:04.266365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20589a-39e3-4940-82fb-998b53e681e0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:04.304648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd339f-5965-49a6-a0e8-446ce9def6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:04.305340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd339f-5965-49a6-a0e8-446ce9def6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:04.305621 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd339f-5965-49a6-a0e8-446ce9def6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:04.305895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd339f-5965-49a6-a0e8-446ce9def6a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:04.317801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd339f-5965-49a6-a0e8-446ce9def6a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9acd339f-5965-49a6-a0e8-446ce9def6a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:04.323306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:04.324325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:04.325167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 385/783] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:04.331240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c702ef4-20b4-4301-83ce-161484ef72e3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:04.487944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c702ef4-20b4-4301-83ce-161484ef72e3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:04.525056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d1cd-6f09-43df-8774-f5e8a3d92650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:04.525639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d1cd-6f09-43df-8774-f5e8a3d92650 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:04.525920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d1cd-6f09-43df-8774-f5e8a3d92650 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:04.526188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d1cd-6f09-43df-8774-f5e8a3d92650 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:04.526846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467d1cd-6f09-43df-8774-f5e8a3d92650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:04.527202 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467d1cd-6f09-43df-8774-f5e8a3d92650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:04.528627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467d1cd-6f09-43df-8774-f5e8a3d92650 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:04.533815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba697a-215d-4b9d-a4b3-8d679f2db394 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:04.534089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba697a-215d-4b9d-a4b3-8d679f2db394 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:04.534363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba697a-215d-4b9d-a4b3-8d679f2db394 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:04.535688 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 386/784] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:04.541142 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb31d8-ceea-4052-a4b7-62d2ce030578 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:04.541413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb31d8-ceea-4052-a4b7-62d2ce030578 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:04.541689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb31d8-ceea-4052-a4b7-62d2ce030578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:04.542294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 399/785] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:12:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:04.548117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d1cd-6f09-43df-8774-f5e8a3d92650 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:04.565187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:04.569740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-60cb31d8-ceea-4052-a4b7-62d2ce030578 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:04.570936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-60cb31d8-ceea-4052-a4b7-62d2ce030578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:04.707353 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 387/786] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:04.746746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d1cd-6f09-43df-8774-f5e8a3d92650 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:04.809181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359a557-000a-4967-af3c-6d0b12cac16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:04.810097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359a557-000a-4967-af3c-6d0b12cac16b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:04.810597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359a557-000a-4967-af3c-6d0b12cac16b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:04.811019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359a557-000a-4967-af3c-6d0b12cac16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:04.830003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359a557-000a-4967-af3c-6d0b12cac16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:04.831728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359a557-000a-4967-af3c-6d0b12cac16b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6359a557-000a-4967-af3c-6d0b12cac16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:04.855809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:04.857033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:04.859024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:04.859024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:04.859024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:04.859024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 400/787] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:04.863351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb31d8-ceea-4052-a4b7-62d2ce030578 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:04.878968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:05.010584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb31d8-ceea-4052-a4b7-62d2ce030578 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:05.046860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28c5ca-43ec-4c6e-a4b9-7034af8280fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:05.047470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28c5ca-43ec-4c6e-a4b9-7034af8280fa None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:05.047742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28c5ca-43ec-4c6e-a4b9-7034af8280fa None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:05.048045 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28c5ca-43ec-4c6e-a4b9-7034af8280fa None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:05.048682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28c5ca-43ec-4c6e-a4b9-7034af8280fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:05.048979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28c5ca-43ec-4c6e-a4b9-7034af8280fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:05.050332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28c5ca-43ec-4c6e-a4b9-7034af8280fa None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:05.064451 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359a557-000a-4967-af3c-6d0b12cac16b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:05.075153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 388/788] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:05.081981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28c5ca-43ec-4c6e-a4b9-7034af8280fa None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:05.161065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:05.199259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28c5ca-43ec-4c6e-a4b9-7034af8280fa None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:05.215487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:05.237167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bd3a9-521d-4f2c-94bf-864e274127c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:05.237891 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bd3a9-521d-4f2c-94bf-864e274127c3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:05.238240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bd3a9-521d-4f2c-94bf-864e274127c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:05.238682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bd3a9-521d-4f2c-94bf-864e274127c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:05.247182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bd3a9-521d-4f2c-94bf-864e274127c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:05.249209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bd3a9-521d-4f2c-94bf-864e274127c3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-022bd3a9-521d-4f2c-94bf-864e274127c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:05.262281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:05.263254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:05.264313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:05.264313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:05.264313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:05.264313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:05.264313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:05.264313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:05.264313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:05.264313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:05.264313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:12:05.264313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:05.264842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 389/789] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:12:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:05.270459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bd3a9-521d-4f2c-94bf-864e274127c3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:05.366024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359a557-000a-4967-af3c-6d0b12cac16b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:05.378859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bd3a9-521d-4f2c-94bf-864e274127c3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:05.416537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41ec63-18e6-4b66-abfa-94b654ae5aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:05.417246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41ec63-18e6-4b66-abfa-94b654ae5aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:05.417599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41ec63-18e6-4b66-abfa-94b654ae5aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:05.417949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41ec63-18e6-4b66-abfa-94b654ae5aa5 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:05.418745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41ec63-18e6-4b66-abfa-94b654ae5aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:05.419125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41ec63-18e6-4b66-abfa-94b654ae5aa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:05.420786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41ec63-18e6-4b66-abfa-94b654ae5aa5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:05.422727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:05.442374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 390/790] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 18 06:12:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:05.447681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41ec63-18e6-4b66-abfa-94b654ae5aa5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:05.509394 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1758f94-1f60-41ab-abb4-157888a265ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:05.510058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1758f94-1f60-41ab-abb4-157888a265ad None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:05.510333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1758f94-1f60-41ab-abb4-157888a265ad None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:05.510602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1758f94-1f60-41ab-abb4-157888a265ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:05.549152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1758f94-1f60-41ab-abb4-157888a265ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-b1758f94-1f60-41ab-abb4-157888a265ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:05.554974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:05.556231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:05.557265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:05.569751 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 401/791] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:12:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 506 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:05.575630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1758f94-1f60-41ab-abb4-157888a265ad None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:05.695863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41ec63-18e6-4b66-abfa-94b654ae5aa5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:05.734879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fc94a-462e-4137-aa63-329728a3cd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:05.735534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc94a-462e-4137-aa63-329728a3cd25 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:05.735766 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc94a-462e-4137-aa63-329728a3cd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:05.736067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc94a-462e-4137-aa63-329728a3cd25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:05.749012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fc94a-462e-4137-aa63-329728a3cd25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:05.751131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fc94a-462e-4137-aa63-329728a3cd25 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:05.768498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1758f94-1f60-41ab-abb4-157888a265ad None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-852fc94a-462e-4137-aa63-329728a3cd25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:05.768970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:05.769837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:05.770818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:05.770818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:05.770818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:05.770818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 391/792] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:05.771475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920327d-9713-4021-9097-fba389f4bf5b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:05.771639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920327d-9713-4021-9097-fba389f4bf5b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:05.775929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920327d-9713-4021-9097-fba389f4bf5b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:05.775929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 392/793] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:05.777125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920327d-9713-4021-9097-fba389f4bf5b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:05.802058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:05.817474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6972f6e-ef12-408d-86cd-77a9af321b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:05.818194 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6972f6e-ef12-408d-86cd-77a9af321b74 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:05.818556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6972f6e-ef12-408d-86cd-77a9af321b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:05.818894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6972f6e-ef12-408d-86cd-77a9af321b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:05.819612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6972f6e-ef12-408d-86cd-77a9af321b74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:05.820043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6972f6e-ef12-408d-86cd-77a9af321b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:05.821646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6972f6e-ef12-408d-86cd-77a9af321b74 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:05.830243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:05.831686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 402/794] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:12:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:05.833301 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0560e-5aeb-4473-a21e-6b49d81c2d88 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:05.833659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0560e-5aeb-4473-a21e-6b49d81c2d88 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:05.833998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0560e-5aeb-4473-a21e-6b49d81c2d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:05.853996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-89b0560e-5aeb-4473-a21e-6b49d81c2d88 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:05.855543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-89b0560e-5aeb-4473-a21e-6b49d81c2d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:05.908179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920327d-9713-4021-9097-fba389f4bf5b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:05.929708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 403/795] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:05.930703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0560e-5aeb-4473-a21e-6b49d81c2d88 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:05.965748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47740c22-0d51-42ae-9484-2a4d43dc0b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:05.966274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47740c22-0d51-42ae-9484-2a4d43dc0b52 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:05.967077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47740c22-0d51-42ae-9484-2a4d43dc0b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:05.967342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47740c22-0d51-42ae-9484-2a4d43dc0b52 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:05.970733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47740c22-0d51-42ae-9484-2a4d43dc0b52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:05.971627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47740c22-0d51-42ae-9484-2a4d43dc0b52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:05.973032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47740c22-0d51-42ae-9484-2a4d43dc0b52 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:05.999791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 393/796] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:06.004990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47740c22-0d51-42ae-9484-2a4d43dc0b52 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:06.097049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0560e-5aeb-4473-a21e-6b49d81c2d88 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:06.119815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:06.162278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41086b-66f9-4b2a-ae96-3ce934804922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:06.162912 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41086b-66f9-4b2a-ae96-3ce934804922 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:06.163188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41086b-66f9-4b2a-ae96-3ce934804922 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:06.163461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41086b-66f9-4b2a-ae96-3ce934804922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:06.182324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41086b-66f9-4b2a-ae96-3ce934804922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:06.183784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41086b-66f9-4b2a-ae96-3ce934804922 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:06.186318 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:06.194406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47740c22-0d51-42ae-9484-2a4d43dc0b52 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-3a41086b-66f9-4b2a-ae96-3ce934804922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:06.203089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:06.205614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:06.207646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:06.207646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:06.207646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:06.207646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 404/797] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:06.212168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41086b-66f9-4b2a-ae96-3ce934804922 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:06.257319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fcdbe-5426-41d2-ad67-4f39b5aeaada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:06.257868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fcdbe-5426-41d2-ad67-4f39b5aeaada None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:06.258899 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fcdbe-5426-41d2-ad67-4f39b5aeaada None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:06.259203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fcdbe-5426-41d2-ad67-4f39b5aeaada None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:06.275052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fcdbe-5426-41d2-ad67-4f39b5aeaada None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:06.278583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fcdbe-5426-41d2-ad67-4f39b5aeaada None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b37fcdbe-5426-41d2-ad67-4f39b5aeaada None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:06.296171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:06.298216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:06.300376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:06.300376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:06.300376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:06.300376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:06.300376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:06.300376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:06.300376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:06.300376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:06.303937 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 394/798] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:06.304614 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fcdbe-5426-41d2-ad67-4f39b5aeaada None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:06.367378 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41086b-66f9-4b2a-ae96-3ce934804922 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:06.412619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf95ebd-a487-4244-aaf5-ff13f81bef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:06.413595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf95ebd-a487-4244-aaf5-ff13f81bef56 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:06.414019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf95ebd-a487-4244-aaf5-ff13f81bef56 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:06.414396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf95ebd-a487-4244-aaf5-ff13f81bef56 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:06.415183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf95ebd-a487-4244-aaf5-ff13f81bef56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:06.415593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf95ebd-a487-4244-aaf5-ff13f81bef56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:06.417319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf95ebd-a487-4244-aaf5-ff13f81bef56 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:06.433398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fcdbe-5426-41d2-ad67-4f39b5aeaada None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:06.439191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 405/799] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:06.440418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf95ebd-a487-4244-aaf5-ff13f81bef56 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:06.469087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:06.475038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6182d-39b5-4ff2-942d-4cc8bda7ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:06.476790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6182d-39b5-4ff2-942d-4cc8bda7ed9e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:06.477227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6182d-39b5-4ff2-942d-4cc8bda7ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:06.477920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6182d-39b5-4ff2-942d-4cc8bda7ed9e None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:06.478763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6182d-39b5-4ff2-942d-4cc8bda7ed9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:06.479227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6182d-39b5-4ff2-942d-4cc8bda7ed9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:06.481028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6182d-39b5-4ff2-942d-4cc8bda7ed9e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:06.495998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 395/800] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:06.497149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6182d-39b5-4ff2-942d-4cc8bda7ed9e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:06.526995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:06.619339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6182d-39b5-4ff2-942d-4cc8bda7ed9e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:06.658343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ba2c5-256f-413f-9a3d-4ce11b0d58bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:06.659202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ba2c5-256f-413f-9a3d-4ce11b0d58bb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:06.659638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ba2c5-256f-413f-9a3d-4ce11b0d58bb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:06.659928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ba2c5-256f-413f-9a3d-4ce11b0d58bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:06.668478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ba2c5-256f-413f-9a3d-4ce11b0d58bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:06.670617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ba2c5-256f-413f-9a3d-4ce11b0d58bb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:06.680127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf95ebd-a487-4244-aaf5-ff13f81bef56 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-bb2ba2c5-256f-413f-9a3d-4ce11b0d58bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:06.682243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:06.683171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 396/801] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 18 06:12:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:06.684137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ba2c5-256f-413f-9a3d-4ce11b0d58bb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:06.718965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872ef6a-54bd-4f7d-b6d1-6aae3ad9c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:06.719697 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872ef6a-54bd-4f7d-b6d1-6aae3ad9c0bb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:06.720102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872ef6a-54bd-4f7d-b6d1-6aae3ad9c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:06.720473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872ef6a-54bd-4f7d-b6d1-6aae3ad9c0bb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:06.721107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872ef6a-54bd-4f7d-b6d1-6aae3ad9c0bb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:06.722474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872ef6a-54bd-4f7d-b6d1-6aae3ad9c0bb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-e872ef6a-54bd-4f7d-b6d1-6aae3ad9c0bb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:06.731741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:06.733324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:06.734217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 406/802] 10.222.0.16 () {56 vars in 1129 bytes} [Sun Sep 18 06:12:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:06.735029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6cfaa-9158-4dd5-a84a-95cba4f3f621 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:06.735029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6cfaa-9158-4dd5-a84a-95cba4f3f621 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:06.735029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6cfaa-9158-4dd5-a84a-95cba4f3f621 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:06.740899 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 407/803] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:06.741435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6cfaa-9158-4dd5-a84a-95cba4f3f621 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:06.781363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:06.805488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ba2c5-256f-413f-9a3d-4ce11b0d58bb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:06.841345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:06.850098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e617c-f4d5-4de2-b24e-d6d9a953be2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:06.850861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e617c-f4d5-4de2-b24e-d6d9a953be2f None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:06.851040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e617c-f4d5-4de2-b24e-d6d9a953be2f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:06.851319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e617c-f4d5-4de2-b24e-d6d9a953be2f None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/3e0f04f474124698a46bed8dac01e30e/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:06.853600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e617c-f4d5-4de2-b24e-d6d9a953be2f None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=3e0f04f474124698a46bed8dac01e30e, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:06.855031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e617c-f4d5-4de2-b24e-d6d9a953be2f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:06.855869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6cfaa-9158-4dd5-a84a-95cba4f3f621 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:06.870675 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 397/804] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:12:06 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/3e0f04f474124698a46bed8dac01e30e/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:12:06.871895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8e80-1fa1-41a7-a37b-7b253adc5a16 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:06.872207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8e80-1fa1-41a7-a37b-7b253adc5a16 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:06.872482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8e80-1fa1-41a7-a37b-7b253adc5a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:06.894313 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f18aa8-47cc-432b-8b65-5dfa2dabab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:06.894982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f18aa8-47cc-432b-8b65-5dfa2dabab72 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:06.895268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f18aa8-47cc-432b-8b65-5dfa2dabab72 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:06.895542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f18aa8-47cc-432b-8b65-5dfa2dabab72 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:06.896323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f18aa8-47cc-432b-8b65-5dfa2dabab72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:06.896690 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f18aa8-47cc-432b-8b65-5dfa2dabab72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:06.897676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f45b8e80-1fa1-41a7-a37b-7b253adc5a16 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:06.898165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f18aa8-47cc-432b-8b65-5dfa2dabab72 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:06.899041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f45b8e80-1fa1-41a7-a37b-7b253adc5a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:06.924098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 408/805] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 18 06:12:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:06.924978 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f18aa8-47cc-432b-8b65-5dfa2dabab72 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:06.978901 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 398/806] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:06.980575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab46104-6dc7-445b-aa71-918b98e47544 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:06.980858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab46104-6dc7-445b-aa71-918b98e47544 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:06.981131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab46104-6dc7-445b-aa71-918b98e47544 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:06.983110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 399/807] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:06.983933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab46104-6dc7-445b-aa71-918b98e47544 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:07.078442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:07.085515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f18aa8-47cc-432b-8b65-5dfa2dabab72 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:07.119784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab46104-6dc7-445b-aa71-918b98e47544 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:07.133999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887c353-3fa3-4971-9134-92d33f1c6538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:07.134886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887c353-3fa3-4971-9134-92d33f1c6538 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:07.135344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887c353-3fa3-4971-9134-92d33f1c6538 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:07.135790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887c353-3fa3-4971-9134-92d33f1c6538 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:07.136810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887c353-3fa3-4971-9134-92d33f1c6538 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:07.137315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887c353-3fa3-4971-9134-92d33f1c6538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:07.138924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887c353-3fa3-4971-9134-92d33f1c6538 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:07.148443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 409/808] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 18 06:12:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:07.149963 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37083229-255e-4124-93e5-4bcf6867cee9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:07.150460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37083229-255e-4124-93e5-4bcf6867cee9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:07.150949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37083229-255e-4124-93e5-4bcf6867cee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:07.161139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a596464-c211-459f-8c01-64106eba9c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:07.161745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a596464-c211-459f-8c01-64106eba9c40 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:07.162021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a596464-c211-459f-8c01-64106eba9c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:07.162386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a596464-c211-459f-8c01-64106eba9c40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:07.171511 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-37083229-255e-4124-93e5-4bcf6867cee9 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:07.173008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-37083229-255e-4124-93e5-4bcf6867cee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:07.176324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:07.243097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 410/809] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:07.244204 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37083229-255e-4124-93e5-4bcf6867cee9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:07.246906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a596464-c211-459f-8c01-64106eba9c40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:07.248892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a596464-c211-459f-8c01-64106eba9c40 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:07.327764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:07.364037 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37083229-255e-4124-93e5-4bcf6867cee9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:07.369039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 400/810] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:12:07.370030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a596464-c211-459f-8c01-64106eba9c40 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:07.412606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec219fda-d8bf-4895-bc95-56630b428d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:07.413471 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219fda-d8bf-4895-bc95-56630b428d5a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:07.414317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219fda-d8bf-4895-bc95-56630b428d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:07.414747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec219fda-d8bf-4895-bc95-56630b428d5a None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:07.415982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec219fda-d8bf-4895-bc95-56630b428d5a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:07.416683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec219fda-d8bf-4895-bc95-56630b428d5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:07.418995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec219fda-d8bf-4895-bc95-56630b428d5a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:07.426522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 411/811] 10.222.0.16 () {56 vars in 1124 bytes} [Sun Sep 18 06:12:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:07.428049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec219fda-d8bf-4895-bc95-56630b428d5a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:07.433506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:07.481030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a596464-c211-459f-8c01-64106eba9c40 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:07.521341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb0b6b-1178-4490-9e36-075454e8e855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:07.521965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb0b6b-1178-4490-9e36-075454e8e855 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:07.522242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb0b6b-1178-4490-9e36-075454e8e855 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:07.522510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb0b6b-1178-4490-9e36-075454e8e855 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:07.533368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb0b6b-1178-4490-9e36-075454e8e855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:07.534550 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec219fda-d8bf-4895-bc95-56630b428d5a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c9eb0b6b-1178-4490-9e36-075454e8e855 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:07.538117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:07.539119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:07.539984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 401/812] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:12:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:07.540680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb0b6b-1178-4490-9e36-075454e8e855 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:07.571016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:07.578375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fabbaf-7ca5-4048-853c-a8690113da48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:07.578999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fabbaf-7ca5-4048-853c-a8690113da48 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:07.579945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fabbaf-7ca5-4048-853c-a8690113da48 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:07.579945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fabbaf-7ca5-4048-853c-a8690113da48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:07.589784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fabbaf-7ca5-4048-853c-a8690113da48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:07.591223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fabbaf-7ca5-4048-853c-a8690113da48 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-08fabbaf-7ca5-4048-853c-a8690113da48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:07.608163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:07.609290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:07.610165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:07.610165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:07.610165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:07.610165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 412/813] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:07.610400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fabbaf-7ca5-4048-853c-a8690113da48 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:07.658524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb0b6b-1178-4490-9e36-075454e8e855 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:07.672118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:07.695836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fbaf0-6a6c-4338-ad76-d69f066d9178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:07.696466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fbaf0-6a6c-4338-ad76-d69f066d9178 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:07.696742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fbaf0-6a6c-4338-ad76-d69f066d9178 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:07.697013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fbaf0-6a6c-4338-ad76-d69f066d9178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:07.697669 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fbaf0-6a6c-4338-ad76-d69f066d9178 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:07.699014 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fbaf0-6a6c-4338-ad76-d69f066d9178 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:07.721409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 402/814] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:12:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:07.722239 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fbaf0-6a6c-4338-ad76-d69f066d9178 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:07.722933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fabbaf-7ca5-4048-853c-a8690113da48 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:07.789300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab45540-b432-4931-86a2-db3e2a8ecd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:07.790667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab45540-b432-4931-86a2-db3e2a8ecd27 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:07.791152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab45540-b432-4931-86a2-db3e2a8ecd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:07.791923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab45540-b432-4931-86a2-db3e2a8ecd27 None admin] PATH_INFO: `/v3/services/network` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:07.793324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab45540-b432-4931-86a2-db3e2a8ecd27 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:07.795994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab45540-b432-4931-86a2-db3e2a8ecd27 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-cab45540-b432-4931-86a2-db3e2a8ecd27 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:07.809642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:07.811410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 06:12:07.812429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:07.816141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 413/815] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:07 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:07.817331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab45540-b432-4931-86a2-db3e2a8ecd27 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:07.840924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:07.864716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fbaf0-6a6c-4338-ad76-d69f066d9178 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:07.907265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e563-5518-4ba5-aa26-c3b14f0a9af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:07.908343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e563-5518-4ba5-aa26-c3b14f0a9af1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:07.909691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e563-5518-4ba5-aa26-c3b14f0a9af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:07.910112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e563-5518-4ba5-aa26-c3b14f0a9af1 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:07.910921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600e563-5518-4ba5-aa26-c3b14f0a9af1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:07.911364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600e563-5518-4ba5-aa26-c3b14f0a9af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:07.912924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600e563-5518-4ba5-aa26-c3b14f0a9af1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:07.924243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 403/816] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:12:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:07.924885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e563-5518-4ba5-aa26-c3b14f0a9af1 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:07.946430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab45540-b432-4931-86a2-db3e2a8ecd27 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:07.965587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:07.989025 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653237-bfcb-4c12-967c-fb3f73755269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:07.990017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653237-bfcb-4c12-967c-fb3f73755269 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:07.990590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653237-bfcb-4c12-967c-fb3f73755269 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:07.990866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653237-bfcb-4c12-967c-fb3f73755269 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:07.991852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65653237-bfcb-4c12-967c-fb3f73755269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:07.992217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65653237-bfcb-4c12-967c-fb3f73755269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:07.993612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65653237-bfcb-4c12-967c-fb3f73755269 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:08.011215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 414/817] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:08.012498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653237-bfcb-4c12-967c-fb3f73755269 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:08.040286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e563-5518-4ba5-aa26-c3b14f0a9af1 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:08.082941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878be0e7-a27c-4d35-9f2d-928a899af386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:08.084183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878be0e7-a27c-4d35-9f2d-928a899af386 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:08.085037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878be0e7-a27c-4d35-9f2d-928a899af386 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:08.085522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878be0e7-a27c-4d35-9f2d-928a899af386 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:08.086385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878be0e7-a27c-4d35-9f2d-928a899af386 None admin] RBAC: Adding query filter params (name=network) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:08.086927 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878be0e7-a27c-4d35-9f2d-928a899af386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:08.089397 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878be0e7-a27c-4d35-9f2d-928a899af386 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:08.096757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 404/818] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:12:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:08.097872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878be0e7-a27c-4d35-9f2d-928a899af386 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:08.113573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:08.146200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653237-bfcb-4c12-967c-fb3f73755269 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:08.183617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dbd59-7dcf-4d14-a866-dccc322fc779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:08.184272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dbd59-7dcf-4d14-a866-dccc322fc779 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:08.184612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dbd59-7dcf-4d14-a866-dccc322fc779 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:08.184951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dbd59-7dcf-4d14-a866-dccc322fc779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:08.199464 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dbd59-7dcf-4d14-a866-dccc322fc779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:08.201989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dbd59-7dcf-4d14-a866-dccc322fc779 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-051dbd59-7dcf-4d14-a866-dccc322fc779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:08.222299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:08.223277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:08.224349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:08.224349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:08.224349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:08.224349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 415/819] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:08.225123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dbd59-7dcf-4d14-a866-dccc322fc779 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:08.227405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878be0e7-a27c-4d35-9f2d-928a899af386 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:08.262166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:08.268966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20db6e3-5751-4255-8c54-7859016ea8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:08.269685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20db6e3-5751-4255-8c54-7859016ea8dc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:08.270031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20db6e3-5751-4255-8c54-7859016ea8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:08.270369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20db6e3-5751-4255-8c54-7859016ea8dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:08.277742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20db6e3-5751-4255-8c54-7859016ea8dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:08.280222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20db6e3-5751-4255-8c54-7859016ea8dc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b20db6e3-5751-4255-8c54-7859016ea8dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:08.293010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:08.294020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:08.295313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:08.295313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:08.295313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:08.295313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:08.295313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:08.295313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:08.295313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:08.295313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:08.295313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 405/820] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:08.296362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20db6e3-5751-4255-8c54-7859016ea8dc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:08.360043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dbd59-7dcf-4d14-a866-dccc322fc779 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:08.376859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:08.414891 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20db6e3-5751-4255-8c54-7859016ea8dc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:08.416514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67998d2-d2e5-4768-b6e5-202c8f5be364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:08.417344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67998d2-d2e5-4768-b6e5-202c8f5be364 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:08.417884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67998d2-d2e5-4768-b6e5-202c8f5be364 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:08.418352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67998d2-d2e5-4768-b6e5-202c8f5be364 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:08.419171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67998d2-d2e5-4768-b6e5-202c8f5be364 None admin] RBAC: Adding query filter params (type=network) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:08.419767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67998d2-d2e5-4768-b6e5-202c8f5be364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:08.421539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67998d2-d2e5-4768-b6e5-202c8f5be364 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:08.430730 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 416/821] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:12:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:08.431927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67998d2-d2e5-4768-b6e5-202c8f5be364 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:08.456075 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74abf2c-593f-43cb-82ad-d4d0fb694ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:08.456597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74abf2c-593f-43cb-82ad-d4d0fb694ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:08.456874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74abf2c-593f-43cb-82ad-d4d0fb694ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:08.457146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74abf2c-593f-43cb-82ad-d4d0fb694ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:08.457774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74abf2c-593f-43cb-82ad-d4d0fb694ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:08.458077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74abf2c-593f-43cb-82ad-d4d0fb694ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:08.459416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74abf2c-593f-43cb-82ad-d4d0fb694ff8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:08.472137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 406/822] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:08.473032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74abf2c-593f-43cb-82ad-d4d0fb694ff8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:08.558491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:08.569406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67998d2-d2e5-4768-b6e5-202c8f5be364 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:08.599000 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74abf2c-593f-43cb-82ad-d4d0fb694ff8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:08.604837 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c6a90-76eb-4382-bded-8bd513d30269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:08.605437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c6a90-76eb-4382-bded-8bd513d30269 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:08.605710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c6a90-76eb-4382-bded-8bd513d30269 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:08.605976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c6a90-76eb-4382-bded-8bd513d30269 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:08.606655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c6a90-76eb-4382-bded-8bd513d30269 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:08.606948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c6a90-76eb-4382-bded-8bd513d30269 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:08.609373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c6a90-76eb-4382-bded-8bd513d30269 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:08.621677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 417/823] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:08.622558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c6a90-76eb-4382-bded-8bd513d30269 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:08.641139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:08.650312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a36e8-ee91-4994-b3ba-341ea04439b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:08.651288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a36e8-ee91-4994-b3ba-341ea04439b4 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:08.652060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a36e8-ee91-4994-b3ba-341ea04439b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:08.652972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a36e8-ee91-4994-b3ba-341ea04439b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:08.654161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a36e8-ee91-4994-b3ba-341ea04439b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:08.656469 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a36e8-ee91-4994-b3ba-341ea04439b4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:08.684512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 407/824] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:12:08 2022] POST /identity/v3/endpoints => generated 337 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:08.685963 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a36e8-ee91-4994-b3ba-341ea04439b4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:08.786365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c6a90-76eb-4382-bded-8bd513d30269 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:08.829307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a36e8-ee91-4994-b3ba-341ea04439b4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:08.872198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3e06-0dc3-4d42-8305-d8de8ab2d8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:08.874868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3e06-0dc3-4d42-8305-d8de8ab2d8ff None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:08.875361 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3e06-0dc3-4d42-8305-d8de8ab2d8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:08.875864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3e06-0dc3-4d42-8305-d8de8ab2d8ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:08.876851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7081-e5fc-4b07-8c98-5c693bc6bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:08.877132 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b3e06-0dc3-4d42-8305-d8de8ab2d8ff None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=9b5585d29bcb4b03a1902fbf113f48e8) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:08.877488 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7081-e5fc-4b07-8c98-5c693bc6bce6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:08.877762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7081-e5fc-4b07-8c98-5c693bc6bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:08.878030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7081-e5fc-4b07-8c98-5c693bc6bce6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:08.878248 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b3e06-0dc3-4d42-8305-d8de8ab2d8ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:08.880009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b3e06-0dc3-4d42-8305-d8de8ab2d8ff None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:08.888063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 408/825] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:08 2022] GET /identity/v3/role_assignments?user.id=9b5585d29bcb4b03a1902fbf113f48e8&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=4494ba66c3f649febc69511a47e27b67 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:08.899967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7081-e5fc-4b07-8c98-5c693bc6bce6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:08.901475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7081-e5fc-4b07-8c98-5c693bc6bce6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8aea7081-e5fc-4b07-8c98-5c693bc6bce6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:08.923079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:08.924140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:08.925691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:08.925691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:08.925691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:08.925691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:08.925691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:08.925691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:08.925691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:08.925691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:08.925691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:08.925691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:08.925691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 418/826] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 18 06:12:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:08.930214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3e06-0dc3-4d42-8305-d8de8ab2d8ff None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:09.005363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:09.076511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3e06-0dc3-4d42-8305-d8de8ab2d8ff None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:09.116269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc2003-12c9-4ad2-961f-960fc66019f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:09.116882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc2003-12c9-4ad2-961f-960fc66019f7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:09.117163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc2003-12c9-4ad2-961f-960fc66019f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:09.117437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc2003-12c9-4ad2-961f-960fc66019f7 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:09.118171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc2003-12c9-4ad2-961f-960fc66019f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:09.118475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc2003-12c9-4ad2-961f-960fc66019f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:09.119936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc2003-12c9-4ad2-961f-960fc66019f7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:09.141162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 409/827] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 18 06:12:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:09.146799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7081-e5fc-4b07-8c98-5c693bc6bce6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:09.166415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:09.199665 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8f63-2b49-4058-a9b9-d129cce19ebd None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:09.199999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8f63-2b49-4058-a9b9-d129cce19ebd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:09.200252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8f63-2b49-4058-a9b9-d129cce19ebd None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:09.202381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 410/828] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:09.207763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77c349-34cb-482a-941f-20805bbd2200 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:09.208149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77c349-34cb-482a-941f-20805bbd2200 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:09.208432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77c349-34cb-482a-941f-20805bbd2200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:09.229019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cb77c349-34cb-482a-941f-20805bbd2200 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:09.230231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cb77c349-34cb-482a-941f-20805bbd2200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:09.265358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7081-e5fc-4b07-8c98-5c693bc6bce6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:09.301941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e8eee-7cc4-4eb4-b4ee-177632fe8b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:09.302572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e8eee-7cc4-4eb4-b4ee-177632fe8b7d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:09.302907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e8eee-7cc4-4eb4-b4ee-177632fe8b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:09.303183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e8eee-7cc4-4eb4-b4ee-177632fe8b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:09.304609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 411/829] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:09.314016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e8eee-7cc4-4eb4-b4ee-177632fe8b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:09.315486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e8eee-7cc4-4eb4-b4ee-177632fe8b7d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-a95e8eee-7cc4-4eb4-b4ee-177632fe8b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:09.330811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:09.331810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:09.332754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:09.332754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:09.332754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:09.332754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 419/830] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:09.337433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77c349-34cb-482a-941f-20805bbd2200 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:09.388784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:09.441302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77c349-34cb-482a-941f-20805bbd2200 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:09.476695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113a514-f373-4c9a-9df5-750e55844fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:09.477301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a514-f373-4c9a-9df5-750e55844fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:09.477581 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a514-f373-4c9a-9df5-750e55844fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:09.477854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113a514-f373-4c9a-9df5-750e55844fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:09.478491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113a514-f373-4c9a-9df5-750e55844fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:09.478791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113a514-f373-4c9a-9df5-750e55844fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:09.480176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113a514-f373-4c9a-9df5-750e55844fe6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:09.492754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 412/831] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:09.501011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e8eee-7cc4-4eb4-b4ee-177632fe8b7d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:09.567701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:09.612073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113a514-f373-4c9a-9df5-750e55844fe6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:09.612847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e8eee-7cc4-4eb4-b4ee-177632fe8b7d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:09.650109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1c97f-fa2d-4886-a1cb-7d26d5d0777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:09.651121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1c97f-fa2d-4886-a1cb-7d26d5d0777b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:09.651736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1c97f-fa2d-4886-a1cb-7d26d5d0777b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:09.652325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1c97f-fa2d-4886-a1cb-7d26d5d0777b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:09.660132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1c97f-fa2d-4886-a1cb-7d26d5d0777b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:09.661936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1c97f-fa2d-4886-a1cb-7d26d5d0777b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-32e1c97f-fa2d-4886-a1cb-7d26d5d0777b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:09.681655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:09.682602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:09.683491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:09.683491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:09.683491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:09.683491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:09.683491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:09.683491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:09.683491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:09.683491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:09.683491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 420/832] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:09.691511 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1c97f-fa2d-4886-a1cb-7d26d5d0777b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:09.725894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:09.738323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113a514-f373-4c9a-9df5-750e55844fe6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:09.786631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04124e8-4983-4bca-ac73-a8e9d9f0ba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:09.787885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04124e8-4983-4bca-ac73-a8e9d9f0ba49 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:09.788444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04124e8-4983-4bca-ac73-a8e9d9f0ba49 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:09.789295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04124e8-4983-4bca-ac73-a8e9d9f0ba49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:09.804288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04124e8-4983-4bca-ac73-a8e9d9f0ba49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:09.807598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1c97f-fa2d-4886-a1cb-7d26d5d0777b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-b04124e8-4983-4bca-ac73-a8e9d9f0ba49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:09.812444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:09.813374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:09.814243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:09.817063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 413/833] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:12:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:09.823261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04124e8-4983-4bca-ac73-a8e9d9f0ba49 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:09.846877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:09.859426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d316020-c635-47a9-b711-1585cbdf0235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:09.860298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d316020-c635-47a9-b711-1585cbdf0235 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:09.860428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d316020-c635-47a9-b711-1585cbdf0235 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:09.860767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d316020-c635-47a9-b711-1585cbdf0235 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:09.861519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d316020-c635-47a9-b711-1585cbdf0235 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:09.861892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d316020-c635-47a9-b711-1585cbdf0235 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:09.863420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d316020-c635-47a9-b711-1585cbdf0235 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:09.881922 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 421/834] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:09.883364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d316020-c635-47a9-b711-1585cbdf0235 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:09.967990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04124e8-4983-4bca-ac73-a8e9d9f0ba49 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:09.990571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d316020-c635-47a9-b711-1585cbdf0235 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:10.017515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96356ec-6adb-4869-b8a1-dd484eca1699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:10.018714 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96356ec-6adb-4869-b8a1-dd484eca1699 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:10.019706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96356ec-6adb-4869-b8a1-dd484eca1699 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:10.020203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96356ec-6adb-4869-b8a1-dd484eca1699 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:10.021374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96356ec-6adb-4869-b8a1-dd484eca1699 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:10.021889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96356ec-6adb-4869-b8a1-dd484eca1699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:10.024718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96356ec-6adb-4869-b8a1-dd484eca1699 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:10.034989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808cdbe-5c43-453f-9e00-e2f6ba9bf729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:10.036745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cdbe-5c43-453f-9e00-e2f6ba9bf729 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:10.037295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cdbe-5c43-453f-9e00-e2f6ba9bf729 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:10.037768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cdbe-5c43-453f-9e00-e2f6ba9bf729 None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/4734057fc039462d8d04b5dbee141fac/roles/7a2c1ebe84c94165a42716d4de2d3290` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:10.043955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 414/835] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:12:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:10.045582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96356ec-6adb-4869-b8a1-dd484eca1699 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:10.060005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808cdbe-5c43-453f-9e00-e2f6ba9bf729 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=4734057fc039462d8d04b5dbee141fac, role_id=7a2c1ebe84c94165a42716d4de2d3290)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:10.062231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808cdbe-5c43-453f-9e00-e2f6ba9bf729 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:10.064445 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:10.078975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 422/836] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:12:09 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/4734057fc039462d8d04b5dbee141fac/roles/7a2c1ebe84c94165a42716d4de2d3290 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:12:10.133150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1727ad-3d77-4e3f-b8c4-afdefd8dc107 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:10.133439 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1727ad-3d77-4e3f-b8c4-afdefd8dc107 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:10.133615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1727ad-3d77-4e3f-b8c4-afdefd8dc107 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:10.135641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 423/837] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:10.146471 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeefbaa-06f9-4d00-ba42-17a0a2fe2641 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:10.146808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeefbaa-06f9-4d00-ba42-17a0a2fe2641 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:10.147031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeefbaa-06f9-4d00-ba42-17a0a2fe2641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:10.161207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96356ec-6adb-4869-b8a1-dd484eca1699 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:10.173340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ebeefbaa-06f9-4d00-ba42-17a0a2fe2641 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:10.175418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ebeefbaa-06f9-4d00-ba42-17a0a2fe2641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:10.201735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b176d-4adf-4488-9f7f-8089e1a1557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:10.202597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b176d-4adf-4488-9f7f-8089e1a1557a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:10.202872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b176d-4adf-4488-9f7f-8089e1a1557a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:10.203141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b176d-4adf-4488-9f7f-8089e1a1557a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:10.214728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b176d-4adf-4488-9f7f-8089e1a1557a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:10.214930 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:10.217073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b176d-4adf-4488-9f7f-8089e1a1557a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-451b176d-4adf-4488-9f7f-8089e1a1557a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:10.238292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:10.239340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:10.241366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:10.241366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:10.241366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:10.244115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 415/838] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:10.245737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b176d-4adf-4488-9f7f-8089e1a1557a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:10.270699 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 424/839] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:10.324341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:10.357489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b176d-4adf-4488-9f7f-8089e1a1557a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:10.392453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fb58b-7317-4f0d-84f7-92c5ef7cce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:10.392967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fb58b-7317-4f0d-84f7-92c5ef7cce05 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:10.393238 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fb58b-7317-4f0d-84f7-92c5ef7cce05 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:10.393505 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fb58b-7317-4f0d-84f7-92c5ef7cce05 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:10.394136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fb58b-7317-4f0d-84f7-92c5ef7cce05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:10.394431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fb58b-7317-4f0d-84f7-92c5ef7cce05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:10.395782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fb58b-7317-4f0d-84f7-92c5ef7cce05 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:10.408864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 416/840] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:10.414123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeefbaa-06f9-4d00-ba42-17a0a2fe2641 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:10.520175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeefbaa-06f9-4d00-ba42-17a0a2fe2641 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:10.555428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdd014-a3e1-432a-b6c5-96c0bdbe4063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:10.556088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd014-a3e1-432a-b6c5-96c0bdbe4063 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:10.556647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd014-a3e1-432a-b6c5-96c0bdbe4063 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:10.556924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd014-a3e1-432a-b6c5-96c0bdbe4063 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:10.557537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fb58b-7317-4f0d-84f7-92c5ef7cce05 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:10.565859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdd014-a3e1-432a-b6c5-96c0bdbe4063 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:10.567302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdd014-a3e1-432a-b6c5-96c0bdbe4063 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-c5cdd014-a3e1-432a-b6c5-96c0bdbe4063 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:10.579380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:10.580369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:10.581398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:10.581398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:10.581398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:10.581398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:10.581398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:10.581398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:10.581398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:10.581398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:10.581398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 06:12:10.581398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:10.581398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 425/841] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:12:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:10.586030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdd014-a3e1-432a-b6c5-96c0bdbe4063 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:10.614718 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:10.691575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fb58b-7317-4f0d-84f7-92c5ef7cce05 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:10.697396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdd014-a3e1-432a-b6c5-96c0bdbe4063 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:10.725280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:10.736300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28098c61-78ce-4762-a647-4c1b53c95d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:10.737085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098c61-78ce-4762-a647-4c1b53c95d3d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:10.737460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098c61-78ce-4762-a647-4c1b53c95d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:10.737835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098c61-78ce-4762-a647-4c1b53c95d3d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:10.738735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28098c61-78ce-4762-a647-4c1b53c95d3d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:10.739866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f2af-f50f-49d6-9211-0c5dee6cfb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:10.740344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28098c61-78ce-4762-a647-4c1b53c95d3d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:10.740815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f2af-f50f-49d6-9211-0c5dee6cfb3e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:10.741230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f2af-f50f-49d6-9211-0c5dee6cfb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:10.741641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f2af-f50f-49d6-9211-0c5dee6cfb3e None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:10.742627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2f2af-f50f-49d6-9211-0c5dee6cfb3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:10.743069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2f2af-f50f-49d6-9211-0c5dee6cfb3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:10.744754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2f2af-f50f-49d6-9211-0c5dee6cfb3e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-28098c61-78ce-4762-a647-4c1b53c95d3d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:10.751233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:10.752488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 06:12:10.753524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:10.759939 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 417/842] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:12:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:10.762012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28098c61-78ce-4762-a647-4c1b53c95d3d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:10.775790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 426/843] 10.222.0.16 () {56 vars in 1135 bytes} [Sun Sep 18 06:12:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:10.777088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f2af-f50f-49d6-9211-0c5dee6cfb3e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:10.892101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28098c61-78ce-4762-a647-4c1b53c95d3d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:10.896101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:10.922894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f2af-f50f-49d6-9211-0c5dee6cfb3e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:10.929611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1335ab-8bd6-496e-8525-2e8e20cc041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:10.930223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1335ab-8bd6-496e-8525-2e8e20cc041f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:10.930499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1335ab-8bd6-496e-8525-2e8e20cc041f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:10.930770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1335ab-8bd6-496e-8525-2e8e20cc041f None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:10.931396 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1335ab-8bd6-496e-8525-2e8e20cc041f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:10.931749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1335ab-8bd6-496e-8525-2e8e20cc041f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:10.933157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1335ab-8bd6-496e-8525-2e8e20cc041f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:10.942864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 418/844] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:12:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:10.945005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1335ab-8bd6-496e-8525-2e8e20cc041f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:10.969679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e2068-7472-4bbd-b431-7bfee7eac75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:10.970429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e2068-7472-4bbd-b431-7bfee7eac75c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:10.970805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e2068-7472-4bbd-b431-7bfee7eac75c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:10.971170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e2068-7472-4bbd-b431-7bfee7eac75c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:11.017370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:11.065443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e2068-7472-4bbd-b431-7bfee7eac75c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:11.066772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1335ab-8bd6-496e-8525-2e8e20cc041f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:11.067377 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e2068-7472-4bbd-b431-7bfee7eac75c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:11.102579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515930e6-de39-4442-b037-d611677eb368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:11.103483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515930e6-de39-4442-b037-d611677eb368 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:11.103757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515930e6-de39-4442-b037-d611677eb368 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:11.104166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515930e6-de39-4442-b037-d611677eb368 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:11.104984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515930e6-de39-4442-b037-d611677eb368 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:11.105337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515930e6-de39-4442-b037-d611677eb368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:11.106926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515930e6-de39-4442-b037-d611677eb368 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:11.120943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 419/845] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:12:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:11.174990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:11.198208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 427/846] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:12:11.204016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515930e6-de39-4442-b037-d611677eb368 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:11.328226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515930e6-de39-4442-b037-d611677eb368 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:11.357842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:11.365430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a960cb6-6890-4e91-beab-2f6fdb1e7073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:11.366161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a960cb6-6890-4e91-beab-2f6fdb1e7073 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:11.366588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a960cb6-6890-4e91-beab-2f6fdb1e7073 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:11.367096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a960cb6-6890-4e91-beab-2f6fdb1e7073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:11.379462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a960cb6-6890-4e91-beab-2f6fdb1e7073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:11.381223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a960cb6-6890-4e91-beab-2f6fdb1e7073 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:11.396842 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde9582-a382-4f49-bbb7-f1bc7562b6a9 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:11.397164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde9582-a382-4f49-bbb7-f1bc7562b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:11.397448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde9582-a382-4f49-bbb7-f1bc7562b6a9 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5a960cb6-6890-4e91-beab-2f6fdb1e7073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:11.397629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:11.398544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:11.399452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:11.399452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:11.399452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:11.399643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 428/848] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:11.399713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 420/848] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:11.404875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a669eb-fcec-4a27-841a-4a32378101f7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:11.405346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a669eb-fcec-4a27-841a-4a32378101f7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:11.405454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a960cb6-6890-4e91-beab-2f6fdb1e7073 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:11.405639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a669eb-fcec-4a27-841a-4a32378101f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:11.424183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e6a669eb-fcec-4a27-841a-4a32378101f7 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:11.425361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e6a669eb-fcec-4a27-841a-4a32378101f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:11.515622 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a960cb6-6890-4e91-beab-2f6fdb1e7073 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:11.515999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 429/849] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:11.559021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d938a-e53c-470c-9d5e-134b2517b164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:11.559626 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d938a-e53c-470c-9d5e-134b2517b164 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:11.559943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d938a-e53c-470c-9d5e-134b2517b164 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:11.560217 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d938a-e53c-470c-9d5e-134b2517b164 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:11.560851 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d938a-e53c-470c-9d5e-134b2517b164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:11.561151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d938a-e53c-470c-9d5e-134b2517b164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:11.562621 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d938a-e53c-470c-9d5e-134b2517b164 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:11.575338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 421/850] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:11.582041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a669eb-fcec-4a27-841a-4a32378101f7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:11.687128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a669eb-fcec-4a27-841a-4a32378101f7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:11.701543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:11.723236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16c2c-1dca-49a8-8bc9-d5f48bf0c77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:11.723866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16c2c-1dca-49a8-8bc9-d5f48bf0c77c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:11.724171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16c2c-1dca-49a8-8bc9-d5f48bf0c77c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:11.724443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16c2c-1dca-49a8-8bc9-d5f48bf0c77c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:11.731089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa16c2c-1dca-49a8-8bc9-d5f48bf0c77c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:11.733530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa16c2c-1dca-49a8-8bc9-d5f48bf0c77c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0fa16c2c-1dca-49a8-8bc9-d5f48bf0c77c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:11.745542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:11.746455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:11.748190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:11.748190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:11.748190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:11.748190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:11.748190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:11.748190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:11.748190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:11.748190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:11.748190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 430/851] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:11.752601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d938a-e53c-470c-9d5e-134b2517b164 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:11.786954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:11.818953 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16c2c-1dca-49a8-8bc9-d5f48bf0c77c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:11.866894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d938a-e53c-470c-9d5e-134b2517b164 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:11.910360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29453e-6f3a-436e-9bc1-9a0f7901db9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:11.911228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29453e-6f3a-436e-9bc1-9a0f7901db9a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:11.911657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29453e-6f3a-436e-9bc1-9a0f7901db9a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:11.912149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29453e-6f3a-436e-9bc1-9a0f7901db9a None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:11.913252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29453e-6f3a-436e-9bc1-9a0f7901db9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:11.913710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29453e-6f3a-436e-9bc1-9a0f7901db9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:11.916220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29453e-6f3a-436e-9bc1-9a0f7901db9a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:11.929502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 422/852] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:11.935729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29453e-6f3a-436e-9bc1-9a0f7901db9a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:11.969574 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16c2c-1dca-49a8-8bc9-d5f48bf0c77c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:12.018389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c9729-910a-445a-933d-62b2aab2e880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:12.019485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c9729-910a-445a-933d-62b2aab2e880 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:12.019764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c9729-910a-445a-933d-62b2aab2e880 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:12.020072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c9729-910a-445a-933d-62b2aab2e880 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:12.021069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c9729-910a-445a-933d-62b2aab2e880 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:12.023030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c9729-910a-445a-933d-62b2aab2e880 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:12.034695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-212c9729-910a-445a-933d-62b2aab2e880 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:12.036552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:12.037710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 06:12:12.038657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:12.039617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 431/853] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 18 06:12:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:12.046664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c9729-910a-445a-933d-62b2aab2e880 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:12.052886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29453e-6f3a-436e-9bc1-9a0f7901db9a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:12.095538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098db29c-18c8-4589-9d5d-bec3549bf598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:12.095936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:12.096781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098db29c-18c8-4589-9d5d-bec3549bf598 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:12.097253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098db29c-18c8-4589-9d5d-bec3549bf598 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:12.097716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098db29c-18c8-4589-9d5d-bec3549bf598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:12.098737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098db29c-18c8-4589-9d5d-bec3549bf598 None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=3e0f04f474124698a46bed8dac01e30e) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:12.099237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098db29c-18c8-4589-9d5d-bec3549bf598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:12.101036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098db29c-18c8-4589-9d5d-bec3549bf598 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:12.114066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 423/854] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:11 2022] GET /identity/v3/role_assignments?user.id=3e0f04f474124698a46bed8dac01e30e&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=4494ba66c3f649febc69511a47e27b67 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:12.181741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c9729-910a-445a-933d-62b2aab2e880 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:12.220234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc163d-56c7-4ccb-a1f0-6ba96b246017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:12.220863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc163d-56c7-4ccb-a1f0-6ba96b246017 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:12.221139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc163d-56c7-4ccb-a1f0-6ba96b246017 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:12.221406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc163d-56c7-4ccb-a1f0-6ba96b246017 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:12.222042 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc163d-56c7-4ccb-a1f0-6ba96b246017 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:12.222340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc163d-56c7-4ccb-a1f0-6ba96b246017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:12.223719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc163d-56c7-4ccb-a1f0-6ba96b246017 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:12.229207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 432/855] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 18 06:12:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:12.237057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098db29c-18c8-4589-9d5d-bec3549bf598 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:12.353559 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098db29c-18c8-4589-9d5d-bec3549bf598 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:12.390542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc410a-66d0-49af-ac56-d56a78998e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:12.391562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc410a-66d0-49af-ac56-d56a78998e59 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:12.392077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc410a-66d0-49af-ac56-d56a78998e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:12.392557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc410a-66d0-49af-ac56-d56a78998e59 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:12.393446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc410a-66d0-49af-ac56-d56a78998e59 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:12.393976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc410a-66d0-49af-ac56-d56a78998e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:12.395613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc410a-66d0-49af-ac56-d56a78998e59 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:12.400955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 424/856] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 18 06:12:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:12.414612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e782e-8b48-4c37-bc8e-7cf73cd54161 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:12.414942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e782e-8b48-4c37-bc8e-7cf73cd54161 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:12.415164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e782e-8b48-4c37-bc8e-7cf73cd54161 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:12.416927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 433/857] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:12.423475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fa861-2927-4713-8e02-39ad15d3e338 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:12.423794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fa861-2927-4713-8e02-39ad15d3e338 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:12.424076 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fa861-2927-4713-8e02-39ad15d3e338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:12.444705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-004fa861-2927-4713-8e02-39ad15d3e338 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:12.445932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-004fa861-2927-4713-8e02-39ad15d3e338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:12.462615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:12.527885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 425/858] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:12.803708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e782e-8b48-4c37-bc8e-7cf73cd54161 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:12.920904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:12.925302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e782e-8b48-4c37-bc8e-7cf73cd54161 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:12.961979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379fc8-0636-4646-9a69-19a6a8e1d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:12.962993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379fc8-0636-4646-9a69-19a6a8e1d907 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:12.963474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379fc8-0636-4646-9a69-19a6a8e1d907 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:12.964022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379fc8-0636-4646-9a69-19a6a8e1d907 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:12.975125 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a379fc8-0636-4646-9a69-19a6a8e1d907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-2a379fc8-0636-4646-9a69-19a6a8e1d907 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:12.980746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:12.982221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:12:12.983057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:12.985733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 434/859] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:12.991332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fa861-2927-4713-8e02-39ad15d3e338 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:13.095775 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fa861-2927-4713-8e02-39ad15d3e338 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:13.134188 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41154ac9-10c8-4071-98a4-fa59ec476e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:13.135191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41154ac9-10c8-4071-98a4-fa59ec476e3d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:13.135716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41154ac9-10c8-4071-98a4-fa59ec476e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:13.136256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41154ac9-10c8-4071-98a4-fa59ec476e3d None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:13.137166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41154ac9-10c8-4071-98a4-fa59ec476e3d None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:13.137680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41154ac9-10c8-4071-98a4-fa59ec476e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:13.139977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41154ac9-10c8-4071-98a4-fa59ec476e3d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:13.149288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 426/860] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:13.156170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379fc8-0636-4646-9a69-19a6a8e1d907 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:13.260436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379fc8-0636-4646-9a69-19a6a8e1d907 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:13.305386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0228d-a916-4dfd-887e-3763afea59b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:13.306379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0228d-a916-4dfd-887e-3763afea59b1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:13.306880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0228d-a916-4dfd-887e-3763afea59b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:13.307378 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0228d-a916-4dfd-887e-3763afea59b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:13.318193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0228d-a916-4dfd-887e-3763afea59b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:13.319854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0228d-a916-4dfd-887e-3763afea59b1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-9cd0228d-a916-4dfd-887e-3763afea59b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:13.335532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:13.336538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:13.337437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:13.337437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:13.337437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:13.339476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 435/861] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:13.344941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41154ac9-10c8-4071-98a4-fa59ec476e3d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:13.361808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:13.388313 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c44b4e-251e-4cf7-b28f-014eeeab735d None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:13.388789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c44b4e-251e-4cf7-b28f-014eeeab735d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:13.389182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c44b4e-251e-4cf7-b28f-014eeeab735d None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:13.390850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 436/862] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:13.395796 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b086271-4ff2-4f11-b9d9-cec2754ac481 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:13.396105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b086271-4ff2-4f11-b9d9-cec2754ac481 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:13.396380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b086271-4ff2-4f11-b9d9-cec2754ac481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:13.416398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7b086271-4ff2-4f11-b9d9-cec2754ac481 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:13.417672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7b086271-4ff2-4f11-b9d9-cec2754ac481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:13.426421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:13.470072 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41154ac9-10c8-4071-98a4-fa59ec476e3d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:13.504202 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 437/863] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:13.517629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc5f7f-652c-4b4d-bcc7-3798617e1c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:13.518431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5f7f-652c-4b4d-bcc7-3798617e1c21 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:13.518770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5f7f-652c-4b4d-bcc7-3798617e1c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:13.519053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5f7f-652c-4b4d-bcc7-3798617e1c21 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:13.519809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc5f7f-652c-4b4d-bcc7-3798617e1c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:13.520191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc5f7f-652c-4b4d-bcc7-3798617e1c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:13.521669 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc5f7f-652c-4b4d-bcc7-3798617e1c21 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:13.536031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 427/864] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:13.541503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b086271-4ff2-4f11-b9d9-cec2754ac481 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:13.647701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b086271-4ff2-4f11-b9d9-cec2754ac481 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:13.682340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4800d-0be3-4aaf-bf6d-a8a130fda581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:13.683277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4800d-0be3-4aaf-bf6d-a8a130fda581 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:13.683789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4800d-0be3-4aaf-bf6d-a8a130fda581 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:13.684277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4800d-0be3-4aaf-bf6d-a8a130fda581 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:13.692249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4800d-0be3-4aaf-bf6d-a8a130fda581 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:13.693908 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4800d-0be3-4aaf-bf6d-a8a130fda581 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-c4b4800d-0be3-4aaf-bf6d-a8a130fda581 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:13.705935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:13.706873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:13.707852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:13.707852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:13.707852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:13.707852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:13.707852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:13.707852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:13.707852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:13.707852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:13.707852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:13.707852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:13.710318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 438/865] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 18 06:12:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:13.718783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc5f7f-652c-4b4d-bcc7-3798617e1c21 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:13.787015 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:13.810577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4800d-0be3-4aaf-bf6d-a8a130fda581 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:13.813804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:13.836619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc5f7f-652c-4b4d-bcc7-3798617e1c21 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:13.874732 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2e819-fa30-4e4c-a60e-4ae0e89da3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:13.875518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2e819-fa30-4e4c-a60e-4ae0e89da3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:13.875806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2e819-fa30-4e4c-a60e-4ae0e89da3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:13.876116 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2e819-fa30-4e4c-a60e-4ae0e89da3d4 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:13.877014 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2e819-fa30-4e4c-a60e-4ae0e89da3d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:13.877322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2e819-fa30-4e4c-a60e-4ae0e89da3d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:13.879470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2e819-fa30-4e4c-a60e-4ae0e89da3d4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:13.899936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 428/866] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 18 06:12:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:13.905351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2e819-fa30-4e4c-a60e-4ae0e89da3d4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:13.951467 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4800d-0be3-4aaf-bf6d-a8a130fda581 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:13.999669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0045aa7-f645-499e-9ab7-e60d22dfe72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:14.000504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0045aa7-f645-499e-9ab7-e60d22dfe72a None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:14.000892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0045aa7-f645-499e-9ab7-e60d22dfe72a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:14.001270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0045aa7-f645-499e-9ab7-e60d22dfe72a None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:14.002453 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0045aa7-f645-499e-9ab7-e60d22dfe72a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:14.004219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0045aa7-f645-499e-9ab7-e60d22dfe72a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:14.015514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2e819-fa30-4e4c-a60e-4ae0e89da3d4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:14.026157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 439/867] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:12:13 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:14.054150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:14.069082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e3fe6-3ea0-44ae-b48e-74aee966124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:14.069756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e3fe6-3ea0-44ae-b48e-74aee966124c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:14.070040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e3fe6-3ea0-44ae-b48e-74aee966124c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:14.070312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e3fe6-3ea0-44ae-b48e-74aee966124c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:14.151462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e3fe6-3ea0-44ae-b48e-74aee966124c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:14.152878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e3fe6-3ea0-44ae-b48e-74aee966124c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:14.262024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 429/868] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:13 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:12:14.267609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0045aa7-f645-499e-9ab7-e60d22dfe72a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:14.334261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:14.383207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0045aa7-f645-499e-9ab7-e60d22dfe72a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:14.419368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9533e4-d6d5-4591-95ef-34389a7f23b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:14.420199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9533e4-d6d5-4591-95ef-34389a7f23b8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:14.420546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9533e4-d6d5-4591-95ef-34389a7f23b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:14.420893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9533e4-d6d5-4591-95ef-34389a7f23b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:14.437003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9533e4-d6d5-4591-95ef-34389a7f23b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:14.438569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9533e4-d6d5-4591-95ef-34389a7f23b8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-2e9533e4-d6d5-4591-95ef-34389a7f23b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:14.453820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:14.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:14.456351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:14.456351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:14.456351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:14.457692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 440/869] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:14.462510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e3fe6-3ea0-44ae-b48e-74aee966124c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:14.481414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afc180-8ec8-4f16-9686-897d14887baf None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:14.482280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afc180-8ec8-4f16-9686-897d14887baf None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:14.482504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afc180-8ec8-4f16-9686-897d14887baf None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:14.484115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 441/870] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:14.489311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300339ef-e05d-4214-b50a-0930fa3b9a01 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:14.489576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300339ef-e05d-4214-b50a-0930fa3b9a01 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:14.489853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300339ef-e05d-4214-b50a-0930fa3b9a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:14.492182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:14.512204 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-300339ef-e05d-4214-b50a-0930fa3b9a01 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:14.513811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-300339ef-e05d-4214-b50a-0930fa3b9a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:14.581504 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e3fe6-3ea0-44ae-b48e-74aee966124c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:14.595391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 442/871] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:14 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:14.625414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e999c9-a8b8-40b5-8068-b1a68a0f3c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:14.626018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e999c9-a8b8-40b5-8068-b1a68a0f3c20 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:14.626293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e999c9-a8b8-40b5-8068-b1a68a0f3c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:14.626563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e999c9-a8b8-40b5-8068-b1a68a0f3c20 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:14.627202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e999c9-a8b8-40b5-8068-b1a68a0f3c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:14.627499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e999c9-a8b8-40b5-8068-b1a68a0f3c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:14.628916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e999c9-a8b8-40b5-8068-b1a68a0f3c20 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:14.642245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 430/872] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:14.648060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300339ef-e05d-4214-b50a-0930fa3b9a01 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:14.701320 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:14.763320 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b2bbd-f8b4-44b1-b5c4-ff0b2d4a6a91 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:14.763730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b2bbd-f8b4-44b1-b5c4-ff0b2d4a6a91 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:14.764073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b2bbd-f8b4-44b1-b5c4-ff0b2d4a6a91 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:14.765556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 431/873] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:14.768729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300339ef-e05d-4214-b50a-0930fa3b9a01 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:14.770863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0ff7-f29f-4630-bb87-794e15066b7e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:14.771369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0ff7-f29f-4630-bb87-794e15066b7e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:14.771861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0ff7-f29f-4630-bb87-794e15066b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:14.791635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2cdb0ff7-f29f-4630-bb87-794e15066b7e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:14.793671 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2cdb0ff7-f29f-4630-bb87-794e15066b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:14.805619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a42c6-a2ae-48c2-852c-d43ec69a0d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:14.806251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a42c6-a2ae-48c2-852c-d43ec69a0d61 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:14.806526 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a42c6-a2ae-48c2-852c-d43ec69a0d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:14.806795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a42c6-a2ae-48c2-852c-d43ec69a0d61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:14.814383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a42c6-a2ae-48c2-852c-d43ec69a0d61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:14.815841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a42c6-a2ae-48c2-852c-d43ec69a0d61 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-3b9a42c6-a2ae-48c2-852c-d43ec69a0d61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:14.827246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:14.828253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:14.829184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:14.829184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:14.829184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:14.829184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:14.829184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:14.829184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:14.829184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:14.829184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:14.829184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 443/874] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:14.836388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a42c6-a2ae-48c2-852c-d43ec69a0d61 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:14.890322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 432/875] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:14 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:14.904199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb0ff7-f29f-4630-bb87-794e15066b7e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:14.923214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:14.981172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a42c6-a2ae-48c2-852c-d43ec69a0d61 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:14.984466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:15.011896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb0ff7-f29f-4630-bb87-794e15066b7e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:15.028217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09565b-2483-410c-9c00-9f5462e644ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:15.029904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09565b-2483-410c-9c00-9f5462e644ab None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:15.030355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09565b-2483-410c-9c00-9f5462e644ab None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:15.031005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09565b-2483-410c-9c00-9f5462e644ab None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:15.032285 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09565b-2483-410c-9c00-9f5462e644ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:15.032769 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09565b-2483-410c-9c00-9f5462e644ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:15.034406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09565b-2483-410c-9c00-9f5462e644ab None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:15.052026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f101a-73bd-412a-a54d-9fcb8657ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:15.052725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f101a-73bd-412a-a54d-9fcb8657ad7e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:15.053003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f101a-73bd-412a-a54d-9fcb8657ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:15.058082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f101a-73bd-412a-a54d-9fcb8657ad7e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:15.058082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f101a-73bd-412a-a54d-9fcb8657ad7e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:15.058082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f101a-73bd-412a-a54d-9fcb8657ad7e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:15.058799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 444/876] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:15.060396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09565b-2483-410c-9c00-9f5462e644ab None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-907f101a-73bd-412a-a54d-9fcb8657ad7e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:15.068997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:15.070297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:15.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:15.076440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 433/877] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 18 06:12:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:15.078400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f101a-73bd-412a-a54d-9fcb8657ad7e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:15.173360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:15.189873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09565b-2483-410c-9c00-9f5462e644ab None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:15.196279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f101a-73bd-412a-a54d-9fcb8657ad7e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:15.225190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684476a-4cb7-43d9-af0b-e005d10063dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:15.225787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684476a-4cb7-43d9-af0b-e005d10063dd None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:15.226072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684476a-4cb7-43d9-af0b-e005d10063dd None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:15.226338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684476a-4cb7-43d9-af0b-e005d10063dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:15.227049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684476a-4cb7-43d9-af0b-e005d10063dd None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=4734057fc039462d8d04b5dbee141fac) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:15.227352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684476a-4cb7-43d9-af0b-e005d10063dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:15.228806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684476a-4cb7-43d9-af0b-e005d10063dd None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:15.232190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa01d5-8a56-44a2-b5c8-23cc9b5a1722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:15.232879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa01d5-8a56-44a2-b5c8-23cc9b5a1722 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:15.233160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa01d5-8a56-44a2-b5c8-23cc9b5a1722 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:15.233430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa01d5-8a56-44a2-b5c8-23cc9b5a1722 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:15.234049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa01d5-8a56-44a2-b5c8-23cc9b5a1722 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:15.234348 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa01d5-8a56-44a2-b5c8-23cc9b5a1722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:15.240182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 445/878] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:15 2022] GET /identity/v3/role_assignments?user.id=4734057fc039462d8d04b5dbee141fac&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:15.240345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa01d5-8a56-44a2-b5c8-23cc9b5a1722 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:15.240438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684476a-4cb7-43d9-af0b-e005d10063dd None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:15.252491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 434/879] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 18 06:12:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:15.259357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa01d5-8a56-44a2-b5c8-23cc9b5a1722 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:15.276104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:15.372548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684476a-4cb7-43d9-af0b-e005d10063dd None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:15.393101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa01d5-8a56-44a2-b5c8-23cc9b5a1722 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:15.417491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d1e96-5b7d-4d8f-9c7d-127861d5ca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:15.418274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d1e96-5b7d-4d8f-9c7d-127861d5ca95 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:15.418689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d1e96-5b7d-4d8f-9c7d-127861d5ca95 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:15.418968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d1e96-5b7d-4d8f-9c7d-127861d5ca95 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:15.420642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d1e96-5b7d-4d8f-9c7d-127861d5ca95 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:15.422883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d1e96-5b7d-4d8f-9c7d-127861d5ca95 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:15.436251 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd74915-5dda-4e74-a470-8696cac351b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:15.436835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd74915-5dda-4e74-a470-8696cac351b6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:15.437256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd74915-5dda-4e74-a470-8696cac351b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:15.437492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd74915-5dda-4e74-a470-8696cac351b6 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:15.438898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd74915-5dda-4e74-a470-8696cac351b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:15.439202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd74915-5dda-4e74-a470-8696cac351b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:15.441052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd74915-5dda-4e74-a470-8696cac351b6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:15.443408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 446/880] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:12:15 2022] POST /identity/v3/services => generated 269 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:15.448200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 435/881] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 18 06:12:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:16.368057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145517e-e96e-4439-9dc8-1b495c67466b None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:16.368616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145517e-e96e-4439-9dc8-1b495c67466b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:16.368616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145517e-e96e-4439-9dc8-1b495c67466b None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:16.370321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 447/882] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:16.376757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2d6a2-5066-4a5e-bd93-7ea8b65b370a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:16.377400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2d6a2-5066-4a5e-bd93-7ea8b65b370a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:16.377400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2d6a2-5066-4a5e-bd93-7ea8b65b370a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:16.397429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-82d2d6a2-5066-4a5e-bd93-7ea8b65b370a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:16.398619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-82d2d6a2-5066-4a5e-bd93-7ea8b65b370a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:16.400637 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:16.474025 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 436/883] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:16.746763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145517e-e96e-4439-9dc8-1b495c67466b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:16.845288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:16.859944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145517e-e96e-4439-9dc8-1b495c67466b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:16.896076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45ef6f-877c-4a84-92da-ad159f06c8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:16.896703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45ef6f-877c-4a84-92da-ad159f06c8ea None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:16.896985 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45ef6f-877c-4a84-92da-ad159f06c8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:16.897264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45ef6f-877c-4a84-92da-ad159f06c8ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:16.897844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45ef6f-877c-4a84-92da-ad159f06c8ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:16.899298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45ef6f-877c-4a84-92da-ad159f06c8ea None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-3f45ef6f-877c-4a84-92da-ad159f06c8ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:16.908112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:16.909098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:16.909924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 448/884] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:12:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:16.915107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2d6a2-5066-4a5e-bd93-7ea8b65b370a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:17.017766 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2d6a2-5066-4a5e-bd93-7ea8b65b370a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:17.054125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8889dff-0cc1-4268-a048-8e25cfc3a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:17.055086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889dff-0cc1-4268-a048-8e25cfc3a679 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:17.055585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889dff-0cc1-4268-a048-8e25cfc3a679 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:17.056099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889dff-0cc1-4268-a048-8e25cfc3a679 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:17.056922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8889dff-0cc1-4268-a048-8e25cfc3a679 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:17.057424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8889dff-0cc1-4268-a048-8e25cfc3a679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:17.058997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8889dff-0cc1-4268-a048-8e25cfc3a679 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:17.064475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 437/885] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:12:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:17.068104 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:17.072119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45ef6f-877c-4a84-92da-ad159f06c8ea None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:17.176606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45ef6f-877c-4a84-92da-ad159f06c8ea None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:17.212669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229241f-dd62-4eb2-9d29-eee2f53390d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:17.213666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229241f-dd62-4eb2-9d29-eee2f53390d4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:17.214151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229241f-dd62-4eb2-9d29-eee2f53390d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:17.214645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229241f-dd62-4eb2-9d29-eee2f53390d4 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:17.215476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229241f-dd62-4eb2-9d29-eee2f53390d4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:17.216529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229241f-dd62-4eb2-9d29-eee2f53390d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:17.218122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229241f-dd62-4eb2-9d29-eee2f53390d4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:17.223721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 449/886] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:12:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:17.229854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8889dff-0cc1-4268-a048-8e25cfc3a679 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:17.333196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8889dff-0cc1-4268-a048-8e25cfc3a679 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:17.369280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00cb4b-6a7a-4c3b-a5d9-3a8272ce6461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:17.370300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00cb4b-6a7a-4c3b-a5d9-3a8272ce6461 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:17.370794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00cb4b-6a7a-4c3b-a5d9-3a8272ce6461 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:17.371277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00cb4b-6a7a-4c3b-a5d9-3a8272ce6461 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:17.372746 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00cb4b-6a7a-4c3b-a5d9-3a8272ce6461 None admin] RBAC: Adding query filter params (interface=public, service_id=cafc5dc2a3464052b554cf55af7a1806, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:17.373432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00cb4b-6a7a-4c3b-a5d9-3a8272ce6461 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:17.375091 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00cb4b-6a7a-4c3b-a5d9-3a8272ce6461 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:17.381162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 438/887] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 18 06:12:17 2022] GET /identity/v3/endpoints?service_id=cafc5dc2a3464052b554cf55af7a1806&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:17.387432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229241f-dd62-4eb2-9d29-eee2f53390d4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:17.408060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:17.496669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229241f-dd62-4eb2-9d29-eee2f53390d4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:17.532745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75296aee-f074-4a23-b020-8e54130ab4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:17.533363 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75296aee-f074-4a23-b020-8e54130ab4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:17.533643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75296aee-f074-4a23-b020-8e54130ab4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:17.533922 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75296aee-f074-4a23-b020-8e54130ab4e1 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:17.534527 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75296aee-f074-4a23-b020-8e54130ab4e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:17.535919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75296aee-f074-4a23-b020-8e54130ab4e1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:17.542167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 450/888] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 18 06:12:17 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:12:17.558970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d39c3-3c80-4c8d-a380-3d48330ab7dc None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:17.559290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d39c3-3c80-4c8d-a380-3d48330ab7dc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:17.559584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d39c3-3c80-4c8d-a380-3d48330ab7dc None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:17.561220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 439/889] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:17.567723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f75032-2dc3-4f22-b8b8-95e79d8e1b53 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:17.568184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f75032-2dc3-4f22-b8b8-95e79d8e1b53 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:17.568562 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f75032-2dc3-4f22-b8b8-95e79d8e1b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:17.588877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a7f75032-2dc3-4f22-b8b8-95e79d8e1b53 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:17.590177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a7f75032-2dc3-4f22-b8b8-95e79d8e1b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:17.676555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 451/890] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:17.738355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac3550-c183-4d78-9ef7-39f33d25e1fc None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:17.738628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac3550-c183-4d78-9ef7-39f33d25e1fc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:17.738903 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac3550-c183-4d78-9ef7-39f33d25e1fc None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:17.740740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 440/891] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:17.746311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab381497-dabb-451c-8e61-7a16a9a8f81a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:17.746849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab381497-dabb-451c-8e61-7a16a9a8f81a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:17.747278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845198-c127-4457-93c4-c0f4ca2eeda4 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:17.747418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab381497-dabb-451c-8e61-7a16a9a8f81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:17.747924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845198-c127-4457-93c4-c0f4ca2eeda4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:17.748417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845198-c127-4457-93c4-c0f4ca2eeda4 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:17.750118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 441/892] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:17.756924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bd1b2-6762-4090-8c4f-487978df5203 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:17.757405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bd1b2-6762-4090-8c4f-487978df5203 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:17.757830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bd1b2-6762-4090-8c4f-487978df5203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:17.766782 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ab381497-dabb-451c-8e61-7a16a9a8f81a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:17.768019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ab381497-dabb-451c-8e61-7a16a9a8f81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:17.770967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:17.785192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-be0bd1b2-6762-4090-8c4f-487978df5203 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:17.786498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-be0bd1b2-6762-4090-8c4f-487978df5203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:17.852322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 452/893] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:17.856991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:17.870121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 442/894] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:17.962023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab381497-dabb-451c-8e61-7a16a9a8f81a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:18.065519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab381497-dabb-451c-8e61-7a16a9a8f81a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:18.104515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57023699-a70b-421e-a6c3-a8872d75e2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:18.105057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57023699-a70b-421e-a6c3-a8872d75e2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:18.105331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57023699-a70b-421e-a6c3-a8872d75e2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:18.105599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57023699-a70b-421e-a6c3-a8872d75e2d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:18.113881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:18.117049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57023699-a70b-421e-a6c3-a8872d75e2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-57023699-a70b-421e-a6c3-a8872d75e2d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:18.122541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:18.123487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:18.124822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 453/895] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 18 06:12:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:18.132048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bd1b2-6762-4090-8c4f-487978df5203 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:18.137833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57023699-a70b-421e-a6c3-a8872d75e2d9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:18.239105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bd1b2-6762-4090-8c4f-487978df5203 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:18.249189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57023699-a70b-421e-a6c3-a8872d75e2d9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:18.278053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5385eb-d69c-48aa-a5d9-dc8929641555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:18.279382 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5385eb-d69c-48aa-a5d9-dc8929641555 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:18.279660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5385eb-d69c-48aa-a5d9-dc8929641555 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:18.279944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5385eb-d69c-48aa-a5d9-dc8929641555 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:18.280594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5385eb-d69c-48aa-a5d9-dc8929641555 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:18.280890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5385eb-d69c-48aa-a5d9-dc8929641555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:18.282306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5385eb-d69c-48aa-a5d9-dc8929641555 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:18.284226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9461e7-f47d-49fd-81fc-3ea8d8213428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:18.284858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9461e7-f47d-49fd-81fc-3ea8d8213428 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:18.285137 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9461e7-f47d-49fd-81fc-3ea8d8213428 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:18.285410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9461e7-f47d-49fd-81fc-3ea8d8213428 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:18.285989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9461e7-f47d-49fd-81fc-3ea8d8213428 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:18.287342 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9461e7-f47d-49fd-81fc-3ea8d8213428 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:18.296231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 443/896] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 18 06:12:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-fa9461e7-f47d-49fd-81fc-3ea8d8213428 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:18.296783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:18.297709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 06:12:18.298589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:18.299324 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5385eb-d69c-48aa-a5d9-dc8929641555 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:18.302655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 454/897] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 18 06:12:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:18.303386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9461e7-f47d-49fd-81fc-3ea8d8213428 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:18.357351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:18.366527 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:18.408783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5385eb-d69c-48aa-a5d9-dc8929641555 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:18.409348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9461e7-f47d-49fd-81fc-3ea8d8213428 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:18.444695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88cab7-7618-4d48-b308-038a1b46f20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:18.445328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88cab7-7618-4d48-b308-038a1b46f20d None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:18.445431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b3eba-4e18-4831-ba71-9c1fe0dfa9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:18.445605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88cab7-7618-4d48-b308-038a1b46f20d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:18.445994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b3eba-4e18-4831-ba71-9c1fe0dfa9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:18.446116 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88cab7-7618-4d48-b308-038a1b46f20d None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:18.446508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b3eba-4e18-4831-ba71-9c1fe0dfa9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:18.446713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88cab7-7618-4d48-b308-038a1b46f20d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:18.447067 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b3eba-4e18-4831-ba71-9c1fe0dfa9e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:18.448118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88cab7-7618-4d48-b308-038a1b46f20d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:18.459226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b3eba-4e18-4831-ba71-9c1fe0dfa9e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:18.460899 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b3eba-4e18-4831-ba71-9c1fe0dfa9e3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:18.471931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 444/898] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:12:18 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:18.471931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88cab7-7618-4d48-b308-038a1b46f20d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7c6b3eba-4e18-4831-ba71-9c1fe0dfa9e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:18.476103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:18.477261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:18.478218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:18.478218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:18.478218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:18.482889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 455/899] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:18.484386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b3eba-4e18-4831-ba71-9c1fe0dfa9e3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:18.601741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b3eba-4e18-4831-ba71-9c1fe0dfa9e3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:18.620551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:18.621045 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88cab7-7618-4d48-b308-038a1b46f20d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:18.637351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:18.645732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99e912-e736-4b11-84dc-2273abe787d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:18.646340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99e912-e736-4b11-84dc-2273abe787d4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:18.646778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99e912-e736-4b11-84dc-2273abe787d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:18.647050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99e912-e736-4b11-84dc-2273abe787d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:18.648649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99e912-e736-4b11-84dc-2273abe787d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:18.648970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99e912-e736-4b11-84dc-2273abe787d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:18.650603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99e912-e736-4b11-84dc-2273abe787d4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:18.673158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 456/900] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:18.673882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d927e-c3e5-4581-811f-e016ff53f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:18.674555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99e912-e736-4b11-84dc-2273abe787d4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:18.674918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d927e-c3e5-4581-811f-e016ff53f978 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:18.675442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d927e-c3e5-4581-811f-e016ff53f978 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:18.675921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d927e-c3e5-4581-811f-e016ff53f978 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:18.676733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d927e-c3e5-4581-811f-e016ff53f978 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:18.677206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d927e-c3e5-4581-811f-e016ff53f978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:18.678964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d927e-c3e5-4581-811f-e016ff53f978 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:18.685572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 445/901] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 18 06:12:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:18.692568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d927e-c3e5-4581-811f-e016ff53f978 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:18.791074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99e912-e736-4b11-84dc-2273abe787d4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:18.835524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83af21-15c6-4f10-b0a4-eb06151a545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:18.835524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83af21-15c6-4f10-b0a4-eb06151a545e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:18.835524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83af21-15c6-4f10-b0a4-eb06151a545e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:18.835524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83af21-15c6-4f10-b0a4-eb06151a545e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:18.837596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d927e-c3e5-4581-811f-e016ff53f978 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:18.841708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83af21-15c6-4f10-b0a4-eb06151a545e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:18.843439 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83af21-15c6-4f10-b0a4-eb06151a545e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-fb83af21-15c6-4f10-b0a4-eb06151a545e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:18.855672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:18.857084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:18.858187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:18.858187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:18.858187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:18.858187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:18.858187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:18.858187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:18.858187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:18.858187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:18.858187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:18.858187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:18.860247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 457/902] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 18 06:12:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:18.865656 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83af21-15c6-4f10-b0a4-eb06151a545e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:18.880741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ef902-8981-4293-8206-b604b8d4927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:18.882013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef902-8981-4293-8206-b604b8d4927f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:18.882703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef902-8981-4293-8206-b604b8d4927f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:18.883126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef902-8981-4293-8206-b604b8d4927f None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:18.884043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ef902-8981-4293-8206-b604b8d4927f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:18.884489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ef902-8981-4293-8206-b604b8d4927f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:18.886118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ef902-8981-4293-8206-b604b8d4927f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:18.893402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 446/903] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 18 06:12:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:18.903936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ef902-8981-4293-8206-b604b8d4927f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:18.907588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:18.977603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83af21-15c6-4f10-b0a4-eb06151a545e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:18.978215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:19.014782 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429165f-b31b-40bd-bb8b-e833ef5b9d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:19.015389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429165f-b31b-40bd-bb8b-e833ef5b9d7b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:19.015667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429165f-b31b-40bd-bb8b-e833ef5b9d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:19.015968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429165f-b31b-40bd-bb8b-e833ef5b9d7b None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:19.016749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429165f-b31b-40bd-bb8b-e833ef5b9d7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:19.017053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429165f-b31b-40bd-bb8b-e833ef5b9d7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:19.018488 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429165f-b31b-40bd-bb8b-e833ef5b9d7b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:19.035482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ef902-8981-4293-8206-b604b8d4927f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:19.036839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 458/904] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 18 06:12:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:19.043481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429165f-b31b-40bd-bb8b-e833ef5b9d7b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:19.076683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2cedd-6b13-4d32-a489-531ad8bda2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:19.077291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2cedd-6b13-4d32-a489-531ad8bda2ba None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:19.077570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2cedd-6b13-4d32-a489-531ad8bda2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:19.077840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2cedd-6b13-4d32-a489-531ad8bda2ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:19.078532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2cedd-6b13-4d32-a489-531ad8bda2ba None admin] RBAC: Adding query filter params (interface=public, service_id=c2067e5dd42e4e87ab9c89f0da544f5d, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:19.078842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2cedd-6b13-4d32-a489-531ad8bda2ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:19.080235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2cedd-6b13-4d32-a489-531ad8bda2ba None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:19.085667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 447/905] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 18 06:12:18 2022] GET /identity/v3/endpoints?service_id=c2067e5dd42e4e87ab9c89f0da544f5d&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:19.093343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2cedd-6b13-4d32-a489-531ad8bda2ba None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:19.158126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:19.164913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429165f-b31b-40bd-bb8b-e833ef5b9d7b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:19.202049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559b7fd-eed5-4b90-aeef-aecbd7fc0a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:19.202876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b7fd-eed5-4b90-aeef-aecbd7fc0a6b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:19.203251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b7fd-eed5-4b90-aeef-aecbd7fc0a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:19.203665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b7fd-eed5-4b90-aeef-aecbd7fc0a6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:19.219558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2cedd-6b13-4d32-a489-531ad8bda2ba None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:19.221418 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:19.261060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3feb8-e050-40ba-a503-1525d8cd3547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:19.261948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3feb8-e050-40ba-a503-1525d8cd3547 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:19.262358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3feb8-e050-40ba-a503-1525d8cd3547 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:19.263451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3feb8-e050-40ba-a503-1525d8cd3547 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:19.264244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3feb8-e050-40ba-a503-1525d8cd3547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:19.265999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3feb8-e050-40ba-a503-1525d8cd3547 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:19.278824 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 448/906] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 18 06:12:19 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:12:19.294629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559b7fd-eed5-4b90-aeef-aecbd7fc0a6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:19.296465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559b7fd-eed5-4b90-aeef-aecbd7fc0a6b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:19.406457 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:19.415474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 459/907] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 18 06:12:19.422729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3feb8-e050-40ba-a503-1525d8cd3547 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:19.536367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3feb8-e050-40ba-a503-1525d8cd3547 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:19.573069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ac19b-6c0f-4159-9c62-7c35716287ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:19.573697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ac19b-6c0f-4159-9c62-7c35716287ae None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:19.573974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ac19b-6c0f-4159-9c62-7c35716287ae None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:19.574247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ac19b-6c0f-4159-9c62-7c35716287ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:19.585408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ac19b-6c0f-4159-9c62-7c35716287ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:19.586915 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ac19b-6c0f-4159-9c62-7c35716287ae None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-be6ac19b-6c0f-4159-9c62-7c35716287ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:19.602335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:19.603279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:19.604376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:19.604376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:19.604376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:19.604376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 449/908] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:19.610752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559b7fd-eed5-4b90-aeef-aecbd7fc0a6b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:19.717003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559b7fd-eed5-4b90-aeef-aecbd7fc0a6b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:19.757732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671dd86-d4d8-4b9e-9d77-559bf87875a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:19.758346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671dd86-d4d8-4b9e-9d77-559bf87875a0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:19.758627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671dd86-d4d8-4b9e-9d77-559bf87875a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:19.758900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671dd86-d4d8-4b9e-9d77-559bf87875a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:19.759546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671dd86-d4d8-4b9e-9d77-559bf87875a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:19.759848 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671dd86-d4d8-4b9e-9d77-559bf87875a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:19.761254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671dd86-d4d8-4b9e-9d77-559bf87875a0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:19.776721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 460/909] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:19.782531 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ac19b-6c0f-4159-9c62-7c35716287ae None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:19.806235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:19.853556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f780d-2d74-47ed-94c8-3795b90d4dfa None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:19.853870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f780d-2d74-47ed-94c8-3795b90d4dfa None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:19.854111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f780d-2d74-47ed-94c8-3795b90d4dfa None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:19.855693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 461/910] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:19.861190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93a7b-0cfe-481e-9330-e0b5fd0fcae2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:19.861477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93a7b-0cfe-481e-9330-e0b5fd0fcae2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:19.861757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93a7b-0cfe-481e-9330-e0b5fd0fcae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:19.882776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-36d93a7b-0cfe-481e-9330-e0b5fd0fcae2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:19.884581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-36d93a7b-0cfe-481e-9330-e0b5fd0fcae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:19.905289 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ac19b-6c0f-4159-9c62-7c35716287ae None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:19.945458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b7807-24e2-4dd1-a37e-a02c72247681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:19.946089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b7807-24e2-4dd1-a37e-a02c72247681 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:19.946366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b7807-24e2-4dd1-a37e-a02c72247681 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:19.946900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:19.947546 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b7807-24e2-4dd1-a37e-a02c72247681 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:19.957429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b7807-24e2-4dd1-a37e-a02c72247681 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:19.958879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b7807-24e2-4dd1-a37e-a02c72247681 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-1c5b7807-24e2-4dd1-a37e-a02c72247681 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:19.972200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:19.973211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:19.974103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:19.974103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:19.974103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:19.974103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:19.974103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:19.974103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:19.974103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:19.974103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:19.976234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 462/911] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:19.976640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 450/912] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:19.982508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93a7b-0cfe-481e-9330-e0b5fd0fcae2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:20.083304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93a7b-0cfe-481e-9330-e0b5fd0fcae2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:20.118716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386741a-b0d7-4cc3-b892-bbacde34ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:20.119383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386741a-b0d7-4cc3-b892-bbacde34ce19 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:20.119664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386741a-b0d7-4cc3-b892-bbacde34ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:20.120016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386741a-b0d7-4cc3-b892-bbacde34ce19 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:20.120707 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386741a-b0d7-4cc3-b892-bbacde34ce19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:20.121011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386741a-b0d7-4cc3-b892-bbacde34ce19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:20.123281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386741a-b0d7-4cc3-b892-bbacde34ce19 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:20.135578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 463/913] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:20.142060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b7807-24e2-4dd1-a37e-a02c72247681 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:20.223894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:20.245327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386741a-b0d7-4cc3-b892-bbacde34ce19 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:20.245977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b7807-24e2-4dd1-a37e-a02c72247681 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:20.281841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409c0a3-40ce-447a-93c0-cdc0f2e44307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:20.282438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c0a3-40ce-447a-93c0-cdc0f2e44307 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:20.282708 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c0a3-40ce-447a-93c0-cdc0f2e44307 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:20.282978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c0a3-40ce-447a-93c0-cdc0f2e44307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:20.283693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409c0a3-40ce-447a-93c0-cdc0f2e44307 None admin] RBAC: Adding query filter params (role.id=3363af7e4d4945c692ccb6a46a4d61ca, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=4734057fc039462d8d04b5dbee141fac) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:20.284016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409c0a3-40ce-447a-93c0-cdc0f2e44307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:20.285433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409c0a3-40ce-447a-93c0-cdc0f2e44307 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:20.296046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 451/914] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:20 2022] GET /identity/v3/role_assignments?user.id=4734057fc039462d8d04b5dbee141fac&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=3363af7e4d4945c692ccb6a46a4d61ca => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:20.304290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:20.372305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386741a-b0d7-4cc3-b892-bbacde34ce19 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:20.411361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2da5d-0a61-4811-85da-773dd959816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:20.412039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2da5d-0a61-4811-85da-773dd959816b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:20.412323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2da5d-0a61-4811-85da-773dd959816b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:20.412600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2da5d-0a61-4811-85da-773dd959816b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:20.413188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2da5d-0a61-4811-85da-773dd959816b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:20.414723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2da5d-0a61-4811-85da-773dd959816b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-98f2da5d-0a61-4811-85da-773dd959816b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:20.424604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:20.426103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:20.426965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 464/915] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:12:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:20.434980 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409c0a3-40ce-447a-93c0-cdc0f2e44307 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:20.542166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409c0a3-40ce-447a-93c0-cdc0f2e44307 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:20.578308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fd4c9-99c8-44fa-ae40-4c6acc67a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:20.579277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd4c9-99c8-44fa-ae40-4c6acc67a121 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:20.579759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd4c9-99c8-44fa-ae40-4c6acc67a121 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:20.580267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd4c9-99c8-44fa-ae40-4c6acc67a121 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:20.581131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fd4c9-99c8-44fa-ae40-4c6acc67a121 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:20.581649 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fd4c9-99c8-44fa-ae40-4c6acc67a121 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:20.583216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fd4c9-99c8-44fa-ae40-4c6acc67a121 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:20.588772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 452/916] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:12:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:20.595322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2da5d-0a61-4811-85da-773dd959816b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:20.702168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2da5d-0a61-4811-85da-773dd959816b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:20.712438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:20.744696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803d5b6-7722-4f59-aa8a-9ce046ceb299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:20.745405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d5b6-7722-4f59-aa8a-9ce046ceb299 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:20.745732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d5b6-7722-4f59-aa8a-9ce046ceb299 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:20.746008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d5b6-7722-4f59-aa8a-9ce046ceb299 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:20.746870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803d5b6-7722-4f59-aa8a-9ce046ceb299 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:20.747242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803d5b6-7722-4f59-aa8a-9ce046ceb299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:20.748717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803d5b6-7722-4f59-aa8a-9ce046ceb299 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:20.755065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 465/917] 10.222.0.16 () {56 vars in 1114 bytes} [Sun Sep 18 06:12:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:20.761217 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fd4c9-99c8-44fa-ae40-4c6acc67a121 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:20.781358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:20.871634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fd4c9-99c8-44fa-ae40-4c6acc67a121 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:20.876839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5130d-f8b2-4bf5-93cd-7bd9bce8930a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:20.877789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5130d-f8b2-4bf5-93cd-7bd9bce8930a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:20.878521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5130d-f8b2-4bf5-93cd-7bd9bce8930a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:20.881755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 466/918] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:20.887968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381531d-a986-4fce-94a4-5882effa5fa0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:20.887968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381531d-a986-4fce-94a4-5882effa5fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:20.887968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381531d-a986-4fce-94a4-5882effa5fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:20.906990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e381531d-a986-4fce-94a4-5882effa5fa0 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:20.908630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e381531d-a986-4fce-94a4-5882effa5fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:20.909426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bef48-3d62-402e-9d8a-83904cebac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:20.910026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bef48-3d62-402e-9d8a-83904cebac05 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:20.910302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bef48-3d62-402e-9d8a-83904cebac05 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:20.910578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bef48-3d62-402e-9d8a-83904cebac05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:20.911233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bef48-3d62-402e-9d8a-83904cebac05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:20.912605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bef48-3d62-402e-9d8a-83904cebac05 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:20.940168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 453/919] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:12:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:21.006318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 467/920] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:21.290825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bef48-3d62-402e-9d8a-83904cebac05 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:21.357365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:21.399220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bef48-3d62-402e-9d8a-83904cebac05 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:21.434728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d585d35-f33c-4581-874a-5853b61f207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:21.435354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585d35-f33c-4581-874a-5853b61f207c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:21.435885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585d35-f33c-4581-874a-5853b61f207c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:21.435885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585d35-f33c-4581-874a-5853b61f207c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:21.436538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d585d35-f33c-4581-874a-5853b61f207c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:21.437903 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d585d35-f33c-4581-874a-5853b61f207c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7d585d35-f33c-4581-874a-5853b61f207c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:21.446862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:21.447866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:21.448759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 454/921] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 18 06:12:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:21.454793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381531d-a986-4fce-94a4-5882effa5fa0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:21.560126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:21.565268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381531d-a986-4fce-94a4-5882effa5fa0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:21.605277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e9be5-ccb8-4fa2-aea3-5d6b8a380cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:21.605886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e9be5-ccb8-4fa2-aea3-5d6b8a380cbc None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:21.606753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e9be5-ccb8-4fa2-aea3-5d6b8a380cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:21.607033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e9be5-ccb8-4fa2-aea3-5d6b8a380cbc None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:21.607814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e9be5-ccb8-4fa2-aea3-5d6b8a380cbc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:21.608207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e9be5-ccb8-4fa2-aea3-5d6b8a380cbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:21.609582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e9be5-ccb8-4fa2-aea3-5d6b8a380cbc None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:21.614685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 468/922] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 18 06:12:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:21.620493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d585d35-f33c-4581-874a-5853b61f207c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:21.695148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e643469-22b2-4355-a000-0ce0979e6e1c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:21.695501 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e643469-22b2-4355-a000-0ce0979e6e1c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:21.695759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e643469-22b2-4355-a000-0ce0979e6e1c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:21.697379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 469/923] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:21.702456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801723a-fa4e-4fde-bb0f-d002fe99c41e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:21.702732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801723a-fa4e-4fde-bb0f-d002fe99c41e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:21.703001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801723a-fa4e-4fde-bb0f-d002fe99c41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:21.721672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d801723a-fa4e-4fde-bb0f-d002fe99c41e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:21.723046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d801723a-fa4e-4fde-bb0f-d002fe99c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:21.729988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d585d35-f33c-4581-874a-5853b61f207c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:21.761401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:21.772908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785a640-20c3-41a0-ab5e-be34cdcc6771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:21.774157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785a640-20c3-41a0-ab5e-be34cdcc6771 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:21.774623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785a640-20c3-41a0-ab5e-be34cdcc6771 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:21.775399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785a640-20c3-41a0-ab5e-be34cdcc6771 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:21.776515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785a640-20c3-41a0-ab5e-be34cdcc6771 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:21.777021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785a640-20c3-41a0-ab5e-be34cdcc6771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:21.779364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785a640-20c3-41a0-ab5e-be34cdcc6771 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:21.785289 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 455/924] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 18 06:12:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:21.792279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785a640-20c3-41a0-ab5e-be34cdcc6771 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:21.815221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 470/925] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:21.904534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785a640-20c3-41a0-ab5e-be34cdcc6771 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:21.943292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3e27f-2a79-413b-88ca-b52d66a2bcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:21.943897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3e27f-2a79-413b-88ca-b52d66a2bcff None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:21.944213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3e27f-2a79-413b-88ca-b52d66a2bcff None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:21.944484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3e27f-2a79-413b-88ca-b52d66a2bcff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:21.945176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3e27f-2a79-413b-88ca-b52d66a2bcff None admin] RBAC: Adding query filter params (interface=public, service_id=dac57b5ceda14fd8afd15157a8a00c6a, region_id=RegionOne) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:21.945482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3e27f-2a79-413b-88ca-b52d66a2bcff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:21.946835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3e27f-2a79-413b-88ca-b52d66a2bcff None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:21.952801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 456/926] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 18 06:12:21 2022] GET /identity/v3/endpoints?service_id=dac57b5ceda14fd8afd15157a8a00c6a&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:21.958296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801723a-fa4e-4fde-bb0f-d002fe99c41e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:22.053942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:22.063610 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801723a-fa4e-4fde-bb0f-d002fe99c41e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:22.099765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07117e61-1fa3-47fa-906d-d263eb7fe27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:22.100322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07117e61-1fa3-47fa-906d-d263eb7fe27f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:22.100604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07117e61-1fa3-47fa-906d-d263eb7fe27f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:22.100875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07117e61-1fa3-47fa-906d-d263eb7fe27f None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:22.101475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07117e61-1fa3-47fa-906d-d263eb7fe27f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:22.102894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07117e61-1fa3-47fa-906d-d263eb7fe27f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:22.109886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 471/927] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 18 06:12:21 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:12:22.113012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3e27f-2a79-413b-88ca-b52d66a2bcff None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:22.187655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:22.240151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3e27f-2a79-413b-88ca-b52d66a2bcff None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:22.279602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af65a9-d22e-4b56-88b9-dc9c8627ad0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:22.280275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af65a9-d22e-4b56-88b9-dc9c8627ad0e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:22.280550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af65a9-d22e-4b56-88b9-dc9c8627ad0e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:22.280823 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af65a9-d22e-4b56-88b9-dc9c8627ad0e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:22.281409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af65a9-d22e-4b56-88b9-dc9c8627ad0e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:22.282781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af65a9-d22e-4b56-88b9-dc9c8627ad0e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-d7af65a9-d22e-4b56-88b9-dc9c8627ad0e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:22.292524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:22.294069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:22.295101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 457/928] 10.222.0.16 () {56 vars in 1132 bytes} [Sun Sep 18 06:12:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:22.303007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07117e61-1fa3-47fa-906d-d263eb7fe27f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:22.416410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07117e61-1fa3-47fa-906d-d263eb7fe27f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:22.453247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257deae-ea93-434d-801b-44fa2e25ead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:22.454196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257deae-ea93-434d-801b-44fa2e25ead6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:22.454678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257deae-ea93-434d-801b-44fa2e25ead6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:22.455177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257deae-ea93-434d-801b-44fa2e25ead6 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:22.456473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257deae-ea93-434d-801b-44fa2e25ead6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:22.456977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257deae-ea93-434d-801b-44fa2e25ead6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:22.458553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257deae-ea93-434d-801b-44fa2e25ead6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:22.464167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 472/929] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 18 06:12:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:22.470852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af65a9-d22e-4b56-88b9-dc9c8627ad0e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:22.476498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365752-eca9-475c-8ca9-30c599f74d03 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:22.476779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365752-eca9-475c-8ca9-30c599f74d03 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:22.477051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365752-eca9-475c-8ca9-30c599f74d03 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:22.478607 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 473/930] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:22.485588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f7237-690f-4379-8f5e-abd916d253c7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:22.485877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f7237-690f-4379-8f5e-abd916d253c7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:22.486153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f7237-690f-4379-8f5e-abd916d253c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:22.506206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-551f7237-690f-4379-8f5e-abd916d253c7 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:22.507392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-551f7237-690f-4379-8f5e-abd916d253c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:22.523107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:22.586255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 474/931] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:22.596440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af65a9-d22e-4b56-88b9-dc9c8627ad0e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:22.620962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:22.632545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a89c6b-85eb-4059-b28f-d63aa08a162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:22.633149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a89c6b-85eb-4059-b28f-d63aa08a162b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:22.633430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a89c6b-85eb-4059-b28f-d63aa08a162b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:22.637723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a89c6b-85eb-4059-b28f-d63aa08a162b None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:22.637723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a89c6b-85eb-4059-b28f-d63aa08a162b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:22.637723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a89c6b-85eb-4059-b28f-d63aa08a162b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:22.637723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a89c6b-85eb-4059-b28f-d63aa08a162b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:22.644023 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 458/932] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 18 06:12:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:22.648971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f7237-690f-4379-8f5e-abd916d253c7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:22.758625 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f7237-690f-4379-8f5e-abd916d253c7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:22.794371 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaad228-da28-4df9-8f4b-c96f267cfce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:22.794979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad228-da28-4df9-8f4b-c96f267cfce8 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:22.795259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad228-da28-4df9-8f4b-c96f267cfce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:22.795533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad228-da28-4df9-8f4b-c96f267cfce8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:22.796221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaad228-da28-4df9-8f4b-c96f267cfce8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:22.797595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaad228-da28-4df9-8f4b-c96f267cfce8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:22.820162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 475/933] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:12:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:22.896291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a89c6b-85eb-4059-b28f-d63aa08a162b None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:23.017341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a89c6b-85eb-4059-b28f-d63aa08a162b None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:23.058418 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe4f53-b0c4-4fed-8cb1-7057c85260d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:23.059047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe4f53-b0c4-4fed-8cb1-7057c85260d1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:23.059355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe4f53-b0c4-4fed-8cb1-7057c85260d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:23.059627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe4f53-b0c4-4fed-8cb1-7057c85260d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:23.069834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe4f53-b0c4-4fed-8cb1-7057c85260d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8bbe4f53-b0c4-4fed-8cb1-7057c85260d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:23.075529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:23.076542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:23.078046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 459/934] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 18 06:12:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:23.083269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaad228-da28-4df9-8f4b-c96f267cfce8 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:23.094035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:23.198416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaad228-da28-4df9-8f4b-c96f267cfce8 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:23.229709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab632f-2f31-4dde-9e53-fe0e250ef314 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:23.230014 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab632f-2f31-4dde-9e53-fe0e250ef314 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:23.230255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab632f-2f31-4dde-9e53-fe0e250ef314 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:23.232198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 460/935] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:23.234084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1982c0-bec0-47fb-b475-48e4c2dd7bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:23.234694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1982c0-bec0-47fb-b475-48e4c2dd7bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:23.234972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1982c0-bec0-47fb-b475-48e4c2dd7bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:23.235245 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1982c0-bec0-47fb-b475-48e4c2dd7bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:23.235924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1982c0-bec0-47fb-b475-48e4c2dd7bf4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:23.236234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1982c0-bec0-47fb-b475-48e4c2dd7bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:23.237081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58676-e5f0-4ff9-992d-5df8eeb6bc7e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:23.237358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58676-e5f0-4ff9-992d-5df8eeb6bc7e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:23.237601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1982c0-bec0-47fb-b475-48e4c2dd7bf4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:23.237702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58676-e5f0-4ff9-992d-5df8eeb6bc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:23.247689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 476/936] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 18 06:12:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:23.253080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1982c0-bec0-47fb-b475-48e4c2dd7bf4 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:23.259511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-57b58676-e5f0-4ff9-992d-5df8eeb6bc7e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:23.260744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-57b58676-e5f0-4ff9-992d-5df8eeb6bc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:23.296448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:23.338966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:23.344517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 461/937] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:23.380742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1982c0-bec0-47fb-b475-48e4c2dd7bf4 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:23.416829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597fbf7-ab15-4908-a680-b3a96acf10d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:23.417506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597fbf7-ab15-4908-a680-b3a96acf10d6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:23.417784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597fbf7-ab15-4908-a680-b3a96acf10d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:23.418054 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597fbf7-ab15-4908-a680-b3a96acf10d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:23.429353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597fbf7-ab15-4908-a680-b3a96acf10d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:23.430807 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597fbf7-ab15-4908-a680-b3a96acf10d6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-f597fbf7-ab15-4908-a680-b3a96acf10d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:23.445976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:23.446926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:23.448449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:23.448449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:23.448449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:23.448449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 477/938] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:23.452935 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58676-e5f0-4ff9-992d-5df8eeb6bc7e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:23.558085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58676-e5f0-4ff9-992d-5df8eeb6bc7e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:23.592821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc7d46-2a50-4ccf-b664-3f38a98ea009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:23.593427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc7d46-2a50-4ccf-b664-3f38a98ea009 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:23.593708 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc7d46-2a50-4ccf-b664-3f38a98ea009 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:23.593980 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc7d46-2a50-4ccf-b664-3f38a98ea009 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:23.594618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc7d46-2a50-4ccf-b664-3f38a98ea009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:23.594923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc7d46-2a50-4ccf-b664-3f38a98ea009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:23.596316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc7d46-2a50-4ccf-b664-3f38a98ea009 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:23.612325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 462/939] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:23.617994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597fbf7-ab15-4908-a680-b3a96acf10d6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:23.624814 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc7d46-2a50-4ccf-b664-3f38a98ea009 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:23.661631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:23.742044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc7d46-2a50-4ccf-b664-3f38a98ea009 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:23.755618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597fbf7-ab15-4908-a680-b3a96acf10d6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:23.782229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca338bd3-2bd6-4f1c-b769-18431a8f0cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:23.782978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca338bd3-2bd6-4f1c-b769-18431a8f0cf2 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:23.783353 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca338bd3-2bd6-4f1c-b769-18431a8f0cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:23.783860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca338bd3-2bd6-4f1c-b769-18431a8f0cf2 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:23.784669 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca338bd3-2bd6-4f1c-b769-18431a8f0cf2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:23.786543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca338bd3-2bd6-4f1c-b769-18431a8f0cf2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:23.789415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:23.790401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: WARNING keystone.server.flask.common [None req-ca338bd3-2bd6-4f1c-b769-18431a8f0cf2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 18 06:12:23.807949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9992-c017-47e0-a635-36c307978528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:23.809122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9992-c017-47e0-a635-36c307978528 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:23.809620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9992-c017-47e0-a635-36c307978528 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:23.810130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9992-c017-47e0-a635-36c307978528 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:23.813898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.sql.core [None req-ca338bd3-2bd6-4f1c-b769-18431a8f0cf2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 18 06:12:23.813898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 18 06:12:23.813898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [parameters: {'id': 'c73e8fac6f074dd6aa6d241d0c6b8939', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 18 06:12:23.813898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 18 06:12:23.818979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d9992-c017-47e0-a635-36c307978528 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:23.820737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d9992-c017-47e0-a635-36c307978528 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ca338bd3-2bd6-4f1c-b769-18431a8f0cf2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c73e8fac6f074dd6aa6d241d0c6b8939.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c73e8fac6f074dd6aa6d241d0c6b8939. Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 06:12:23.831837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 18 06:12:23.832880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application yield resource Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.rollback() Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.force_reraise() Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise self.value Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application session.commit() Sep 18 06:12:23.834070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._prepare_impl() Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.flush() Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._flush(objects) Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application compat.raise_( Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application flush_context.execute() Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 18 06:12:23.835184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rec.execute(self) Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 18 06:12:23.836426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 06:12:23.837405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [parameters: {'id': 'c73e8fac6f074dd6aa6d241d0c6b8939', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:23.838539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:23.839514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:23.841381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:23.841381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 18 06:12:23.841381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 18 06:12:23.841381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:23.841381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:23.841381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 18 06:12:23.841381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 18 06:12:23.841381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c73e8fac6f074dd6aa6d241d0c6b8939. Sep 18 06:12:23.841381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:23.846903 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 463/940] 10.222.0.16 () {60 vars in 1140 bytes} [Sun Sep 18 06:12:23 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:23.848127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca338bd3-2bd6-4f1c-b769-18431a8f0cf2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-f67d9992-c017-47e0-a635-36c307978528 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:23.856287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:23.857277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:23.858281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:23.858281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:23.858281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:23.858281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:23.858281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:23.858281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:23.858281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:23.858281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:23.858281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:23.858281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:23.865206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 478/941] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 18 06:12:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:23.866477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9992-c017-47e0-a635-36c307978528 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:23.949494 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:23.973999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca338bd3-2bd6-4f1c-b769-18431a8f0cf2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:23.997835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9992-c017-47e0-a635-36c307978528 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:24.017741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30112753-2473-4d23-a957-68691e38fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:24.018748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30112753-2473-4d23-a957-68691e38fb93 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:24.019099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30112753-2473-4d23-a957-68691e38fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:24.019443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30112753-2473-4d23-a957-68691e38fb93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:24.028132 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30112753-2473-4d23-a957-68691e38fb93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:24.030463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30112753-2473-4d23-a957-68691e38fb93 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:24.037371 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d48358-b09f-46e6-88ae-185f37e8e019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:24.038235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48358-b09f-46e6-88ae-185f37e8e019 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:24.038696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48358-b09f-46e6-88ae-185f37e8e019 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:24.039163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48358-b09f-46e6-88ae-185f37e8e019 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:24.040158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d48358-b09f-46e6-88ae-185f37e8e019 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:24.040644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d48358-b09f-46e6-88ae-185f37e8e019 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:24.042290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d48358-b09f-46e6-88ae-185f37e8e019 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-30112753-2473-4d23-a957-68691e38fb93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:24.043482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:24.044408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:24.045328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:24.045328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:24.045328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:24.045328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:24.045328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:24.045328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:24.045328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:24.045328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:24.048055 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 464/942] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:24.050193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30112753-2473-4d23-a957-68691e38fb93 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:24.073570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 479/943] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 18 06:12:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:24.075397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d48358-b09f-46e6-88ae-185f37e8e019 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:24.119687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:24.179625 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30112753-2473-4d23-a957-68691e38fb93 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:24.187223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d48358-b09f-46e6-88ae-185f37e8e019 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:24.222431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c61d8-e161-420e-8579-0e306b609620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:24.223048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c61d8-e161-420e-8579-0e306b609620 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:24.223358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c61d8-e161-420e-8579-0e306b609620 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:24.223594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c61d8-e161-420e-8579-0e306b609620 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:24.224307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c61d8-e161-420e-8579-0e306b609620 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:24.224589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c61d8-e161-420e-8579-0e306b609620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:24.226252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c61d8-e161-420e-8579-0e306b609620 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:24.227069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf68ce-e7b5-4b32-9edb-4fe00346117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:24.228096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf68ce-e7b5-4b32-9edb-4fe00346117d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:24.228608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf68ce-e7b5-4b32-9edb-4fe00346117d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:24.229096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf68ce-e7b5-4b32-9edb-4fe00346117d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:24.241503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf68ce-e7b5-4b32-9edb-4fe00346117d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:24.243434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf68ce-e7b5-4b32-9edb-4fe00346117d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:24.256016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 465/944] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:12:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-2caf68ce-e7b5-4b32-9edb-4fe00346117d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:24.269915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:24.270949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:24.271856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:24.271856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:24.271856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:24.274304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 480/945] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:24.280597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c61d8-e161-420e-8579-0e306b609620 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:24.285305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:24.404403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c61d8-e161-420e-8579-0e306b609620 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:24.444776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfc0c9-711b-4907-ab30-c1015145fe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:24.444776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc0c9-711b-4907-ab30-c1015145fe45 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:24.444776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc0c9-711b-4907-ab30-c1015145fe45 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:24.444776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc0c9-711b-4907-ab30-c1015145fe45 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:24.445214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfc0c9-711b-4907-ab30-c1015145fe45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:24.445496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfc0c9-711b-4907-ab30-c1015145fe45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:24.447697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfc0c9-711b-4907-ab30-c1015145fe45 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:24.461106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 466/946] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:24.467328 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf68ce-e7b5-4b32-9edb-4fe00346117d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:24.564596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04aa26-4a7b-4679-9a84-60457b748f49 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:24.565566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04aa26-4a7b-4679-9a84-60457b748f49 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:24.566091 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04aa26-4a7b-4679-9a84-60457b748f49 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:24.566611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:24.568297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 467/947] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:24.573690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dabc9-af66-4871-bb7e-eb8fb9db2dc6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:24.574051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dabc9-af66-4871-bb7e-eb8fb9db2dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:24.574404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dabc9-af66-4871-bb7e-eb8fb9db2dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:24.578520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf68ce-e7b5-4b32-9edb-4fe00346117d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:24.594410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9d8dabc9-af66-4871-bb7e-eb8fb9db2dc6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:24.596063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9d8dabc9-af66-4871-bb7e-eb8fb9db2dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:24.623251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69880e0d-c177-4a6a-a5e3-3f8afaf3654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:24.624642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69880e0d-c177-4a6a-a5e3-3f8afaf3654a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:24.624924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69880e0d-c177-4a6a-a5e3-3f8afaf3654a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:24.625203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69880e0d-c177-4a6a-a5e3-3f8afaf3654a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:24.637028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69880e0d-c177-4a6a-a5e3-3f8afaf3654a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:24.639113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69880e0d-c177-4a6a-a5e3-3f8afaf3654a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-69880e0d-c177-4a6a-a5e3-3f8afaf3654a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:24.654667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:24.655602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:24.656554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:24.656554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:24.656554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:24.656554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:24.656554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:24.656554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:24.656554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:24.656554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:24.657619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 481/948] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:24.663278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69880e0d-c177-4a6a-a5e3-3f8afaf3654a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:24.676509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:24.689172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 468/949] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:24.780604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69880e0d-c177-4a6a-a5e3-3f8afaf3654a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:24.816413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4004d0c-e4da-4d76-814f-2bc72a841feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:24.817012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4004d0c-e4da-4d76-814f-2bc72a841feb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:24.817283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4004d0c-e4da-4d76-814f-2bc72a841feb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:24.817552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4004d0c-e4da-4d76-814f-2bc72a841feb None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:24.818231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4004d0c-e4da-4d76-814f-2bc72a841feb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:24.818530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4004d0c-e4da-4d76-814f-2bc72a841feb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:24.819982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4004d0c-e4da-4d76-814f-2bc72a841feb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:24.833169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 482/950] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:24.838862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dabc9-af66-4871-bb7e-eb8fb9db2dc6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:24.944956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dabc9-af66-4871-bb7e-eb8fb9db2dc6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:24.981717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4004d0c-e4da-4d76-814f-2bc72a841feb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:24.982761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b2faa-4e05-4470-9c74-3a9b55b82643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:24.983431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b2faa-4e05-4470-9c74-3a9b55b82643 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:24.983713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b2faa-4e05-4470-9c74-3a9b55b82643 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:24.984032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b2faa-4e05-4470-9c74-3a9b55b82643 None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/4734057fc039462d8d04b5dbee141fac/roles/3363af7e4d4945c692ccb6a46a4d61ca` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:24.986206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b2faa-4e05-4470-9c74-3a9b55b82643 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=4734057fc039462d8d04b5dbee141fac, role_id=3363af7e4d4945c692ccb6a46a4d61ca)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:24.987640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b2faa-4e05-4470-9c74-3a9b55b82643 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:24.994572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:25.006288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 469/951] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:12:24 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/4734057fc039462d8d04b5dbee141fac/roles/3363af7e4d4945c692ccb6a46a4d61ca => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:12:25.108851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4004d0c-e4da-4d76-814f-2bc72a841feb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:25.149156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc265d-354e-4f88-a6eb-7b947c26a926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:25.149806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc265d-354e-4f88-a6eb-7b947c26a926 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:25.150079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc265d-354e-4f88-a6eb-7b947c26a926 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:25.150347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc265d-354e-4f88-a6eb-7b947c26a926 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:25.150929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc265d-354e-4f88-a6eb-7b947c26a926 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:25.152354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc265d-354e-4f88-a6eb-7b947c26a926 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-40cc265d-354e-4f88-a6eb-7b947c26a926 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:25.162584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:25.163668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:25.164771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 483/952] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 18 06:12:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:25.171416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b2faa-4e05-4470-9c74-3a9b55b82643 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:25.207762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b301-ea60-43ac-aa60-6590d03c65fd None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:25.208100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b301-ea60-43ac-aa60-6590d03c65fd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:25.208276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b301-ea60-43ac-aa60-6590d03c65fd None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:25.209554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 484/953] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:25.216176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1bad9-8be3-4d2d-9ded-d153d9a9068f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:25.216456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1bad9-8be3-4d2d-9ded-d153d9a9068f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:25.216727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1bad9-8be3-4d2d-9ded-d153d9a9068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:25.238639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e8f1bad9-8be3-4d2d-9ded-d153d9a9068f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:25.239822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e8f1bad9-8be3-4d2d-9ded-d153d9a9068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:25.241136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:25.307421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b2faa-4e05-4470-9c74-3a9b55b82643 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:25.316525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 485/954] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:25.349054 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051c254-7edd-4170-baee-c129a9e62440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:25.349665 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051c254-7edd-4170-baee-c129a9e62440 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:25.349941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051c254-7edd-4170-baee-c129a9e62440 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:25.350215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051c254-7edd-4170-baee-c129a9e62440 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:25.350838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051c254-7edd-4170-baee-c129a9e62440 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:25.351138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051c254-7edd-4170-baee-c129a9e62440 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:25.352528 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051c254-7edd-4170-baee-c129a9e62440 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:25.357881 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 470/955] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 18 06:12:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:25.363703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1bad9-8be3-4d2d-9ded-d153d9a9068f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:25.367253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:25.467459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1bad9-8be3-4d2d-9ded-d153d9a9068f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:25.501878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328be54c-5f5f-40cb-bd28-3d4bf30d2062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:25.502485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328be54c-5f5f-40cb-bd28-3d4bf30d2062 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:25.502762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328be54c-5f5f-40cb-bd28-3d4bf30d2062 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:25.503033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328be54c-5f5f-40cb-bd28-3d4bf30d2062 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:25.503663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328be54c-5f5f-40cb-bd28-3d4bf30d2062 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:25.503998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328be54c-5f5f-40cb-bd28-3d4bf30d2062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:25.505621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328be54c-5f5f-40cb-bd28-3d4bf30d2062 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:25.511164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 486/956] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 18 06:12:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:25.517658 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051c254-7edd-4170-baee-c129a9e62440 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:25.588529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328be54c-5f5f-40cb-bd28-3d4bf30d2062 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:25.636725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051c254-7edd-4170-baee-c129a9e62440 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:25.656314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:25.660248 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:25.678743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c2f92-2716-407c-9701-8a585eb415c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:25.679357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c2f92-2716-407c-9701-8a585eb415c6 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:25.679629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c2f92-2716-407c-9701-8a585eb415c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:25.680260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c2f92-2716-407c-9701-8a585eb415c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:25.680636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c2f92-2716-407c-9701-8a585eb415c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:25.681982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c2f92-2716-407c-9701-8a585eb415c6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:25.704459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328be54c-5f5f-40cb-bd28-3d4bf30d2062 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:25.711952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 471/957] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:12:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:25.758934 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ab34-5856-4339-a9ed-fe38a9760b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:25.759874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ab34-5856-4339-a9ed-fe38a9760b52 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:25.760368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ab34-5856-4339-a9ed-fe38a9760b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:25.760945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2ab34-5856-4339-a9ed-fe38a9760b52 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:25.761790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2ab34-5856-4339-a9ed-fe38a9760b52 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:25.763396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2ab34-5856-4339-a9ed-fe38a9760b52 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7ce2ab34-5856-4339-a9ed-fe38a9760b52 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:25.773805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:25.775126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 06:12:25.776179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:25.784099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 487/958] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:25.785896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c2f92-2716-407c-9701-8a585eb415c6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:25.901280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c2f92-2716-407c-9701-8a585eb415c6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:25.938319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fab28-a7ea-4c14-a0ac-a553f009423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:25.938927 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fab28-a7ea-4c14-a0ac-a553f009423f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:25.939202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fab28-a7ea-4c14-a0ac-a553f009423f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:25.939477 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fab28-a7ea-4c14-a0ac-a553f009423f None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:25.940134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fab28-a7ea-4c14-a0ac-a553f009423f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:25.940439 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fab28-a7ea-4c14-a0ac-a553f009423f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:25.941795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fab28-a7ea-4c14-a0ac-a553f009423f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:25.946965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 472/959] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:12:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:25.953260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ab34-5856-4339-a9ed-fe38a9760b52 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:26.062558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2ab34-5856-4339-a9ed-fe38a9760b52 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:26.088804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:26.097733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675afd5-edeb-45d8-8a05-d781bb06be59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:26.098454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675afd5-edeb-45d8-8a05-d781bb06be59 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:26.099172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675afd5-edeb-45d8-8a05-d781bb06be59 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:26.099794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675afd5-edeb-45d8-8a05-d781bb06be59 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:26.100801 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675afd5-edeb-45d8-8a05-d781bb06be59 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:26.101101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675afd5-edeb-45d8-8a05-d781bb06be59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:26.102520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675afd5-edeb-45d8-8a05-d781bb06be59 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:26.107557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 488/960] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:12:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:26.634967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02870-6682-41a2-be3c-6e26acb13a69 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:26.635304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02870-6682-41a2-be3c-6e26acb13a69 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:26.635521 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02870-6682-41a2-be3c-6e26acb13a69 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:26.637651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 473/961] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:26.643080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af72d0-ae56-464e-8bf2-123fb63e75c7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:26.643369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af72d0-ae56-464e-8bf2-123fb63e75c7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:26.643644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af72d0-ae56-464e-8bf2-123fb63e75c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:26.662492 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-62af72d0-ae56-464e-8bf2-123fb63e75c7 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:26.663688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-62af72d0-ae56-464e-8bf2-123fb63e75c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:26.738431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 489/962] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:27.010530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d02870-6682-41a2-be3c-6e26acb13a69 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:27.054979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:27.118876 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d02870-6682-41a2-be3c-6e26acb13a69 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:27.154520 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e9081-8936-4624-850b-ead88bffb911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:27.155130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e9081-8936-4624-850b-ead88bffb911 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:27.155409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e9081-8936-4624-850b-ead88bffb911 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:27.155682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e9081-8936-4624-850b-ead88bffb911 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:27.156369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e9081-8936-4624-850b-ead88bffb911 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:27.157858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e9081-8936-4624-850b-ead88bffb911 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:27.175890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.sql.core [None req-485e9081-8936-4624-850b-ead88bffb911 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 18 06:12:27.175890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 18 06:12:27.175890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [parameters: {'user_id': '1ac5c2a7409b44b09d650ec4c6e76412', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 18 06:12:27.175890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-485e9081-8936-4624-850b-ead88bffb911 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Sep 18 06:12:27.184363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 06:12:27.185717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application yield resource Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application next(self.gen) Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.rollback() Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.force_reraise() Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise self.value Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application session.commit() Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 18 06:12:27.187332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._prepare_impl() Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.session.flush() Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._flush(objects) Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application compat.raise_( Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application flush_context.execute() Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rec.execute(self) Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 18 06:12:27.188300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 06:12:27.189203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application conn.query(q) Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application result.read() Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 06:12:27.190070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [parameters: {'user_id': '1ac5c2a7409b44b09d650ec4c6e76412', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:27.192836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 18 06:12:27.194776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 18 06:12:27.197004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 18 06:12:27.197004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 18 06:12:27.197004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 18 06:12:27.197004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 18 06:12:27.197004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 18 06:12:27.197004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:27.197004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 474/963] 10.222.0.16 () {60 vars in 1131 bytes} [Sun Sep 18 06:12:27 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:27.197916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af72d0-ae56-464e-8bf2-123fb63e75c7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:27.286516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3952-d823-4126-b412-197fd41a9d0b None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:27.286828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3952-d823-4126-b412-197fd41a9d0b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:27.286990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3952-d823-4126-b412-197fd41a9d0b None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:27.291655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 475/964] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:27.297091 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831d04b-9e97-479a-858a-59b9fc51b981 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:27.297377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831d04b-9e97-479a-858a-59b9fc51b981 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:27.297652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831d04b-9e97-479a-858a-59b9fc51b981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:27.311572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af72d0-ae56-464e-8bf2-123fb63e75c7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:27.316758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2831d04b-9e97-479a-858a-59b9fc51b981 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:27.318378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2831d04b-9e97-479a-858a-59b9fc51b981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:27.334609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:27.351510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f09af-b004-4e75-b698-e2bd5e71836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:27.352540 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f09af-b004-4e75-b698-e2bd5e71836c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:27.353279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f09af-b004-4e75-b698-e2bd5e71836c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:27.353975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f09af-b004-4e75-b698-e2bd5e71836c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:27.363141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f09af-b004-4e75-b698-e2bd5e71836c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:27.365255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f09af-b004-4e75-b698-e2bd5e71836c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-031f09af-b004-4e75-b698-e2bd5e71836c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:27.380892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:27.382047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:27.383192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:27.383192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:27.383192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:27.383192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:27.383192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:27.383192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:27.383192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:27.383192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:27.383192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 06:12:27.383192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:27.385641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 490/965] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:12:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:27.392006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f09af-b004-4e75-b698-e2bd5e71836c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:27.400940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 476/966] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:27.495167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f09af-b004-4e75-b698-e2bd5e71836c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:27.529994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac01800-ae31-4bc0-a73d-da9c2120c181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:27.530834 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac01800-ae31-4bc0-a73d-da9c2120c181 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:27.531322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac01800-ae31-4bc0-a73d-da9c2120c181 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:27.531737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac01800-ae31-4bc0-a73d-da9c2120c181 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:27.532598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac01800-ae31-4bc0-a73d-da9c2120c181 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:27.533044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac01800-ae31-4bc0-a73d-da9c2120c181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:27.534681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac01800-ae31-4bc0-a73d-da9c2120c181 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:27.570388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 491/967] 10.222.0.16 () {56 vars in 1101 bytes} [Sun Sep 18 06:12:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:27.678022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831d04b-9e97-479a-858a-59b9fc51b981 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:27.712760 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:27.793624 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831d04b-9e97-479a-858a-59b9fc51b981 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:27.838712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f1402-c23c-4568-83ab-bd87262b0604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:27.839369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f1402-c23c-4568-83ab-bd87262b0604 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:27.839646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f1402-c23c-4568-83ab-bd87262b0604 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:27.839932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f1402-c23c-4568-83ab-bd87262b0604 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:27.851623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f1402-c23c-4568-83ab-bd87262b0604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c99f1402-c23c-4568-83ab-bd87262b0604 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:27.856565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:27.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:27.858385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 477/968] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 18 06:12:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:27.863611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac01800-ae31-4bc0-a73d-da9c2120c181 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:27.909421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:27.972684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac01800-ae31-4bc0-a73d-da9c2120c181 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:28.008520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6fe75-d2ec-45bd-8194-40886bd3df4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:28.009124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6fe75-d2ec-45bd-8194-40886bd3df4c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.009403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6fe75-d2ec-45bd-8194-40886bd3df4c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.009677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6fe75-d2ec-45bd-8194-40886bd3df4c None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.010333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6fe75-d2ec-45bd-8194-40886bd3df4c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:28.010635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6fe75-d2ec-45bd-8194-40886bd3df4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:28.012558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6fe75-d2ec-45bd-8194-40886bd3df4c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:28.025535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 492/969] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 18 06:12:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:28.026970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f1402-c23c-4568-83ab-bd87262b0604 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:28.077191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7b32a-566c-4fd8-b006-c8495d3d8c6d None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.077541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7b32a-566c-4fd8-b006-c8495d3d8c6d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.077764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7b32a-566c-4fd8-b006-c8495d3d8c6d None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.079354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 493/970] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:28.084939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b059-33db-482b-92da-eee64672f339 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.085230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b059-33db-482b-92da-eee64672f339 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.085508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b059-33db-482b-92da-eee64672f339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.105295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a6d1b059-33db-482b-92da-eee64672f339 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:28.106860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a6d1b059-33db-482b-92da-eee64672f339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:28.120906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:28.133208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f1402-c23c-4568-83ab-bd87262b0604 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:28.171592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba811d26-9eca-4d1d-a071-de832e91b27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:28.172250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811d26-9eca-4d1d-a071-de832e91b27e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.172529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811d26-9eca-4d1d-a071-de832e91b27e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.172802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba811d26-9eca-4d1d-a071-de832e91b27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.175318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 494/971] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:28.183027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba811d26-9eca-4d1d-a071-de832e91b27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:28.184766 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba811d26-9eca-4d1d-a071-de832e91b27e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ba811d26-9eca-4d1d-a071-de832e91b27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:28.199030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:28.205666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:28.206655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:28.206655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:28.206655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:28.206655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 478/972] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:28.206895 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1b059-33db-482b-92da-eee64672f339 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:28.237579 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:28.310219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1b059-33db-482b-92da-eee64672f339 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:28.346126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8c60e-dcbb-4edf-83a3-b1086d841729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:28.346654 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8c60e-dcbb-4edf-83a3-b1086d841729 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.346933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8c60e-dcbb-4edf-83a3-b1086d841729 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.347207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8c60e-dcbb-4edf-83a3-b1086d841729 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.347845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8c60e-dcbb-4edf-83a3-b1086d841729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:28.348174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8c60e-dcbb-4edf-83a3-b1086d841729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:28.349542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8c60e-dcbb-4edf-83a3-b1086d841729 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:28.365120 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 495/973] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:28.366321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba811d26-9eca-4d1d-a071-de832e91b27e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:28.413038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef26a4d-de03-4ac3-91e5-b859b5f2357a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.413321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef26a4d-de03-4ac3-91e5-b859b5f2357a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.413604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef26a4d-de03-4ac3-91e5-b859b5f2357a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.414956 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 496/974] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:28.420024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b57ef-fb2a-4103-8103-f97e095aeacc None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.420307 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b57ef-fb2a-4103-8103-f97e095aeacc None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.420581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b57ef-fb2a-4103-8103-f97e095aeacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.439556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0f5b57ef-fb2a-4103-8103-f97e095aeacc None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:28.440797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0f5b57ef-fb2a-4103-8103-f97e095aeacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:28.469247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba811d26-9eca-4d1d-a071-de832e91b27e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:28.503224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4765b0-02b4-481f-84c4-08a135a90c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:28.503845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4765b0-02b4-481f-84c4-08a135a90c3c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.504166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4765b0-02b4-481f-84c4-08a135a90c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.504447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4765b0-02b4-481f-84c4-08a135a90c3c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.506773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 497/975] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:28.507652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b57ef-fb2a-4103-8103-f97e095aeacc None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:28.512264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4765b0-02b4-481f-84c4-08a135a90c3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:28.513707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4765b0-02b4-481f-84c4-08a135a90c3c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4c4765b0-02b4-481f-84c4-08a135a90c3c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:28.525919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:28.526895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:28.529409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:28.529409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:28.529409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:28.529409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:28.529409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:28.529409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:28.529409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:28.529409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:28.529409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 06:12:28.529409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:28.529409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 479/976] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 18 06:12:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:28.535651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4765b0-02b4-481f-84c4-08a135a90c3c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:28.538383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:28.538822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:28.622460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b57ef-fb2a-4103-8103-f97e095aeacc None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:28.648561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4765b0-02b4-481f-84c4-08a135a90c3c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:28.656485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0755d-e50c-4734-a20b-98fdbb73dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:28.657127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0755d-e50c-4734-a20b-98fdbb73dd71 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.657405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0755d-e50c-4734-a20b-98fdbb73dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.657682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0755d-e50c-4734-a20b-98fdbb73dd71 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.658263 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0755d-e50c-4734-a20b-98fdbb73dd71 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:28.659633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0755d-e50c-4734-a20b-98fdbb73dd71 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-10c0755d-e50c-4734-a20b-98fdbb73dd71 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:28.668447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:28.669731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:28.670733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 498/977] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 18 06:12:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:28.675298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0755d-e50c-4734-a20b-98fdbb73dd71 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:28.689737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630ac6-43a7-4545-ad00-d933d65002a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:28.691049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630ac6-43a7-4545-ad00-d933d65002a0 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.691331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630ac6-43a7-4545-ad00-d933d65002a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.691651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630ac6-43a7-4545-ad00-d933d65002a0 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.692425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2630ac6-43a7-4545-ad00-d933d65002a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:28.692729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2630ac6-43a7-4545-ad00-d933d65002a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:28.694373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2630ac6-43a7-4545-ad00-d933d65002a0 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:28.717922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 480/978] 10.222.0.16 () {56 vars in 1149 bytes} [Sun Sep 18 06:12:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:28.718971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630ac6-43a7-4545-ad00-d933d65002a0 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:28.764347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:28.780076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0755d-e50c-4734-a20b-98fdbb73dd71 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:28.784428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:28.814970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433ff35-8ff4-448a-8255-35c0cf9a79d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:28.815566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433ff35-8ff4-448a-8255-35c0cf9a79d6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.815851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433ff35-8ff4-448a-8255-35c0cf9a79d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.816148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433ff35-8ff4-448a-8255-35c0cf9a79d6 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.816764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433ff35-8ff4-448a-8255-35c0cf9a79d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:28.817061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433ff35-8ff4-448a-8255-35c0cf9a79d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:28.818428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433ff35-8ff4-448a-8255-35c0cf9a79d6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:28.822937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 499/979] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 18 06:12:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:28.823682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433ff35-8ff4-448a-8255-35c0cf9a79d6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:28.825923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630ac6-43a7-4545-ad00-d933d65002a0 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:28.861401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830ae6d-48da-4290-aadf-d5ae9ca9eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:28.861997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830ae6d-48da-4290-aadf-d5ae9ca9eef6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.862271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830ae6d-48da-4290-aadf-d5ae9ca9eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.862542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830ae6d-48da-4290-aadf-d5ae9ca9eef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.928600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433ff35-8ff4-448a-8255-35c0cf9a79d6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:28.929830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830ae6d-48da-4290-aadf-d5ae9ca9eef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:28.931272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830ae6d-48da-4290-aadf-d5ae9ca9eef6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:28.962682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db7c08-8cab-443e-9de1-c779f2dd6842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:28.963277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db7c08-8cab-443e-9de1-c779f2dd6842 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:28.963560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db7c08-8cab-443e-9de1-c779f2dd6842 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:28.963928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db7c08-8cab-443e-9de1-c779f2dd6842 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:28.969176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db7c08-8cab-443e-9de1-c779f2dd6842 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:28.970536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db7c08-8cab-443e-9de1-c779f2dd6842 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:28.988911 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:28.991682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 500/980] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:12:28 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:28.992532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db7c08-8cab-443e-9de1-c779f2dd6842 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:29.008176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:29.049796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 481/981] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:28 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:12:29.051361 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830ae6d-48da-4290-aadf-d5ae9ca9eef6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:29.127538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db7c08-8cab-443e-9de1-c779f2dd6842 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:29.164182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830ae6d-48da-4290-aadf-d5ae9ca9eef6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:29.167341 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937e2c1-95b8-40cc-b209-4ddc5a31daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:29.168401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937e2c1-95b8-40cc-b209-4ddc5a31daa9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:29.168536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937e2c1-95b8-40cc-b209-4ddc5a31daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:29.168787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937e2c1-95b8-40cc-b209-4ddc5a31daa9 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:29.169409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937e2c1-95b8-40cc-b209-4ddc5a31daa9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:29.169708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937e2c1-95b8-40cc-b209-4ddc5a31daa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:29.171306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937e2c1-95b8-40cc-b209-4ddc5a31daa9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:29.178136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 501/982] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 18 06:12:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:29.184827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937e2c1-95b8-40cc-b209-4ddc5a31daa9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:29.205886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c4bce-35d1-45d2-a858-aa0947362032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:29.206602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c4bce-35d1-45d2-a858-aa0947362032 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:29.206887 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c4bce-35d1-45d2-a858-aa0947362032 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:29.207162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c4bce-35d1-45d2-a858-aa0947362032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:29.218543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c4bce-35d1-45d2-a858-aa0947362032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:29.220052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c4bce-35d1-45d2-a858-aa0947362032 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-1b5c4bce-35d1-45d2-a858-aa0947362032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:29.235297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:29.236302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:29.237874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:29.237874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:29.237874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:29.237874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 482/983] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:29.241936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c4bce-35d1-45d2-a858-aa0947362032 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:29.258314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:29.267249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:29.300926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937e2c1-95b8-40cc-b209-4ddc5a31daa9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:29.335629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8b3bc-89b9-4183-a1b5-1dc7c14e6a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:29.336258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b3bc-89b9-4183-a1b5-1dc7c14e6a4b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:29.336536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b3bc-89b9-4183-a1b5-1dc7c14e6a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:29.336805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8b3bc-89b9-4183-a1b5-1dc7c14e6a4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:29.337508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8b3bc-89b9-4183-a1b5-1dc7c14e6a4b None admin] RBAC: Adding query filter params (interface=admin, service_id=dac57b5ceda14fd8afd15157a8a00c6a, region_id=RegionOne) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:29.337818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8b3bc-89b9-4183-a1b5-1dc7c14e6a4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:29.339181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8b3bc-89b9-4183-a1b5-1dc7c14e6a4b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:29.350057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 502/984] 10.222.0.16 () {56 vars in 1249 bytes} [Sun Sep 18 06:12:29 2022] GET /identity/v3/endpoints?service_id=dac57b5ceda14fd8afd15157a8a00c6a&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:29.351489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c4bce-35d1-45d2-a858-aa0947362032 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:29.351889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8b3bc-89b9-4183-a1b5-1dc7c14e6a4b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:29.388824 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55092bb4-b66c-4cec-b21a-2d00264dee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:29.389437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55092bb4-b66c-4cec-b21a-2d00264dee6a None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:29.389712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55092bb4-b66c-4cec-b21a-2d00264dee6a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:29.389985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55092bb4-b66c-4cec-b21a-2d00264dee6a None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:29.390623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55092bb4-b66c-4cec-b21a-2d00264dee6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:29.390928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55092bb4-b66c-4cec-b21a-2d00264dee6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:29.392355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55092bb4-b66c-4cec-b21a-2d00264dee6a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:29.405147 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 483/985] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:29.410563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55092bb4-b66c-4cec-b21a-2d00264dee6a None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:29.465599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8b3bc-89b9-4183-a1b5-1dc7c14e6a4b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:29.485029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:29.505864 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355eec6-9975-4d08-b886-a64096964bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:29.506561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355eec6-9975-4d08-b886-a64096964bba None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:29.506886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355eec6-9975-4d08-b886-a64096964bba None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:29.507225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355eec6-9975-4d08-b886-a64096964bba None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:29.507921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355eec6-9975-4d08-b886-a64096964bba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:29.509434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355eec6-9975-4d08-b886-a64096964bba None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:29.510868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:29.518124 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55092bb4-b66c-4cec-b21a-2d00264dee6a None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:29.528302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 503/986] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 18 06:12:29 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:12:29.560554 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312e8eb-9968-4064-8045-fdf0e5827a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:29.561208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e8eb-9968-4064-8045-fdf0e5827a09 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:29.561491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e8eb-9968-4064-8045-fdf0e5827a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:29.561764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e8eb-9968-4064-8045-fdf0e5827a09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:29.569396 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312e8eb-9968-4064-8045-fdf0e5827a09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:29.570947 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312e8eb-9968-4064-8045-fdf0e5827a09 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f312e8eb-9968-4064-8045-fdf0e5827a09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:29.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:29.585247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:29.586235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:29.586235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:29.586235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:29.586235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:29.586235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:29.586235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:29.586235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:29.586235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:29.588231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 484/987] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:29.592104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355eec6-9975-4d08-b886-a64096964bba None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:29.704978 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355eec6-9975-4d08-b886-a64096964bba None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:29.741850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f189f-f0e8-4f2b-bb2e-56c8014f4e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:29.742677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f189f-f0e8-4f2b-bb2e-56c8014f4e99 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:29.743105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f189f-f0e8-4f2b-bb2e-56c8014f4e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:29.743542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f189f-f0e8-4f2b-bb2e-56c8014f4e99 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:29.744408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f189f-f0e8-4f2b-bb2e-56c8014f4e99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:29.744856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f189f-f0e8-4f2b-bb2e-56c8014f4e99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:29.747035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f189f-f0e8-4f2b-bb2e-56c8014f4e99 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:29.760669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 504/988] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:29.767039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312e8eb-9968-4064-8045-fdf0e5827a09 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:29.878044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312e8eb-9968-4064-8045-fdf0e5827a09 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:29.909023 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:29.915230 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e6097-7c7f-49c0-810a-73ce79fab862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:29.915843 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e6097-7c7f-49c0-810a-73ce79fab862 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:29.916143 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e6097-7c7f-49c0-810a-73ce79fab862 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:29.916414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e6097-7c7f-49c0-810a-73ce79fab862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:29.917142 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e6097-7c7f-49c0-810a-73ce79fab862 None admin] RBAC: Adding query filter params (role.id=3363af7e4d4945c692ccb6a46a4d61ca, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=4734057fc039462d8d04b5dbee141fac) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:29.917444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e6097-7c7f-49c0-810a-73ce79fab862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:29.919543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e6097-7c7f-49c0-810a-73ce79fab862 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:29.926581 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 485/989] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:29 2022] GET /identity/v3/role_assignments?user.id=4734057fc039462d8d04b5dbee141fac&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=3363af7e4d4945c692ccb6a46a4d61ca => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:31.207971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb8216-b581-46e4-b93e-1baaee8e47af None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:31.208499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb8216-b581-46e4-b93e-1baaee8e47af None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:31.208499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb8216-b581-46e4-b93e-1baaee8e47af None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:31.210013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 505/990] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:31.215083 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41bab-2880-4824-bde7-3a76ccd8d7c4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:31.215528 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41bab-2880-4824-bde7-3a76ccd8d7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:31.215665 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41bab-2880-4824-bde7-3a76ccd8d7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:31.234356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f1f41bab-2880-4824-bde7-3a76ccd8d7c4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:31.235538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f1f41bab-2880-4824-bde7-3a76ccd8d7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:31.306794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 486/991] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:31.579611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb8216-b581-46e4-b93e-1baaee8e47af None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:31.646627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:31.691296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb8216-b581-46e4-b93e-1baaee8e47af None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:31.726201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bb91c-9527-4ed4-bf2e-1da291acd2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:31.726839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bb91c-9527-4ed4-bf2e-1da291acd2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:31.727113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bb91c-9527-4ed4-bf2e-1da291acd2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:31.727378 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bb91c-9527-4ed4-bf2e-1da291acd2c5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:31.727966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bb91c-9527-4ed4-bf2e-1da291acd2c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:31.729331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bb91c-9527-4ed4-bf2e-1da291acd2c5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:31.730007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b0b32-750f-4a3a-85e1-74e1c77befef None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:31.730327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b0b32-750f-4a3a-85e1-74e1c77befef None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:31.730616 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b0b32-750f-4a3a-85e1-74e1c77befef None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:31.732120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 487/992] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:31.738354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c01961-fdea-402c-bab8-941d89abd96c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:31.738354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c01961-fdea-402c-bab8-941d89abd96c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:31.738354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c01961-fdea-402c-bab8-941d89abd96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-087bb91c-9527-4ed4-bf2e-1da291acd2c5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:31.740687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:31.741660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 06:12:31.742514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:31.744202 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 506/993] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:31.747755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bb91c-9527-4ed4-bf2e-1da291acd2c5 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:31.759488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c2c01961-fdea-402c-bab8-941d89abd96c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:31.760792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c2c01961-fdea-402c-bab8-941d89abd96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:31.840122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 488/994] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:31.869013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bb91c-9527-4ed4-bf2e-1da291acd2c5 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:31.893059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:31.905700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6974-7b3b-4465-bc59-e2dba3f6e6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:31.906301 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6974-7b3b-4465-bc59-e2dba3f6e6cb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:31.906573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6974-7b3b-4465-bc59-e2dba3f6e6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:31.906841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6974-7b3b-4465-bc59-e2dba3f6e6cb None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:31.907453 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6974-7b3b-4465-bc59-e2dba3f6e6cb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:31.907746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6974-7b3b-4465-bc59-e2dba3f6e6cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:31.909120 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6974-7b3b-4465-bc59-e2dba3f6e6cb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:31.918838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 507/995] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:12:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:31.920608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c01961-fdea-402c-bab8-941d89abd96c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:31.979027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:32.029018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c01961-fdea-402c-bab8-941d89abd96c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:32.062677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39317b-fe11-42bb-8605-1dfdb5a8c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:32.063281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39317b-fe11-42bb-8605-1dfdb5a8c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:32.063564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39317b-fe11-42bb-8605-1dfdb5a8c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:32.063826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39317b-fe11-42bb-8605-1dfdb5a8c6f1 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:32.064479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39317b-fe11-42bb-8605-1dfdb5a8c6f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:32.064783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39317b-fe11-42bb-8605-1dfdb5a8c6f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:32.066143 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39317b-fe11-42bb-8605-1dfdb5a8c6f1 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:32.076169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 489/996] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:12:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:32.077926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6974-7b3b-4465-bc59-e2dba3f6e6cb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:32.101626 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380ae9-23ef-41e9-a68f-92f493a1e8e9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:32.101900 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380ae9-23ef-41e9-a68f-92f493a1e8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:32.102099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380ae9-23ef-41e9-a68f-92f493a1e8e9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:32.103611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 490/997] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:32.104616 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f380ae9-23ef-41e9-a68f-92f493a1e8e9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:32.178300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6974-7b3b-4465-bc59-e2dba3f6e6cb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:32.209001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f380ae9-23ef-41e9-a68f-92f493a1e8e9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:32.212395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f510bd-2096-4d65-856c-ac802ad24591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:32.212993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f510bd-2096-4d65-856c-ac802ad24591 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:32.213269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f510bd-2096-4d65-856c-ac802ad24591 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:32.213539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f510bd-2096-4d65-856c-ac802ad24591 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:32.214234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f510bd-2096-4d65-856c-ac802ad24591 None admin] RBAC: Adding query filter params (interface=public, service_id=56dbb8adb2294fd49a77a0775fef68fc, region_id=RegionOne) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:32.214535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f510bd-2096-4d65-856c-ac802ad24591 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:32.216535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f510bd-2096-4d65-856c-ac802ad24591 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:32.221751 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 508/998] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 18 06:12:32 2022] GET /identity/v3/endpoints?service_id=56dbb8adb2294fd49a77a0775fef68fc&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:32.222919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361292c3-e88a-4216-845f-04961803f3c6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:32.223206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361292c3-e88a-4216-845f-04961803f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:32.223484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361292c3-e88a-4216-845f-04961803f3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:32.229811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:32.241870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-361292c3-e88a-4216-845f-04961803f3c6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:32.243070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-361292c3-e88a-4216-845f-04961803f3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:32.244347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619bc82-92a7-4e33-afbb-9edfd8b95b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:32.244973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619bc82-92a7-4e33-afbb-9edfd8b95b0d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:32.245248 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619bc82-92a7-4e33-afbb-9edfd8b95b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:32.245518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619bc82-92a7-4e33-afbb-9edfd8b95b0d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:32.246781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619bc82-92a7-4e33-afbb-9edfd8b95b0d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:32.248119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619bc82-92a7-4e33-afbb-9edfd8b95b0d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-c619bc82-92a7-4e33-afbb-9edfd8b95b0d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:32.257073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:32.258186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:32.259047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 491/999] 10.222.0.16 () {56 vars in 1126 bytes} [Sun Sep 18 06:12:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:32.260892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619bc82-92a7-4e33-afbb-9edfd8b95b0d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:32.290185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:32.312531 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 509/1000] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:32.313355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361292c3-e88a-4216-845f-04961803f3c6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:32.365165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619bc82-92a7-4e33-afbb-9edfd8b95b0d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:32.404940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666bc7-d753-41f7-b442-0e198c3ce242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:32.405540 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666bc7-d753-41f7-b442-0e198c3ce242 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:32.405819 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666bc7-d753-41f7-b442-0e198c3ce242 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:32.406098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666bc7-d753-41f7-b442-0e198c3ce242 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:32.406690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07666bc7-d753-41f7-b442-0e198c3ce242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:32.408084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07666bc7-d753-41f7-b442-0e198c3ce242 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:32.415272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 492/1001] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 18 06:12:32 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:12:32.418062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361292c3-e88a-4216-845f-04961803f3c6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:32.456780 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203884-06e6-401d-b6e2-db1968fc0a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:32.457400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203884-06e6-401d-b6e2-db1968fc0a5a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:32.457682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203884-06e6-401d-b6e2-db1968fc0a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:32.457957 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203884-06e6-401d-b6e2-db1968fc0a5a None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:32.458594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203884-06e6-401d-b6e2-db1968fc0a5a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:32.458899 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203884-06e6-401d-b6e2-db1968fc0a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:32.460330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203884-06e6-401d-b6e2-db1968fc0a5a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:32.470961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 510/1002] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 18 06:12:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:32.472702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666bc7-d753-41f7-b442-0e198c3ce242 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:32.528866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:32.586300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203884-06e6-401d-b6e2-db1968fc0a5a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:32.587734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666bc7-d753-41f7-b442-0e198c3ce242 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:32.627756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6c53d-8f91-411f-b31b-e84b6c25de5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:32.628813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c53d-8f91-411f-b31b-e84b6c25de5c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:32.628813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c53d-8f91-411f-b31b-e84b6c25de5c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:32.629016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c53d-8f91-411f-b31b-e84b6c25de5c None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:32.629476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6c53d-8f91-411f-b31b-e84b6c25de5c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:32.629776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6c53d-8f91-411f-b31b-e84b6c25de5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:32.631390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6c53d-8f91-411f-b31b-e84b6c25de5c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:32.640258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 493/1003] 10.222.0.16 () {56 vars in 1122 bytes} [Sun Sep 18 06:12:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:32.642969 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:32.644178 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6c53d-8f91-411f-b31b-e84b6c25de5c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:32.700477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203884-06e6-401d-b6e2-db1968fc0a5a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:32.736610 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea8523-ee70-4ee4-8beb-71c90f8d0e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:32.737262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea8523-ee70-4ee4-8beb-71c90f8d0e4e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:32.737512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea8523-ee70-4ee4-8beb-71c90f8d0e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:32.737781 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea8523-ee70-4ee4-8beb-71c90f8d0e4e None admin] PATH_INFO: `/v3/services/image` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:32.738354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea8523-ee70-4ee4-8beb-71c90f8d0e4e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:32.739727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea8523-ee70-4ee4-8beb-71c90f8d0e4e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6dea8523-ee70-4ee4-8beb-71c90f8d0e4e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:32.749006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:32.750298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:32.751161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 511/1004] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 18 06:12:32 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:32.756074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea8523-ee70-4ee4-8beb-71c90f8d0e4e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:32.764602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6c53d-8f91-411f-b31b-e84b6c25de5c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:32.779198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:32.803102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b1487-99c7-499f-9645-fff35f0ff1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:32.803816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b1487-99c7-499f-9645-fff35f0ff1df None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:32.804206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b1487-99c7-499f-9645-fff35f0ff1df None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:32.804555 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b1487-99c7-499f-9645-fff35f0ff1df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:32.805279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b1487-99c7-499f-9645-fff35f0ff1df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:32.806703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b1487-99c7-499f-9645-fff35f0ff1df None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:32.835253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 494/1005] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:12:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:12:32.872088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea8523-ee70-4ee4-8beb-71c90f8d0e4e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:32.883709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:32.921822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec3610-66c0-4768-88f8-09e225404982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:32.922436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec3610-66c0-4768-88f8-09e225404982 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:32.922711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec3610-66c0-4768-88f8-09e225404982 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:32.922981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec3610-66c0-4768-88f8-09e225404982 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:32.923606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec3610-66c0-4768-88f8-09e225404982 None admin] RBAC: Adding query filter params (name=image) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:32.923975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec3610-66c0-4768-88f8-09e225404982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:32.925312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec3610-66c0-4768-88f8-09e225404982 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:32.931083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 512/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:32.937210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b1487-99c7-499f-9645-fff35f0ff1df None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:33.047368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b1487-99c7-499f-9645-fff35f0ff1df None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:33.081941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b78804-c7d0-4486-b6a0-24026ffc82a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:33.082548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b78804-c7d0-4486-b6a0-24026ffc82a4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:33.082830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b78804-c7d0-4486-b6a0-24026ffc82a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:33.083102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b78804-c7d0-4486-b6a0-24026ffc82a4 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:33.083755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b78804-c7d0-4486-b6a0-24026ffc82a4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:33.084062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b78804-c7d0-4486-b6a0-24026ffc82a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:33.085421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b78804-c7d0-4486-b6a0-24026ffc82a4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:33.090238 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 495/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:34.613494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dfaaf-3402-40d7-9b48-4c94d6f97f06 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:34.614023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dfaaf-3402-40d7-9b48-4c94d6f97f06 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:34.614023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dfaaf-3402-40d7-9b48-4c94d6f97f06 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:34.615514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 513/1008] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:34.620700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944718-04ea-4c72-8255-cf0e220d8707 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:34.621159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944718-04ea-4c72-8255-cf0e220d8707 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:34.621298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944718-04ea-4c72-8255-cf0e220d8707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:34.640187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f2944718-04ea-4c72-8255-cf0e220d8707 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:34.641391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f2944718-04ea-4c72-8255-cf0e220d8707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:34.672098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:34.712944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 496/1009] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:34.983763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dfaaf-3402-40d7-9b48-4c94d6f97f06 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:35.000208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bb6f6-ab68-4666-a2dd-bc83c1ba3991 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:35.000496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bb6f6-ab68-4666-a2dd-bc83c1ba3991 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:35.000747 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bb6f6-ab68-4666-a2dd-bc83c1ba3991 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:35.002331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 497/1010] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:35.007925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc403-e802-4baf-9d25-6fc89320f14b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:35.008216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc403-e802-4baf-9d25-6fc89320f14b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:35.008491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc403-e802-4baf-9d25-6fc89320f14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:35.029516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cfedc403-e802-4baf-9d25-6fc89320f14b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:35.031231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cfedc403-e802-4baf-9d25-6fc89320f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:35.095752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dfaaf-3402-40d7-9b48-4c94d6f97f06 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:35.102992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 498/1011] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:35.131952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f506124-8b47-4976-a8e9-b4afb0efd98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:35.132605 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f506124-8b47-4976-a8e9-b4afb0efd98a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:35.132877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f506124-8b47-4976-a8e9-b4afb0efd98a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:35.133146 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f506124-8b47-4976-a8e9-b4afb0efd98a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:35.133727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f506124-8b47-4976-a8e9-b4afb0efd98a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:35.135128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f506124-8b47-4976-a8e9-b4afb0efd98a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-3f506124-8b47-4976-a8e9-b4afb0efd98a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:35.145668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:35.146747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 06:12:35.147604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:35.153623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 514/1012] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:35.153782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc403-e802-4baf-9d25-6fc89320f14b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:35.242291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef73e8-63b1-41ca-bb7d-b738d90af2a8 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:35.242498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef73e8-63b1-41ca-bb7d-b738d90af2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:35.242743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef73e8-63b1-41ca-bb7d-b738d90af2a8 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:35.244948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 515/1013] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:35.253192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7375290-3df6-43cf-a548-acec4ae43921 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:35.253192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7375290-3df6-43cf-a548-acec4ae43921 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:35.253192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7375290-3df6-43cf-a548-acec4ae43921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:35.253834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:35.258107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc403-e802-4baf-9d25-6fc89320f14b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:35.272003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e7375290-3df6-43cf-a548-acec4ae43921 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:35.273501 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e7375290-3df6-43cf-a548-acec4ae43921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:35.293936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9139d0c-64d2-4544-9b8a-18f70ad01616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:35.294682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9139d0c-64d2-4544-9b8a-18f70ad01616 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:35.294958 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9139d0c-64d2-4544-9b8a-18f70ad01616 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:35.295223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9139d0c-64d2-4544-9b8a-18f70ad01616 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:35.296305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9139d0c-64d2-4544-9b8a-18f70ad01616 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:35.296715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9139d0c-64d2-4544-9b8a-18f70ad01616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:35.297958 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9139d0c-64d2-4544-9b8a-18f70ad01616 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:35.301473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:35.308804 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 499/1014] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:12:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:35.309805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9139d0c-64d2-4544-9b8a-18f70ad01616 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:35.348967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 516/1015] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:35.373823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7375290-3df6-43cf-a548-acec4ae43921 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:35.415077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9139d0c-64d2-4544-9b8a-18f70ad01616 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:35.452253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e70db-64a8-449a-b1c4-5443ca0336fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:35.453572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e70db-64a8-449a-b1c4-5443ca0336fe None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:35.454109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e70db-64a8-449a-b1c4-5443ca0336fe None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:35.454585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e70db-64a8-449a-b1c4-5443ca0336fe None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:35.455774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e70db-64a8-449a-b1c4-5443ca0336fe None admin] RBAC: Adding query filter params (type=compute) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:35.456310 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e70db-64a8-449a-b1c4-5443ca0336fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:35.458168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e70db-64a8-449a-b1c4-5443ca0336fe None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:35.463573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 500/1016] 10.222.0.16 () {56 vars in 1112 bytes} [Sun Sep 18 06:12:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:35.469024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e70db-64a8-449a-b1c4-5443ca0336fe None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:35.479011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7375290-3df6-43cf-a548-acec4ae43921 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:35.499814 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:35.516569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ee304-accb-4a7d-a1bb-91b72720d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:35.517197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ee304-accb-4a7d-a1bb-91b72720d719 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:35.517475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ee304-accb-4a7d-a1bb-91b72720d719 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:35.517743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ee304-accb-4a7d-a1bb-91b72720d719 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:35.518864 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ee304-accb-4a7d-a1bb-91b72720d719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:35.520848 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ee304-accb-4a7d-a1bb-91b72720d719 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:35.522946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 517/1017] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:35.529007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ee304-accb-4a7d-a1bb-91b72720d719 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:35.563271 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:35.593948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e70db-64a8-449a-b1c4-5443ca0336fe None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:35.630550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d479be-24b3-493c-80b9-1239b6ead2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:35.631179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d479be-24b3-493c-80b9-1239b6ead2e2 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:35.631412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d479be-24b3-493c-80b9-1239b6ead2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:35.631682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d479be-24b3-493c-80b9-1239b6ead2e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:35.632374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d479be-24b3-493c-80b9-1239b6ead2e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:35.633724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d479be-24b3-493c-80b9-1239b6ead2e2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:35.639625 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ee304-accb-4a7d-a1bb-91b72720d719 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:35.654447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 501/1018] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:12:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:12:35.655557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d479be-24b3-493c-80b9-1239b6ead2e2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:35.696193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f932d-ef3a-4d59-b169-069554e40f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:35.696808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f932d-ef3a-4d59-b169-069554e40f48 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:35.697087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f932d-ef3a-4d59-b169-069554e40f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:35.697361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f932d-ef3a-4d59-b169-069554e40f48 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:35.698014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f932d-ef3a-4d59-b169-069554e40f48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:35.700026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f932d-ef3a-4d59-b169-069554e40f48 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:35.731348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 518/1019] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:12:35 2022] POST /identity/v3/projects => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:12:35.762446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:35.777618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d479be-24b3-493c-80b9-1239b6ead2e2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:35.817212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41098ecb-17b6-4a81-afe5-a133b4c7857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:35.817852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098ecb-17b6-4a81-afe5-a133b4c7857c None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:35.818144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098ecb-17b6-4a81-afe5-a133b4c7857c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:35.818405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098ecb-17b6-4a81-afe5-a133b4c7857c None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:35.819088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41098ecb-17b6-4a81-afe5-a133b4c7857c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:35.820572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41098ecb-17b6-4a81-afe5-a133b4c7857c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:35.847860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 502/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:12:35 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:37.961251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab77a71-0f3b-4394-9b3e-5978f353b0a1 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:37.961829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab77a71-0f3b-4394-9b3e-5978f353b0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:37.961829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab77a71-0f3b-4394-9b3e-5978f353b0a1 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:37.963954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 519/1021] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:37.969807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644f86-f4c8-4257-9602-b84f6777a356 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:37.970343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644f86-f4c8-4257-9602-b84f6777a356 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:37.970343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644f86-f4c8-4257-9602-b84f6777a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:37.975099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2a5a4-6fca-4a34-bda2-d8bcc99ccb9a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:37.975384 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2a5a4-6fca-4a34-bda2-d8bcc99ccb9a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:37.975665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2a5a4-6fca-4a34-bda2-d8bcc99ccb9a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:37.977204 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 520/1022] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:37.982928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec707a2-be00-4b40-8630-1a4a185aec7e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:37.983225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec707a2-be00-4b40-8630-1a4a185aec7e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:37.983485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec707a2-be00-4b40-8630-1a4a185aec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:37.990506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-55644f86-f4c8-4257-9602-b84f6777a356 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:37.992745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-55644f86-f4c8-4257-9602-b84f6777a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:38.002171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8ec707a2-be00-4b40-8630-1a4a185aec7e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:38.003619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8ec707a2-be00-4b40-8630-1a4a185aec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:38.074719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 503/1023] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:38.082680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 521/1024] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:38.090436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd90f0f-0739-4555-a584-9dc4eecc7046 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:38.090745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd90f0f-0739-4555-a584-9dc4eecc7046 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:38.090922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd90f0f-0739-4555-a584-9dc4eecc7046 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:38.092403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 504/1025] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:38.097373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03128950-6504-4ebc-8949-1c829aa4998d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:38.097660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03128950-6504-4ebc-8949-1c829aa4998d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:38.097938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03128950-6504-4ebc-8949-1c829aa4998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:38.105034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:38.116567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-03128950-6504-4ebc-8949-1c829aa4998d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:38.117753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-03128950-6504-4ebc-8949-1c829aa4998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:38.187940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 522/1026] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:38.349366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd90f0f-0739-4555-a584-9dc4eecc7046 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:38.352472 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03128950-6504-4ebc-8949-1c829aa4998d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:38.423555 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:38.460976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd90f0f-0739-4555-a584-9dc4eecc7046 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:38.461810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03128950-6504-4ebc-8949-1c829aa4998d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:38.494328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee04a9a-0aeb-49d2-a519-f9376e2f4686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:38.494944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee04a9a-0aeb-49d2-a519-f9376e2f4686 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:38.495052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253620a-24d2-4081-a52d-2996dfe9ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:38.495219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee04a9a-0aeb-49d2-a519-f9376e2f4686 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:38.495516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee04a9a-0aeb-49d2-a519-f9376e2f4686 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:38.495669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253620a-24d2-4081-a52d-2996dfe9ce30 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:38.496203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253620a-24d2-4081-a52d-2996dfe9ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:38.496480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253620a-24d2-4081-a52d-2996dfe9ce30 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:38.496712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee04a9a-0aeb-49d2-a519-f9376e2f4686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:38.498586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee04a9a-0aeb-49d2-a519-f9376e2f4686 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:38.498701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:38.499725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 505/1027] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:38.500491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee04a9a-0aeb-49d2-a519-f9376e2f4686 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:38.509867 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253620a-24d2-4081-a52d-2996dfe9ce30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-5253620a-24d2-4081-a52d-2996dfe9ce30 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:38.515397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:38.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 523/1028] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 18 06:12:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:38.517396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253620a-24d2-4081-a52d-2996dfe9ce30 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:38.609121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee04a9a-0aeb-49d2-a519-f9376e2f4686 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:38.619096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253620a-24d2-4081-a52d-2996dfe9ce30 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:38.643110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32758402-785e-4aea-aad2-9201dc564be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:38.643720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758402-785e-4aea-aad2-9201dc564be5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:38.644028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758402-785e-4aea-aad2-9201dc564be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:38.644295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758402-785e-4aea-aad2-9201dc564be5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:38.644863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32758402-785e-4aea-aad2-9201dc564be5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:38.646206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32758402-785e-4aea-aad2-9201dc564be5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:38.647955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:38.653034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57399b-7a07-4406-b9bd-97ae7998613c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:38.653635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57399b-7a07-4406-b9bd-97ae7998613c None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:38.653912 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57399b-7a07-4406-b9bd-97ae7998613c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:38.654183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57399b-7a07-4406-b9bd-97ae7998613c None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:38.654827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57399b-7a07-4406-b9bd-97ae7998613c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:38.656277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57399b-7a07-4406-b9bd-97ae7998613c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-32758402-785e-4aea-aad2-9201dc564be5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:38.656375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:38.657288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:38.658144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 506/1029] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 18 06:12:38 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:38.658957 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32758402-785e-4aea-aad2-9201dc564be5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:38.687991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 524/1030] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:12:38 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:38.687991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57399b-7a07-4406-b9bd-97ae7998613c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:38.751913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:38.779246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32758402-785e-4aea-aad2-9201dc564be5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:38.811644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57399b-7a07-4406-b9bd-97ae7998613c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:38.816524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f91c-ecf1-4e06-a5a6-53512871e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:38.817143 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f91c-ecf1-4e06-a5a6-53512871e525 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:38.817420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f91c-ecf1-4e06-a5a6-53512871e525 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:38.817694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f91c-ecf1-4e06-a5a6-53512871e525 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:38.818364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f91c-ecf1-4e06-a5a6-53512871e525 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:38.818672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f91c-ecf1-4e06-a5a6-53512871e525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:38.820140 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f91c-ecf1-4e06-a5a6-53512871e525 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:38.836895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 507/1031] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 18 06:12:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:38.844410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f91c-ecf1-4e06-a5a6-53512871e525 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:38.852372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ebaf1-681f-4191-9eb5-b3f4db070049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:38.852657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebaf1-681f-4191-9eb5-b3f4db070049 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:38.852861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebaf1-681f-4191-9eb5-b3f4db070049 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:38.853140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebaf1-681f-4191-9eb5-b3f4db070049 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:38.853775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ebaf1-681f-4191-9eb5-b3f4db070049 None admin] RBAC: Adding query filter params (name=image) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:38.854078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ebaf1-681f-4191-9eb5-b3f4db070049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:38.855614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ebaf1-681f-4191-9eb5-b3f4db070049 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:38.861497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 525/1032] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:38.867395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ebaf1-681f-4191-9eb5-b3f4db070049 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:38.916256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:38.963305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f91c-ecf1-4e06-a5a6-53512871e525 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:38.977938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ebaf1-681f-4191-9eb5-b3f4db070049 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:38.992567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:39.006513 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521222-57c6-463d-989d-11b65084d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:39.007145 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521222-57c6-463d-989d-11b65084d372 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:39.007423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521222-57c6-463d-989d-11b65084d372 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:39.007692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521222-57c6-463d-989d-11b65084d372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:39.014535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087d067-74ad-4c3b-8698-a8e237de0a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:39.015146 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087d067-74ad-4c3b-8698-a8e237de0a4d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:39.015425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087d067-74ad-4c3b-8698-a8e237de0a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:39.015697 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087d067-74ad-4c3b-8698-a8e237de0a4d None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:39.016359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087d067-74ad-4c3b-8698-a8e237de0a4d None admin] RBAC: Adding query filter params (type=image) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:39.016663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087d067-74ad-4c3b-8698-a8e237de0a4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:39.018033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087d067-74ad-4c3b-8698-a8e237de0a4d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:39.020346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521222-57c6-463d-989d-11b65084d372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:39.022016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521222-57c6-463d-989d-11b65084d372 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:39.023237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 526/1033] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:39.029344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087d067-74ad-4c3b-8698-a8e237de0a4d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-65521222-57c6-463d-989d-11b65084d372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:39.041478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:39.042729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:39.043773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:39.043773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:39.043773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:39.043773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 508/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:39.048594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521222-57c6-463d-989d-11b65084d372 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:39.138524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087d067-74ad-4c3b-8698-a8e237de0a4d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:39.157357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521222-57c6-463d-989d-11b65084d372 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:39.171482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:39.174833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e923e-083e-4478-af61-f800325a348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:39.175440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e923e-083e-4478-af61-f800325a348b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:39.175719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e923e-083e-4478-af61-f800325a348b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:39.176026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e923e-083e-4478-af61-f800325a348b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:39.176723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e923e-083e-4478-af61-f800325a348b None admin] RBAC: Adding query filter params (interface=public, service_id=3dc8db694c5a4a29a5c9717514d436f9, region_id=RegionOne) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:39.177032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e923e-083e-4478-af61-f800325a348b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:39.178407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e923e-083e-4478-af61-f800325a348b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:39.184453 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 527/1035] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 18 06:12:39 2022] GET /identity/v3/endpoints?service_id=3dc8db694c5a4a29a5c9717514d436f9&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:39.189973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e923e-083e-4478-af61-f800325a348b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:39.197809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde7dae-0fc8-4be5-becd-5af698cfcaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:39.198404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde7dae-0fc8-4be5-becd-5af698cfcaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:39.199981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde7dae-0fc8-4be5-becd-5af698cfcaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:39.200396 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde7dae-0fc8-4be5-becd-5af698cfcaf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:39.201832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde7dae-0fc8-4be5-becd-5af698cfcaf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:39.202143 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde7dae-0fc8-4be5-becd-5af698cfcaf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:39.203886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde7dae-0fc8-4be5-becd-5af698cfcaf4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:39.221390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 509/1036] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:39.222966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde7dae-0fc8-4be5-becd-5af698cfcaf4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:39.244531 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:39.305626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e923e-083e-4478-af61-f800325a348b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:39.331121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde7dae-0fc8-4be5-becd-5af698cfcaf4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:39.339438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60cf67-01af-46e0-8166-2d449f6e13e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:39.340193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60cf67-01af-46e0-8166-2d449f6e13e9 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:39.340472 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60cf67-01af-46e0-8166-2d449f6e13e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:39.340745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60cf67-01af-46e0-8166-2d449f6e13e9 None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:39.341336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60cf67-01af-46e0-8166-2d449f6e13e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:39.342695 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60cf67-01af-46e0-8166-2d449f6e13e9 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:39.349198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 528/1037] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 18 06:12:39 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:12:39.380740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124fc94-f849-46f9-a687-cdec1cd43c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:39.381393 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124fc94-f849-46f9-a687-cdec1cd43c31 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:39.381673 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124fc94-f849-46f9-a687-cdec1cd43c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:39.381949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124fc94-f849-46f9-a687-cdec1cd43c31 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:39.391379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124fc94-f849-46f9-a687-cdec1cd43c31 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:39.392910 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124fc94-f849-46f9-a687-cdec1cd43c31 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-4124fc94-f849-46f9-a687-cdec1cd43c31 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:39.407641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:39.408723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:39.409692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:39.409692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:39.409692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:39.409692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:39.409692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:39.409692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:39.409692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:39.409692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:39.409692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:12:39.409692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:39.409692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 510/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 18 06:12:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:39.415215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60cf67-01af-46e0-8166-2d449f6e13e9 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:39.528626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60cf67-01af-46e0-8166-2d449f6e13e9 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:39.536465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:39.566294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dec17-a5b9-4599-8afd-8aca128d085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:39.566905 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dec17-a5b9-4599-8afd-8aca128d085d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:39.567183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dec17-a5b9-4599-8afd-8aca128d085d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:39.567451 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dec17-a5b9-4599-8afd-8aca128d085d None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:39.568201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dec17-a5b9-4599-8afd-8aca128d085d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:39.568503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dec17-a5b9-4599-8afd-8aca128d085d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:39.569927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dec17-a5b9-4599-8afd-8aca128d085d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:39.587601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 529/1039] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 18 06:12:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:39.594457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124fc94-f849-46f9-a687-cdec1cd43c31 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:39.626470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:39.700538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124fc94-f849-46f9-a687-cdec1cd43c31 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:39.739330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cfae0-f518-40f3-9fda-948ee07ba38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:39.739953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cfae0-f518-40f3-9fda-948ee07ba38d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:39.740234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cfae0-f518-40f3-9fda-948ee07ba38d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:39.740508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cfae0-f518-40f3-9fda-948ee07ba38d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:39.808355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cfae0-f518-40f3-9fda-948ee07ba38d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:39.810135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cfae0-f518-40f3-9fda-948ee07ba38d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:39.848713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:39.920661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 511/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 18 06:12:39.926526 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dec17-a5b9-4599-8afd-8aca128d085d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:40.029475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dec17-a5b9-4599-8afd-8aca128d085d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:40.063597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f79b35-e38d-4deb-ac1e-f74f36bba52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:40.064252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f79b35-e38d-4deb-ac1e-f74f36bba52a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:40.064531 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f79b35-e38d-4deb-ac1e-f74f36bba52a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:40.064804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f79b35-e38d-4deb-ac1e-f74f36bba52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:40.075430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f79b35-e38d-4deb-ac1e-f74f36bba52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:40.076911 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f79b35-e38d-4deb-ac1e-f74f36bba52a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d6f79b35-e38d-4deb-ac1e-f74f36bba52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:40.092330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:40.093333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:40.094251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:40.094251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:40.094251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:40.096230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 530/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:40.099116 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cfae0-f518-40f3-9fda-948ee07ba38d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:40.200870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cfae0-f518-40f3-9fda-948ee07ba38d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:40.229390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:40.235985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02701db4-26c6-41b8-96ae-874295a377c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:40.236595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02701db4-26c6-41b8-96ae-874295a377c2 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:40.236865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02701db4-26c6-41b8-96ae-874295a377c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:40.237135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02701db4-26c6-41b8-96ae-874295a377c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:40.237797 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02701db4-26c6-41b8-96ae-874295a377c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:40.238096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02701db4-26c6-41b8-96ae-874295a377c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:40.239444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02701db4-26c6-41b8-96ae-874295a377c2 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:40.257299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 512/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:40.258830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f79b35-e38d-4deb-ac1e-f74f36bba52a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:40.278274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:40.362997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f79b35-e38d-4deb-ac1e-f74f36bba52a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:40.396093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec45505-ff96-40bd-ac92-c36363ba4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:40.396716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45505-ff96-40bd-ac92-c36363ba4e39 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:40.396995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45505-ff96-40bd-ac92-c36363ba4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:40.397269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45505-ff96-40bd-ac92-c36363ba4e39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:40.404661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec45505-ff96-40bd-ac92-c36363ba4e39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:40.406106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec45505-ff96-40bd-ac92-c36363ba4e39 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-0ec45505-ff96-40bd-ac92-c36363ba4e39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:40.417297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:40.418719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:40.419628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:40.419628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:40.419628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:40.419628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:40.419628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:40.419628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:40.419628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:40.419628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:40.423961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 531/1043] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:40.425507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02701db4-26c6-41b8-96ae-874295a377c2 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:40.531124 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02701db4-26c6-41b8-96ae-874295a377c2 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:40.566335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9c58d-24f0-403d-a127-f3d43da1da9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:40.566944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9c58d-24f0-403d-a127-f3d43da1da9c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:40.567223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9c58d-24f0-403d-a127-f3d43da1da9c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:40.567496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9c58d-24f0-403d-a127-f3d43da1da9c None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:40.568233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9c58d-24f0-403d-a127-f3d43da1da9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:40.568529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9c58d-24f0-403d-a127-f3d43da1da9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:40.569947 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9c58d-24f0-403d-a127-f3d43da1da9c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:40.587401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 513/1044] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:40.588673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec45505-ff96-40bd-ac92-c36363ba4e39 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:40.668094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:40.691999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec45505-ff96-40bd-ac92-c36363ba4e39 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:40.725892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68efcf-03ce-4a40-a54c-18d0b76f7bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:40.726488 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68efcf-03ce-4a40-a54c-18d0b76f7bdb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:40.726765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68efcf-03ce-4a40-a54c-18d0b76f7bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:40.727036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68efcf-03ce-4a40-a54c-18d0b76f7bdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:40.727748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68efcf-03ce-4a40-a54c-18d0b76f7bdb None admin] RBAC: Adding query filter params (role.id=3363af7e4d4945c692ccb6a46a4d61ca, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=9b5585d29bcb4b03a1902fbf113f48e8) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:40.728085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68efcf-03ce-4a40-a54c-18d0b76f7bdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:40.729507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68efcf-03ce-4a40-a54c-18d0b76f7bdb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:40.740228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 532/1045] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:40 2022] GET /identity/v3/role_assignments?user.id=9b5585d29bcb4b03a1902fbf113f48e8&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=3363af7e4d4945c692ccb6a46a4d61ca => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:40.953433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c2536-40c2-4df9-a27e-627e5d8a9c66 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:40.953737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c2536-40c2-4df9-a27e-627e5d8a9c66 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:40.953902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c2536-40c2-4df9-a27e-627e5d8a9c66 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:40.955374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 514/1046] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:40.960504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72b07-bd63-4e2a-8bd9-1548f5ead963 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:40.960784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72b07-bd63-4e2a-8bd9-1548f5ead963 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:40.961055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72b07-bd63-4e2a-8bd9-1548f5ead963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:40.980426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b6b72b07-bd63-4e2a-8bd9-1548f5ead963 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:40.981608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b6b72b07-bd63-4e2a-8bd9-1548f5ead963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:41.055933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 533/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:41.329311 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c2536-40c2-4df9-a27e-627e5d8a9c66 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:41.387134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:41.439835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c2536-40c2-4df9-a27e-627e5d8a9c66 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:41.476979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f41f5-21ff-49f0-a6f2-ccb6a85b25ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:41.477601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f41f5-21ff-49f0-a6f2-ccb6a85b25ab None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:41.477874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f41f5-21ff-49f0-a6f2-ccb6a85b25ab None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:41.478140 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f41f5-21ff-49f0-a6f2-ccb6a85b25ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:41.489220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f41f5-21ff-49f0-a6f2-ccb6a85b25ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e57f41f5-21ff-49f0-a6f2-ccb6a85b25ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:41.494003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:41.494953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:41.496498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:41.497888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 515/1048] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:12:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:41.501896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b72b07-bd63-4e2a-8bd9-1548f5ead963 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:41.545421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d816-40d6-4364-8ded-dbd312c62e05 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:41.545767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d816-40d6-4364-8ded-dbd312c62e05 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:41.545983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d816-40d6-4364-8ded-dbd312c62e05 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:41.547317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 516/1049] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:41.552245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139efb-182e-4e25-ad0f-0db915b2583c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:41.552535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139efb-182e-4e25-ad0f-0db915b2583c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:41.552812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139efb-182e-4e25-ad0f-0db915b2583c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:41.571384 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-23139efb-182e-4e25-ad0f-0db915b2583c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:41.572633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-23139efb-182e-4e25-ad0f-0db915b2583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:41.574920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:41.608091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b72b07-bd63-4e2a-8bd9-1548f5ead963 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:41.643695 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d2113-322a-4e35-bf5e-02d075b28deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:41.644324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d2113-322a-4e35-bf5e-02d075b28deb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:41.644603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d2113-322a-4e35-bf5e-02d075b28deb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:41.644874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d2113-322a-4e35-bf5e-02d075b28deb None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:41.645524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d2113-322a-4e35-bf5e-02d075b28deb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:41.645823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d2113-322a-4e35-bf5e-02d075b28deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:41.646245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 517/1050] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:41.649262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d2113-322a-4e35-bf5e-02d075b28deb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:41.658008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 534/1051] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:12:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:41.663780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23139efb-182e-4e25-ad0f-0db915b2583c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:41.706892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:41.769367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23139efb-182e-4e25-ad0f-0db915b2583c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:41.802984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6c9c-0f96-4f45-a157-cf8432defbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:41.803607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6c9c-0f96-4f45-a157-cf8432defbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:41.803884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6c9c-0f96-4f45-a157-cf8432defbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:41.804184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6c9c-0f96-4f45-a157-cf8432defbe6 None admin] PATH_INFO: `/v3/users/bcfa2907688b43f19ad73a85b1984f0a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:41.820828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b6c9c-0f96-4f45-a157-cf8432defbe6 None admin] RBAC: Authorizing `identity:get_user(user_id=bcfa2907688b43f19ad73a85b1984f0a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:41.822261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b6c9c-0f96-4f45-a157-cf8432defbe6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:41.824325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 518/1052] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:12:41 2022] GET /identity/v3/users/bcfa2907688b43f19ad73a85b1984f0a => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:41.832049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d2113-322a-4e35-bf5e-02d075b28deb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:41.918654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6c9c-0f96-4f45-a157-cf8432defbe6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:41.943862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d2113-322a-4e35-bf5e-02d075b28deb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:41.973130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:41.980464 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfc879-d181-4f04-af94-7a70d4e3f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:41.981089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfc879-d181-4f04-af94-7a70d4e3f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:41.981632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfc879-d181-4f04-af94-7a70d4e3f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:41.981912 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfc879-d181-4f04-af94-7a70d4e3f1f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:42.025999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:42.029894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6c9c-0f96-4f45-a157-cf8432defbe6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:42.054948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfc879-d181-4f04-af94-7a70d4e3f1f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:42.056445 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfc879-d181-4f04-af94-7a70d4e3f1f1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:42.070179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0918058-87b1-4ca6-85f3-d7a42cc75c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:42.070807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0918058-87b1-4ca6-85f3-d7a42cc75c52 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:42.071085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0918058-87b1-4ca6-85f3-d7a42cc75c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:42.071358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0918058-87b1-4ca6-85f3-d7a42cc75c52 None admin] PATH_INFO: `/v3/services/image` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:42.071955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0918058-87b1-4ca6-85f3-d7a42cc75c52 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:42.073331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0918058-87b1-4ca6-85f3-d7a42cc75c52 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e0918058-87b1-4ca6-85f3-d7a42cc75c52 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:42.082464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:42.083442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:42.085135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 519/1053] 10.222.0.16 () {56 vars in 1105 bytes} [Sun Sep 18 06:12:41 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:42.089866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0918058-87b1-4ca6-85f3-d7a42cc75c52 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:42.165815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 535/1054] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:12:42.167614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfc879-d181-4f04-af94-7a70d4e3f1f1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:42.197247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:42.200228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0918058-87b1-4ca6-85f3-d7a42cc75c52 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:42.235460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000af6f-7b06-420d-bb57-084719d82003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:42.236110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000af6f-7b06-420d-bb57-084719d82003 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:42.236488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000af6f-7b06-420d-bb57-084719d82003 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:42.236665 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000af6f-7b06-420d-bb57-084719d82003 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:42.237280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000af6f-7b06-420d-bb57-084719d82003 None admin] RBAC: Adding query filter params (name=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:42.237580 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000af6f-7b06-420d-bb57-084719d82003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:42.239537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000af6f-7b06-420d-bb57-084719d82003 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:42.243971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 520/1055] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:42.249492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000af6f-7b06-420d-bb57-084719d82003 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:42.274357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfc879-d181-4f04-af94-7a70d4e3f1f1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:42.279738 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:42.309222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc6257-bdb5-4291-b37e-8979e21dfb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:42.309850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6257-bdb5-4291-b37e-8979e21dfb2c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:42.310129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6257-bdb5-4291-b37e-8979e21dfb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:42.310403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc6257-bdb5-4291-b37e-8979e21dfb2c None admin] PATH_INFO: `/v3/projects/964283af581f488b90ec52639bf0384c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:42.311529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc6257-bdb5-4291-b37e-8979e21dfb2c None admin] RBAC: Authorizing `identity:get_project(project_id=964283af581f488b90ec52639bf0384c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:42.312996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc6257-bdb5-4291-b37e-8979e21dfb2c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:42.315037 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 536/1056] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:12:42 2022] GET /identity/v3/projects/964283af581f488b90ec52639bf0384c => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:42.321420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc6257-bdb5-4291-b37e-8979e21dfb2c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:42.366457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000af6f-7b06-420d-bb57-084719d82003 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:42.407050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08c1d5-dc60-4aa2-ac2e-1f4e85d39b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:42.407655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08c1d5-dc60-4aa2-ac2e-1f4e85d39b61 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:42.407957 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08c1d5-dc60-4aa2-ac2e-1f4e85d39b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:42.408235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08c1d5-dc60-4aa2-ac2e-1f4e85d39b61 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:42.408857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08c1d5-dc60-4aa2-ac2e-1f4e85d39b61 None admin] RBAC: Adding query filter params (type=image) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:42.409162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08c1d5-dc60-4aa2-ac2e-1f4e85d39b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:42.410526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08c1d5-dc60-4aa2-ac2e-1f4e85d39b61 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:42.415355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 521/1057] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:42.421772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08c1d5-dc60-4aa2-ac2e-1f4e85d39b61 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:42.430924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:42.434518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc6257-bdb5-4291-b37e-8979e21dfb2c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:42.473532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2163c8e-9bb5-46ce-ac40-7482aa2d7fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:42.474048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2163c8e-9bb5-46ce-ac40-7482aa2d7fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:42.474326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2163c8e-9bb5-46ce-ac40-7482aa2d7fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:42.474645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2163c8e-9bb5-46ce-ac40-7482aa2d7fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:42.475307 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2163c8e-9bb5-46ce-ac40-7482aa2d7fc5 None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=964283af581f488b90ec52639bf0384c, user.id=bcfa2907688b43f19ad73a85b1984f0a) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:42.475608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2163c8e-9bb5-46ce-ac40-7482aa2d7fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:42.477074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2163c8e-9bb5-46ce-ac40-7482aa2d7fc5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:42.483945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 537/1058] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:42 2022] GET /identity/v3/role_assignments?user.id=bcfa2907688b43f19ad73a85b1984f0a&scope.project.id=964283af581f488b90ec52639bf0384c&role.id=4494ba66c3f649febc69511a47e27b67 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:42.530919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:42.541360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08c1d5-dc60-4aa2-ac2e-1f4e85d39b61 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:42.580042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179879a-8248-4799-948e-d8d64ba67488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:42.580663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179879a-8248-4799-948e-d8d64ba67488 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:42.580938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179879a-8248-4799-948e-d8d64ba67488 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:42.581210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179879a-8248-4799-948e-d8d64ba67488 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:42.581894 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179879a-8248-4799-948e-d8d64ba67488 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:42.583569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179879a-8248-4799-948e-d8d64ba67488 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:42.611955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 522/1059] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:12:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:12:42.911611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c773-64fe-48fd-ab7d-abd70f98e377 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:42.911893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c773-64fe-48fd-ab7d-abd70f98e377 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:42.912199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953c773-64fe-48fd-ab7d-abd70f98e377 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:42.913528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 538/1060] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:42.919888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f801a-46bf-48bf-9691-612da4a761e7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:42.920202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f801a-46bf-48bf-9691-612da4a761e7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:42.920473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f801a-46bf-48bf-9691-612da4a761e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:42.938613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-928f801a-46bf-48bf-9691-612da4a761e7 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:42.939790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-928f801a-46bf-48bf-9691-612da4a761e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:43.014062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 523/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:43.279124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953c773-64fe-48fd-ab7d-abd70f98e377 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:43.385533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953c773-64fe-48fd-ab7d-abd70f98e377 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:43.420525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc11e0f-6ea2-418b-901f-8d48d5cd4563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:43.421145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc11e0f-6ea2-418b-901f-8d48d5cd4563 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:43.421416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc11e0f-6ea2-418b-901f-8d48d5cd4563 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:43.421680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc11e0f-6ea2-418b-901f-8d48d5cd4563 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:43.431458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc11e0f-6ea2-418b-901f-8d48d5cd4563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7dc11e0f-6ea2-418b-901f-8d48d5cd4563 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:43.436557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:43.437521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:43.438396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:43.440220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 539/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 18 06:12:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:43.443786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f801a-46bf-48bf-9691-612da4a761e7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:43.520119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:43.548549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f801a-46bf-48bf-9691-612da4a761e7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:43.581877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fefe8-73b8-4b97-be5f-2a5427dfeac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:43.582468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fefe8-73b8-4b97-be5f-2a5427dfeac4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:43.582741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fefe8-73b8-4b97-be5f-2a5427dfeac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:43.583009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fefe8-73b8-4b97-be5f-2a5427dfeac4 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:43.583655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fefe8-73b8-4b97-be5f-2a5427dfeac4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:43.583979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fefe8-73b8-4b97-be5f-2a5427dfeac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:43.585332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fefe8-73b8-4b97-be5f-2a5427dfeac4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:43.594137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 524/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 18 06:12:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:43.599746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc11e0f-6ea2-418b-901f-8d48d5cd4563 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:43.626130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:43.702648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc11e0f-6ea2-418b-901f-8d48d5cd4563 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:43.737170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c0459-207f-40cd-8e38-98498078fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:43.737798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c0459-207f-40cd-8e38-98498078fe02 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:43.738071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c0459-207f-40cd-8e38-98498078fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:43.738392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c0459-207f-40cd-8e38-98498078fe02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:43.748770 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c0459-207f-40cd-8e38-98498078fe02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:43.750238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c0459-207f-40cd-8e38-98498078fe02 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-eb9c0459-207f-40cd-8e38-98498078fe02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:43.765734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:43.766703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:43.767626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:43.767626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:43.767626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:43.771601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 540/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:43.773037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fefe8-73b8-4b97-be5f-2a5427dfeac4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:43.889229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fefe8-73b8-4b97-be5f-2a5427dfeac4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:43.928660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b916acd-63cd-420b-b94d-3989a08c9e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:43.929642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b916acd-63cd-420b-b94d-3989a08c9e1c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:43.930128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b916acd-63cd-420b-b94d-3989a08c9e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:43.930645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b916acd-63cd-420b-b94d-3989a08c9e1c None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:43.931500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b916acd-63cd-420b-b94d-3989a08c9e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:43.932046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b916acd-63cd-420b-b94d-3989a08c9e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:43.933874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b916acd-63cd-420b-b94d-3989a08c9e1c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:43.936993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:43.950117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 525/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:43.961345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c0459-207f-40cd-8e38-98498078fe02 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:44.072326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:44.099534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c0459-207f-40cd-8e38-98498078fe02 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:44.134363 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706714eb-97f8-48cc-aaca-19da75ee486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:44.134994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706714eb-97f8-48cc-aaca-19da75ee486c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:44.135276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706714eb-97f8-48cc-aaca-19da75ee486c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:44.135549 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706714eb-97f8-48cc-aaca-19da75ee486c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:44.143782 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706714eb-97f8-48cc-aaca-19da75ee486c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:44.145258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706714eb-97f8-48cc-aaca-19da75ee486c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-706714eb-97f8-48cc-aaca-19da75ee486c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:44.156871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:44.157844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:44.161044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:44.161044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:44.161044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:44.161044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:44.161044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:44.161044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:44.161044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:44.161044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:44.161044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:12:44.161044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:44.161044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 541/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 18 06:12:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:44.167605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b916acd-63cd-420b-b94d-3989a08c9e1c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:44.272092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b916acd-63cd-420b-b94d-3989a08c9e1c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:44.309770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de270b-eda8-455a-b9d7-df492304ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:44.310741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de270b-eda8-455a-b9d7-df492304ed5e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:44.311227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de270b-eda8-455a-b9d7-df492304ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:44.311703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de270b-eda8-455a-b9d7-df492304ed5e None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:44.312699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de270b-eda8-455a-b9d7-df492304ed5e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:44.313209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de270b-eda8-455a-b9d7-df492304ed5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:44.315216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de270b-eda8-455a-b9d7-df492304ed5e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:44.338136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 526/1067] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 18 06:12:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:44.340177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706714eb-97f8-48cc-aaca-19da75ee486c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:44.447119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706714eb-97f8-48cc-aaca-19da75ee486c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:44.482306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf573320-388e-4b20-842f-0c5e0539ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:44.482936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573320-388e-4b20-842f-0c5e0539ffd4 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:44.483216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573320-388e-4b20-842f-0c5e0539ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:44.483489 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573320-388e-4b20-842f-0c5e0539ffd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:44.486172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:44.496646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf573320-388e-4b20-842f-0c5e0539ffd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:44.498096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf573320-388e-4b20-842f-0c5e0539ffd4 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-cf573320-388e-4b20-842f-0c5e0539ffd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:44.512633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:44.513614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:44.519179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:44.519179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:44.519179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:44.519179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 542/1068] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:44.521137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de270b-eda8-455a-b9d7-df492304ed5e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:44.585751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:44.631097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de270b-eda8-455a-b9d7-df492304ed5e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:44.661084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049e652-8284-452c-b426-de74fcf7d711 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:44.661382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049e652-8284-452c-b426-de74fcf7d711 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:44.661642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049e652-8284-452c-b426-de74fcf7d711 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:44.663954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 543/1069] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:44.665896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed379a8-45fe-4814-a69b-d0e2f07b50d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:44.666644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed379a8-45fe-4814-a69b-d0e2f07b50d6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:44.667387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed379a8-45fe-4814-a69b-d0e2f07b50d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:44.667682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed379a8-45fe-4814-a69b-d0e2f07b50d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:44.668506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed379a8-45fe-4814-a69b-d0e2f07b50d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:44.668613 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e5f3-69b0-424a-967f-c825b89c32ab None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:44.668809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed379a8-45fe-4814-a69b-d0e2f07b50d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:44.668909 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e5f3-69b0-424a-967f-c825b89c32ab None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:44.669125 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e5f3-69b0-424a-967f-c825b89c32ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:44.670150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed379a8-45fe-4814-a69b-d0e2f07b50d6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:44.688954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 527/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:44.689155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2f37e5f3-69b0-424a-967f-c825b89c32ab None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:44.689710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2f37e5f3-69b0-424a-967f-c825b89c32ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:44.690262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed379a8-45fe-4814-a69b-d0e2f07b50d6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:44.766690 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 544/1071] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:44.799807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed379a8-45fe-4814-a69b-d0e2f07b50d6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:44.808543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27995a87-f616-461e-bb2f-50f37ceada4c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:44.808833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27995a87-f616-461e-bb2f-50f37ceada4c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:44.809106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27995a87-f616-461e-bb2f-50f37ceada4c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:44.811740 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 545/1072] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:44.815241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7bf2-9284-46cd-8afe-0b53630a7f97 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:44.815520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7bf2-9284-46cd-8afe-0b53630a7f97 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:44.815791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7bf2-9284-46cd-8afe-0b53630a7f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:44.816015 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:44.838183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1b8e7bf2-9284-46cd-8afe-0b53630a7f97 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:44.839899 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1b8e7bf2-9284-46cd-8afe-0b53630a7f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:44.850131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19925f-e5f6-49e2-ab19-6cdc52292d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:44.851176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19925f-e5f6-49e2-ab19-6cdc52292d0c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:44.851460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19925f-e5f6-49e2-ab19-6cdc52292d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:44.852068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19925f-e5f6-49e2-ab19-6cdc52292d0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:44.861194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19925f-e5f6-49e2-ab19-6cdc52292d0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:44.862963 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19925f-e5f6-49e2-ab19-6cdc52292d0c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3d19925f-e5f6-49e2-ab19-6cdc52292d0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:44.877293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:44.878232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:44.884827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:44.884827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:44.884827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:44.884827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:44.884827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:44.884827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:44.884827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:44.884827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:44.884827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 528/1073] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:44.884827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19925f-e5f6-49e2-ab19-6cdc52292d0c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:44.920248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 546/1074] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:44.986990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19925f-e5f6-49e2-ab19-6cdc52292d0c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:45.019679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a959f-f04b-4442-a823-27b5684a1a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:45.020296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a959f-f04b-4442-a823-27b5684a1a83 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:45.020568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a959f-f04b-4442-a823-27b5684a1a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:45.020835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a959f-f04b-4442-a823-27b5684a1a83 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:45.021507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a959f-f04b-4442-a823-27b5684a1a83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:45.021810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a959f-f04b-4442-a823-27b5684a1a83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:45.023208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a959f-f04b-4442-a823-27b5684a1a83 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:45.032624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7bf2-9284-46cd-8afe-0b53630a7f97 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:45.040804 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 529/1075] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:45.041502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a959f-f04b-4442-a823-27b5684a1a83 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:45.079410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:45.088542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:45.144525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7bf2-9284-46cd-8afe-0b53630a7f97 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:45.157674 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a959f-f04b-4442-a823-27b5684a1a83 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:45.184716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54ab00-c453-4c5e-ab9d-ad6fbc9d6bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:45.185343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54ab00-c453-4c5e-ab9d-ad6fbc9d6bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:45.185615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54ab00-c453-4c5e-ab9d-ad6fbc9d6bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:45.185880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54ab00-c453-4c5e-ab9d-ad6fbc9d6bd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:45.192872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a2a27-8420-456b-9de2-35e2d9af90e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:45.193523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a2a27-8420-456b-9de2-35e2d9af90e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:45.193797 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a2a27-8420-456b-9de2-35e2d9af90e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:45.194069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a2a27-8420-456b-9de2-35e2d9af90e7 None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/9b5585d29bcb4b03a1902fbf113f48e8/roles/3363af7e4d4945c692ccb6a46a4d61ca` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:45.195660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54ab00-c453-4c5e-ab9d-ad6fbc9d6bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:45.196238 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a2a27-8420-456b-9de2-35e2d9af90e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=9b5585d29bcb4b03a1902fbf113f48e8, role_id=3363af7e4d4945c692ccb6a46a4d61ca)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:45.197665 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a2a27-8420-456b-9de2-35e2d9af90e7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-dd54ab00-c453-4c5e-ab9d-ad6fbc9d6bd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:45.201014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:45.202139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 547/1076] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:45.203053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54ab00-c453-4c5e-ab9d-ad6fbc9d6bd6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:45.216078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 530/1077] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:12:45 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/9b5585d29bcb4b03a1902fbf113f48e8/roles/3363af7e4d4945c692ccb6a46a4d61ca => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:12:45.216900 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a2a27-8420-456b-9de2-35e2d9af90e7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:45.324214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:45.331130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54ab00-c453-4c5e-ab9d-ad6fbc9d6bd6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:45.332982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a2a27-8420-456b-9de2-35e2d9af90e7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:45.342018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:45.369013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162e81f-3344-4d32-846e-ac6004ab5ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:45.369628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162e81f-3344-4d32-846e-ac6004ab5ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:45.369958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162e81f-3344-4d32-846e-ac6004ab5ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:45.370384 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162e81f-3344-4d32-846e-ac6004ab5ce2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:45.379000 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e8fad-18ea-42d9-a6dd-a20985d6e3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:45.379876 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e8fad-18ea-42d9-a6dd-a20985d6e3ab None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:45.380199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e8fad-18ea-42d9-a6dd-a20985d6e3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:45.380467 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e8fad-18ea-42d9-a6dd-a20985d6e3ab None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:45.381130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e8fad-18ea-42d9-a6dd-a20985d6e3ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:45.381425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e8fad-18ea-42d9-a6dd-a20985d6e3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:45.382796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e8fad-18ea-42d9-a6dd-a20985d6e3ab None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:45.393438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 531/1078] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:45.400213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e8fad-18ea-42d9-a6dd-a20985d6e3ab None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:45.456461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162e81f-3344-4d32-846e-ac6004ab5ce2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:45.457917 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162e81f-3344-4d32-846e-ac6004ab5ce2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:45.514160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e8fad-18ea-42d9-a6dd-a20985d6e3ab None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:45.552267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ddbdf-ddd6-4a03-b37a-90738866307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:45.553573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ddbdf-ddd6-4a03-b37a-90738866307d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:45.554066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ddbdf-ddd6-4a03-b37a-90738866307d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:45.554347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ddbdf-ddd6-4a03-b37a-90738866307d None admin] PATH_INFO: `/v3/users/bcfa2907688b43f19ad73a85b1984f0a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:45.555635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ddbdf-ddd6-4a03-b37a-90738866307d None admin] RBAC: Authorizing `identity:get_user(user_id=bcfa2907688b43f19ad73a85b1984f0a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:45.557392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ddbdf-ddd6-4a03-b37a-90738866307d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:45.563892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 532/1079] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:12:45 2022] GET /identity/v3/users/bcfa2907688b43f19ad73a85b1984f0a => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:45.565174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ddbdf-ddd6-4a03-b37a-90738866307d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:45.568981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 548/1080] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:12:45.575243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162e81f-3344-4d32-846e-ac6004ab5ce2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:45.584903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:45.593627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:45.678008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162e81f-3344-4d32-846e-ac6004ab5ce2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:45.678254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ddbdf-ddd6-4a03-b37a-90738866307d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:45.715405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163dc63-4144-4a44-a896-645a5ad62812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:45.716067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163dc63-4144-4a44-a896-645a5ad62812 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:45.716348 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163dc63-4144-4a44-a896-645a5ad62812 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:45.716456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46403c7-d6c6-46cc-bf43-34761051614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:45.716668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163dc63-4144-4a44-a896-645a5ad62812 None admin] PATH_INFO: `/v3/projects/964283af581f488b90ec52639bf0384c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:45.717055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46403c7-d6c6-46cc-bf43-34761051614d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:45.717325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46403c7-d6c6-46cc-bf43-34761051614d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:45.717592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46403c7-d6c6-46cc-bf43-34761051614d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:45.717880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163dc63-4144-4a44-a896-645a5ad62812 None admin] RBAC: Authorizing `identity:get_project(project_id=964283af581f488b90ec52639bf0384c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:45.719307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163dc63-4144-4a44-a896-645a5ad62812 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:45.720990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 533/1081] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:12:45 2022] GET /identity/v3/projects/964283af581f488b90ec52639bf0384c => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:45.726833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163dc63-4144-4a44-a896-645a5ad62812 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:45.730608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46403c7-d6c6-46cc-bf43-34761051614d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:45.732092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46403c7-d6c6-46cc-bf43-34761051614d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-e46403c7-d6c6-46cc-bf43-34761051614d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:45.748388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:45.749425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:45.750362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:45.750362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:45.750362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:45.750362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 549/1082] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:45.755658 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46403c7-d6c6-46cc-bf43-34761051614d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:45.820705 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:45.827268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:45.837896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163dc63-4144-4a44-a896-645a5ad62812 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:45.876247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46403c7-d6c6-46cc-bf43-34761051614d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:45.879759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a4fad-da54-4631-8963-0339b6dec55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:45.880686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a4fad-da54-4631-8963-0339b6dec55f None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:45.881164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a4fad-da54-4631-8963-0339b6dec55f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:45.881632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a4fad-da54-4631-8963-0339b6dec55f None admin] PATH_INFO: `/v3/projects/964283af581f488b90ec52639bf0384c/users/bcfa2907688b43f19ad73a85b1984f0a/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:45.884296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a4fad-da54-4631-8963-0339b6dec55f None admin] RBAC: Authorizing `identity:create_grant(project_id=964283af581f488b90ec52639bf0384c, user_id=bcfa2907688b43f19ad73a85b1984f0a, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:45.886889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a4fad-da54-4631-8963-0339b6dec55f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:45.902195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 534/1083] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:12:45 2022] PUT /identity/v3/projects/964283af581f488b90ec52639bf0384c/users/bcfa2907688b43f19ad73a85b1984f0a/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:12:45.914252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060561d3-304e-44d2-b3ec-4ff25e07ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:45.914884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060561d3-304e-44d2-b3ec-4ff25e07ab97 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:45.915165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060561d3-304e-44d2-b3ec-4ff25e07ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:45.915438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060561d3-304e-44d2-b3ec-4ff25e07ab97 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:45.916137 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060561d3-304e-44d2-b3ec-4ff25e07ab97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:45.916442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060561d3-304e-44d2-b3ec-4ff25e07ab97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:45.917923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060561d3-304e-44d2-b3ec-4ff25e07ab97 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:45.932178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 550/1084] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:47.392932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcea3b-2aba-43fc-8a79-a973b41f9e97 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:47.393481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcea3b-2aba-43fc-8a79-a973b41f9e97 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:47.393481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcea3b-2aba-43fc-8a79-a973b41f9e97 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:47.394813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 535/1085] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:47.400076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e185ec-393a-4ac6-b715-4b28306ff43d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:47.400472 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e185ec-393a-4ac6-b715-4b28306ff43d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:47.400736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e185ec-393a-4ac6-b715-4b28306ff43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:47.419702 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-43e185ec-393a-4ac6-b715-4b28306ff43d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:47.420904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-43e185ec-393a-4ac6-b715-4b28306ff43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:47.485365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 551/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:47.751889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcea3b-2aba-43fc-8a79-a973b41f9e97 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:47.856315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcea3b-2aba-43fc-8a79-a973b41f9e97 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:47.889879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b136d87-2595-44df-ba30-60484b67b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:47.890493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136d87-2595-44df-ba30-60484b67b676 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:47.890771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136d87-2595-44df-ba30-60484b67b676 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:47.891067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136d87-2595-44df-ba30-60484b67b676 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:47.901762 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b136d87-2595-44df-ba30-60484b67b676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-6b136d87-2595-44df-ba30-60484b67b676 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:47.906481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:47.907593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:47.908475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 536/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Sun Sep 18 06:12:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:12:47.913552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e185ec-393a-4ac6-b715-4b28306ff43d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:47.961123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:48.015994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e185ec-393a-4ac6-b715-4b28306ff43d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:48.049836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f529f20-5cc5-4666-8d1d-66faf757346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:48.050442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f529f20-5cc5-4666-8d1d-66faf757346d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:48.050721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f529f20-5cc5-4666-8d1d-66faf757346d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:48.050993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f529f20-5cc5-4666-8d1d-66faf757346d None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:48.051642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f529f20-5cc5-4666-8d1d-66faf757346d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:48.052082 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f529f20-5cc5-4666-8d1d-66faf757346d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:48.053477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f529f20-5cc5-4666-8d1d-66faf757346d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:48.061842 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 552/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 18 06:12:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:48.067640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b136d87-2595-44df-ba30-60484b67b676 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:48.083084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:48.098230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad854132-bbd4-4523-8816-8dc380e03d18 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:48.098514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad854132-bbd4-4523-8816-8dc380e03d18 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:48.098800 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad854132-bbd4-4523-8816-8dc380e03d18 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:48.100164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 553/1089] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:12:48.105220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482b72f-9596-4bf7-886e-fa1e6daf707c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:48.105499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482b72f-9596-4bf7-886e-fa1e6daf707c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:48.105773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482b72f-9596-4bf7-886e-fa1e6daf707c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:48.124246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8482b72f-9596-4bf7-886e-fa1e6daf707c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:48.125432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8482b72f-9596-4bf7-886e-fa1e6daf707c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:48.169241 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b136d87-2595-44df-ba30-60484b67b676 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:48.191358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 554/1090] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:48.202590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791fcc-7d16-40c5-9554-cb4b32e43f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:48.203216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791fcc-7d16-40c5-9554-cb4b32e43f08 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:48.203492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791fcc-7d16-40c5-9554-cb4b32e43f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:48.203765 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791fcc-7d16-40c5-9554-cb4b32e43f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:48.214027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e791fcc-7d16-40c5-9554-cb4b32e43f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:48.215529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e791fcc-7d16-40c5-9554-cb4b32e43f08 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8e791fcc-7d16-40c5-9554-cb4b32e43f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:48.229047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:48.230821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:48.231742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:48.231742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:48.231742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:48.231742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 537/1091] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:48.236586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482b72f-9596-4bf7-886e-fa1e6daf707c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:48.278670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:48.333203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482b72f-9596-4bf7-886e-fa1e6daf707c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:48.365664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56eb431-0b16-481e-98f9-b180705fc34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:48.366252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eb431-0b16-481e-98f9-b180705fc34a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:48.366530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eb431-0b16-481e-98f9-b180705fc34a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:48.366801 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eb431-0b16-481e-98f9-b180705fc34a None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:48.367435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56eb431-0b16-481e-98f9-b180705fc34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:48.367730 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56eb431-0b16-481e-98f9-b180705fc34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:48.369153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56eb431-0b16-481e-98f9-b180705fc34a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:48.380679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 555/1092] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:48.386540 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791fcc-7d16-40c5-9554-cb4b32e43f08 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:48.448070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:48.462308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56eb431-0b16-481e-98f9-b180705fc34a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:48.487019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791fcc-7d16-40c5-9554-cb4b32e43f08 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:48.521366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f767f-fd00-41d6-b6f2-d395f188a2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:48.522288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f767f-fd00-41d6-b6f2-d395f188a2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:48.522576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f767f-fd00-41d6-b6f2-d395f188a2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:48.522878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f767f-fd00-41d6-b6f2-d395f188a2d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:48.531508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f767f-fd00-41d6-b6f2-d395f188a2d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:48.532908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f767f-fd00-41d6-b6f2-d395f188a2d7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-fa2f767f-fd00-41d6-b6f2-d395f188a2d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:12:48.544078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:48.545220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:48.546219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:48.546219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:48.546219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:12:48.546219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:12:48.546219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:12:48.546219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:12:48.546219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:12:48.546219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:12:48.546219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 06:12:48.546219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:48.546219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 538/1093] 10.222.0.16 () {56 vars in 1093 bytes} [Sun Sep 18 06:12:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:48.550782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f767f-fd00-41d6-b6f2-d395f188a2d7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:48.567630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56eb431-0b16-481e-98f9-b180705fc34a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:48.569181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:48.602596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f43ad-f144-4740-b018-573471a7556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:48.603219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f43ad-f144-4740-b018-573471a7556b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:48.603499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f43ad-f144-4740-b018-573471a7556b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:48.603774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f43ad-f144-4740-b018-573471a7556b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:48.615250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f43ad-f144-4740-b018-573471a7556b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-9f2f43ad-f144-4740-b018-573471a7556b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:12:48.620503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:48.621669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:12:48.622538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 556/1094] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:12:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:48.627686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f43ad-f144-4740-b018-573471a7556b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:48.653256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f767f-fd00-41d6-b6f2-d395f188a2d7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:48.675939 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:48.688328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35bd25-2c2e-4e67-b5e9-1e8818ee7a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:48.688925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35bd25-2c2e-4e67-b5e9-1e8818ee7a44 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:48.689214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35bd25-2c2e-4e67-b5e9-1e8818ee7a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:48.689474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35bd25-2c2e-4e67-b5e9-1e8818ee7a44 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:48.690190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35bd25-2c2e-4e67-b5e9-1e8818ee7a44 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:48.690495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35bd25-2c2e-4e67-b5e9-1e8818ee7a44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:48.691931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35bd25-2c2e-4e67-b5e9-1e8818ee7a44 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:48.709104 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 539/1095] 10.222.0.16 () {56 vars in 1133 bytes} [Sun Sep 18 06:12:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:48.714885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35bd25-2c2e-4e67-b5e9-1e8818ee7a44 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:48.727373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f43ad-f144-4740-b018-573471a7556b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:48.762311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fb1e4-d363-44de-ae03-49d30229a733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:48.762911 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fb1e4-d363-44de-ae03-49d30229a733 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:48.763190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fb1e4-d363-44de-ae03-49d30229a733 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:48.763468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fb1e4-d363-44de-ae03-49d30229a733 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:48.764158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fb1e4-d363-44de-ae03-49d30229a733 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:48.764461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fb1e4-d363-44de-ae03-49d30229a733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:48.765830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fb1e4-d363-44de-ae03-49d30229a733 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:48.774486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 557/1096] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:12:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:48.780667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fb1e4-d363-44de-ae03-49d30229a733 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:48.804661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:48.814303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35bd25-2c2e-4e67-b5e9-1e8818ee7a44 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:48.852783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12635a-e90c-431f-b526-a833f1ae78f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:48.853379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12635a-e90c-431f-b526-a833f1ae78f6 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:48.853651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12635a-e90c-431f-b526-a833f1ae78f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:48.853950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12635a-e90c-431f-b526-a833f1ae78f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:48.880354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fb1e4-d363-44de-ae03-49d30229a733 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:48.903807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:48.914074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89c63-ba1a-44df-966a-35bdcc821444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:48.914698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89c63-ba1a-44df-966a-35bdcc821444 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:48.914977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89c63-ba1a-44df-966a-35bdcc821444 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:48.915248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89c63-ba1a-44df-966a-35bdcc821444 None admin] PATH_INFO: `/v3/users/bcfa2907688b43f19ad73a85b1984f0a` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:48.916462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e89c63-ba1a-44df-966a-35bdcc821444 None admin] RBAC: Authorizing `identity:get_user(user_id=bcfa2907688b43f19ad73a85b1984f0a)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:48.918246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e89c63-ba1a-44df-966a-35bdcc821444 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:48.919854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 558/1097] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:12:48 2022] GET /identity/v3/users/bcfa2907688b43f19ad73a85b1984f0a => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:48.922431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12635a-e90c-431f-b526-a833f1ae78f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:48.923918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12635a-e90c-431f-b526-a833f1ae78f6 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:48.925426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89c63-ba1a-44df-966a-35bdcc821444 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:49.015327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:49.023153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 540/1098] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 18 06:12:49.024529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89c63-ba1a-44df-966a-35bdcc821444 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:49.029001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12635a-e90c-431f-b526-a833f1ae78f6 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:49.061224 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee2fb-7781-4808-b079-bd224ff9b3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:49.061742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee2fb-7781-4808-b079-bd224ff9b3ec None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:49.062022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee2fb-7781-4808-b079-bd224ff9b3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:49.062290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee2fb-7781-4808-b079-bd224ff9b3ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:49.108403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:49.126802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12635a-e90c-431f-b526-a833f1ae78f6 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:49.129504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eee2fb-7781-4808-b079-bd224ff9b3ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:49.130946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eee2fb-7781-4808-b079-bd224ff9b3ec None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:49.160910 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba3311-fdc8-4b60-820f-f305fc40b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:49.161527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba3311-fdc8-4b60-820f-f305fc40b1ab None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:49.161802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba3311-fdc8-4b60-820f-f305fc40b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:49.162073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba3311-fdc8-4b60-820f-f305fc40b1ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:49.172227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba3311-fdc8-4b60-820f-f305fc40b1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:49.173645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba3311-fdc8-4b60-820f-f305fc40b1ab None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-57ba3311-fdc8-4b60-820f-f305fc40b1ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:12:49.188138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:49.189312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:12:49.190429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:12:49.190429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:12:49.190429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:49.190429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 541/1099] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:49.194798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba3311-fdc8-4b60-820f-f305fc40b1ab None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:49.220682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:49.231977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 559/1100] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 18 06:12:49.237583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee2fb-7781-4808-b079-bd224ff9b3ec None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:49.294748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba3311-fdc8-4b60-820f-f305fc40b1ab None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:49.327860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c2c42-8c9c-4a51-ad4c-32255cf614f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:49.328401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c2c42-8c9c-4a51-ad4c-32255cf614f5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:49.328676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c2c42-8c9c-4a51-ad4c-32255cf614f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:49.328950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c2c42-8c9c-4a51-ad4c-32255cf614f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:49.329573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c2c42-8c9c-4a51-ad4c-32255cf614f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:49.329871 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c2c42-8c9c-4a51-ad4c-32255cf614f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:49.331211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c2c42-8c9c-4a51-ad4c-32255cf614f5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:49.332620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:49.333732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee2fb-7781-4808-b079-bd224ff9b3ec None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:49.344228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 542/1101] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:49.349850 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c2c42-8c9c-4a51-ad4c-32255cf614f5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:49.368059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868201-821d-4ef9-80d8-3ec9f5ab5f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:49.368683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868201-821d-4ef9-80d8-3ec9f5ab5f86 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:49.368958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868201-821d-4ef9-80d8-3ec9f5ab5f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:49.369230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868201-821d-4ef9-80d8-3ec9f5ab5f86 None admin] PATH_INFO: `/v3/projects/964283af581f488b90ec52639bf0384c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:49.370833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82868201-821d-4ef9-80d8-3ec9f5ab5f86 None admin] RBAC: Authorizing `identity:get_project(project_id=964283af581f488b90ec52639bf0384c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:49.372288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82868201-821d-4ef9-80d8-3ec9f5ab5f86 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:49.373900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 560/1102] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:12:49 2022] GET /identity/v3/projects/964283af581f488b90ec52639bf0384c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:49.380099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868201-821d-4ef9-80d8-3ec9f5ab5f86 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:49.437428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:49.447636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c2c42-8c9c-4a51-ad4c-32255cf614f5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:49.478490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868201-821d-4ef9-80d8-3ec9f5ab5f86 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:49.482052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461d300-602e-4116-aa81-3dc220502032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:49.482667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461d300-602e-4116-aa81-3dc220502032 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:49.482940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461d300-602e-4116-aa81-3dc220502032 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:49.483211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461d300-602e-4116-aa81-3dc220502032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:49.490209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461d300-602e-4116-aa81-3dc220502032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:49.491641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461d300-602e-4116-aa81-3dc220502032 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-8461d300-602e-4116-aa81-3dc220502032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:12:49.503161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:12:49.504180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:12:49.505392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:12:49.505392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:12:49.505392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:12:49.505392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:12:49.505392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:12:49.505392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:12:49.505392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:12:49.505392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:12:49.508199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 543/1103] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:12:49.510406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461d300-602e-4116-aa81-3dc220502032 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:49.512679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4da4b7-8a60-4262-b203-08a92e8e85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:49.513437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da4b7-8a60-4262-b203-08a92e8e85bb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:49.513712 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da4b7-8a60-4262-b203-08a92e8e85bb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:49.514755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da4b7-8a60-4262-b203-08a92e8e85bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:49.515476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4da4b7-8a60-4262-b203-08a92e8e85bb None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=964283af581f488b90ec52639bf0384c, user.id=bcfa2907688b43f19ad73a85b1984f0a) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:49.515779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4da4b7-8a60-4262-b203-08a92e8e85bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:49.517226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4da4b7-8a60-4262-b203-08a92e8e85bb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:49.525406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 561/1104] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:49 2022] GET /identity/v3/role_assignments?user.id=bcfa2907688b43f19ad73a85b1984f0a&scope.project.id=964283af581f488b90ec52639bf0384c&role.id=4494ba66c3f649febc69511a47e27b67 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:49.569103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:49.616758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461d300-602e-4116-aa81-3dc220502032 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:49.653400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c0fb4-7564-4d45-bf85-c20936a07e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:49.654012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c0fb4-7564-4d45-bf85-c20936a07e12 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:49.654288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c0fb4-7564-4d45-bf85-c20936a07e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:49.654561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c0fb4-7564-4d45-bf85-c20936a07e12 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:49.655291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c0fb4-7564-4d45-bf85-c20936a07e12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:49.655593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c0fb4-7564-4d45-bf85-c20936a07e12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:49.657074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c0fb4-7564-4d45-bf85-c20936a07e12 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:49.670646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 544/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:12:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:12:49.677027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4da4b7-8a60-4262-b203-08a92e8e85bb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:49.778907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4da4b7-8a60-4262-b203-08a92e8e85bb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:49.801574 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:49.813085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020413c5-a1f1-463d-802e-61008db08c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:49.813686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020413c5-a1f1-463d-802e-61008db08c64 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:49.813965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020413c5-a1f1-463d-802e-61008db08c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:49.814239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020413c5-a1f1-463d-802e-61008db08c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:49.814957 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020413c5-a1f1-463d-802e-61008db08c64 None admin] RBAC: Adding query filter params (role.id=3363af7e4d4945c692ccb6a46a4d61ca, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=9b5585d29bcb4b03a1902fbf113f48e8) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:49.815264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020413c5-a1f1-463d-802e-61008db08c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:49.816726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020413c5-a1f1-463d-802e-61008db08c64 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:49.822461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 562/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:49 2022] GET /identity/v3/role_assignments?user.id=9b5585d29bcb4b03a1902fbf113f48e8&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=3363af7e4d4945c692ccb6a46a4d61ca => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:51.721255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d323d-44d5-4014-9c84-773ed196764c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:51.721784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d323d-44d5-4014-9c84-773ed196764c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:51.721784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d323d-44d5-4014-9c84-773ed196764c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:51.723113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 545/1107] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:51.728249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa41dc8-f7f6-46fe-8436-0025ed843464 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:51.728668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa41dc8-f7f6-46fe-8436-0025ed843464 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:51.728803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa41dc8-f7f6-46fe-8436-0025ed843464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:51.747289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5fa41dc8-f7f6-46fe-8436-0025ed843464 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:51.748526 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5fa41dc8-f7f6-46fe-8436-0025ed843464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:51.812949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 563/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:52.093347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d323d-44d5-4014-9c84-773ed196764c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:52.191141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d323d-44d5-4014-9c84-773ed196764c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:52.205465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:52.224995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d86aa-0f84-4067-b895-041dd413b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:52.225603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d86aa-0f84-4067-b895-041dd413b03e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:52.225879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d86aa-0f84-4067-b895-041dd413b03e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:52.226152 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d86aa-0f84-4067-b895-041dd413b03e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:52.227247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d86aa-0f84-4067-b895-041dd413b03e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:52.228687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d86aa-0f84-4067-b895-041dd413b03e None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:52.230928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 546/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:12:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:52.236611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa41dc8-f7f6-46fe-8436-0025ed843464 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:52.331725 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa41dc8-f7f6-46fe-8436-0025ed843464 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:52.348799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:52.365945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c282e6-c7b2-4d8c-b142-416ee85221f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:52.366544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c282e6-c7b2-4d8c-b142-416ee85221f7 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:52.366823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c282e6-c7b2-4d8c-b142-416ee85221f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:52.367093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c282e6-c7b2-4d8c-b142-416ee85221f7 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:52.367739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c282e6-c7b2-4d8c-b142-416ee85221f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:52.369192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c282e6-c7b2-4d8c-b142-416ee85221f7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:52.389979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 564/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:12:52 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:12:54.580020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061033ec-026b-491a-b79a-bb29cf73734e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:54.580581 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061033ec-026b-491a-b79a-bb29cf73734e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:54.580581 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061033ec-026b-491a-b79a-bb29cf73734e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:54.581873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 547/1111] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:54.587237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381e07e-d75c-4ef9-a7a5-c34d3c517618 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:54.587638 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381e07e-d75c-4ef9-a7a5-c34d3c517618 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:54.587784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381e07e-d75c-4ef9-a7a5-c34d3c517618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:54.606238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a381e07e-d75c-4ef9-a7a5-c34d3c517618 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:54.607427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a381e07e-d75c-4ef9-a7a5-c34d3c517618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:54.671985 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 565/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:12:54.948953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061033ec-026b-491a-b79a-bb29cf73734e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:55.046594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061033ec-026b-491a-b79a-bb29cf73734e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:55.078855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df07110-405a-4573-b3e1-a4ef52cc3adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:55.079461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df07110-405a-4573-b3e1-a4ef52cc3adf None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:55.079736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df07110-405a-4573-b3e1-a4ef52cc3adf None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:55.080029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df07110-405a-4573-b3e1-a4ef52cc3adf None admin] PATH_INFO: `/v3/roles/fbc3d149dd894c219e21c220b192281a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:55.081403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df07110-405a-4573-b3e1-a4ef52cc3adf None admin] RBAC: Authorizing `identity:get_role(role_id=fbc3d149dd894c219e21c220b192281a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:55.082754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df07110-405a-4573-b3e1-a4ef52cc3adf None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:55.084084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 548/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:12:54 2022] GET /identity/v3/roles/fbc3d149dd894c219e21c220b192281a => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:55.090683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381e07e-d75c-4ef9-a7a5-c34d3c517618 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:55.185662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381e07e-d75c-4ef9-a7a5-c34d3c517618 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:55.187925 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:55.221661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d9aa2-74b0-44eb-b750-f6d562a3866c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:55.222209 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9aa2-74b0-44eb-b750-f6d562a3866c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:55.222482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9aa2-74b0-44eb-b750-f6d562a3866c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:55.222751 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9aa2-74b0-44eb-b750-f6d562a3866c None admin] PATH_INFO: `/v3/users/56c64e06e5d9460b8627f58cd5026a8e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:55.235119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d9aa2-74b0-44eb-b750-f6d562a3866c None admin] RBAC: Authorizing `identity:get_user(user_id=56c64e06e5d9460b8627f58cd5026a8e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:55.236768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d9aa2-74b0-44eb-b750-f6d562a3866c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:55.238338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 566/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:12:55 2022] GET /identity/v3/users/56c64e06e5d9460b8627f58cd5026a8e => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:55.244097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df07110-405a-4573-b3e1-a4ef52cc3adf None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:55.292984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:55.341160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df07110-405a-4573-b3e1-a4ef52cc3adf None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:55.373749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb95bed-3f01-4759-8b00-49d2c22a52a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:55.374335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95bed-3f01-4759-8b00-49d2c22a52a3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:55.374611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95bed-3f01-4759-8b00-49d2c22a52a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:55.374880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95bed-3f01-4759-8b00-49d2c22a52a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:55.438268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb95bed-3f01-4759-8b00-49d2c22a52a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:55.439692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb95bed-3f01-4759-8b00-49d2c22a52a3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:55.485508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:55.534202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 549/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:12:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 18 06:12:55.540284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d9aa2-74b0-44eb-b750-f6d562a3866c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:55.636476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d9aa2-74b0-44eb-b750-f6d562a3866c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:55.669987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc50dfb-3a10-4c47-8360-7ad91cc4e741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:55.670590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc50dfb-3a10-4c47-8360-7ad91cc4e741 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:55.670866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc50dfb-3a10-4c47-8360-7ad91cc4e741 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:55.671136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc50dfb-3a10-4c47-8360-7ad91cc4e741 None admin] PATH_INFO: `/v3/projects/964283af581f488b90ec52639bf0384c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:55.672320 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc50dfb-3a10-4c47-8360-7ad91cc4e741 None admin] RBAC: Authorizing `identity:get_project(project_id=964283af581f488b90ec52639bf0384c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:55.673731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc50dfb-3a10-4c47-8360-7ad91cc4e741 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:55.675384 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 567/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:12:55 2022] GET /identity/v3/projects/964283af581f488b90ec52639bf0384c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:55.681444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb95bed-3f01-4759-8b00-49d2c22a52a3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:55.776561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb95bed-3f01-4759-8b00-49d2c22a52a3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:55.808583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba2f7b-dcf1-4577-93c2-13459b41e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:55.809159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba2f7b-dcf1-4577-93c2-13459b41e5ff None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:55.809437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba2f7b-dcf1-4577-93c2-13459b41e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:55.809708 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba2f7b-dcf1-4577-93c2-13459b41e5ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:55.810415 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba2f7b-dcf1-4577-93c2-13459b41e5ff None admin] RBAC: Adding query filter params (role.id=fbc3d149dd894c219e21c220b192281a, scope.project.id=964283af581f488b90ec52639bf0384c, user.id=56c64e06e5d9460b8627f58cd5026a8e) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:12:55.810717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba2f7b-dcf1-4577-93c2-13459b41e5ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:55.812151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba2f7b-dcf1-4577-93c2-13459b41e5ff None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:55.817265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 550/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:12:55 2022] GET /identity/v3/role_assignments?user.id=56c64e06e5d9460b8627f58cd5026a8e&scope.project.id=964283af581f488b90ec52639bf0384c&role.id=fbc3d149dd894c219e21c220b192281a => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:57.930993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251aae5-a257-43e8-a188-d9116ec06f9a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:57.931532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251aae5-a257-43e8-a188-d9116ec06f9a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:57.931532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251aae5-a257-43e8-a188-d9116ec06f9a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:57.932900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 568/1118] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:12:57.937955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e8cd8-84e4-4f03-9c27-66304b2b371f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:57.938343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e8cd8-84e4-4f03-9c27-66304b2b371f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:57.938499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e8cd8-84e4-4f03-9c27-66304b2b371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:57.956767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-485e8cd8-84e4-4f03-9c27-66304b2b371f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:12:57.957943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-485e8cd8-84e4-4f03-9c27-66304b2b371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:12:57.967574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:58.023427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 551/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:12:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:12:58.292376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251aae5-a257-43e8-a188-d9116ec06f9a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:58.321140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:58.393927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251aae5-a257-43e8-a188-d9116ec06f9a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:58.428539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99fac3-c491-4932-8ef7-708a0341bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:58.429167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99fac3-c491-4932-8ef7-708a0341bc14 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:58.429434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99fac3-c491-4932-8ef7-708a0341bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:58.429705 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99fac3-c491-4932-8ef7-708a0341bc14 None admin] PATH_INFO: `/v3/roles/fbc3d149dd894c219e21c220b192281a` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:58.431105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99fac3-c491-4932-8ef7-708a0341bc14 None admin] RBAC: Authorizing `identity:get_role(role_id=fbc3d149dd894c219e21c220b192281a)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:58.433143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99fac3-c491-4932-8ef7-708a0341bc14 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:58.434452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 569/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:12:58 2022] GET /identity/v3/roles/fbc3d149dd894c219e21c220b192281a => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:58.440385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e8cd8-84e4-4f03-9c27-66304b2b371f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:58.549735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e8cd8-84e4-4f03-9c27-66304b2b371f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:58.586759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c7384-94f3-4d4e-b4ca-bc899d6aa465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:58.587379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c7384-94f3-4d4e-b4ca-bc899d6aa465 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:58.587651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c7384-94f3-4d4e-b4ca-bc899d6aa465 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:58.587948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c7384-94f3-4d4e-b4ca-bc899d6aa465 None admin] PATH_INFO: `/v3/users/56c64e06e5d9460b8627f58cd5026a8e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:58.589358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c7384-94f3-4d4e-b4ca-bc899d6aa465 None admin] RBAC: Authorizing `identity:get_user(user_id=56c64e06e5d9460b8627f58cd5026a8e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:58.590774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c7384-94f3-4d4e-b4ca-bc899d6aa465 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:58.592394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 552/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:12:58 2022] GET /identity/v3/users/56c64e06e5d9460b8627f58cd5026a8e => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:58.598168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99fac3-c491-4932-8ef7-708a0341bc14 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:58.704916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:58.709090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99fac3-c491-4932-8ef7-708a0341bc14 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:58.746480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec73c9e-9732-401b-97d3-3284e0705b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:58.747104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73c9e-9732-401b-97d3-3284e0705b99 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:58.747379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73c9e-9732-401b-97d3-3284e0705b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:58.747651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73c9e-9732-401b-97d3-3284e0705b99 None admin] PATH_INFO: `/v3/projects/964283af581f488b90ec52639bf0384c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:58.748782 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec73c9e-9732-401b-97d3-3284e0705b99 None admin] RBAC: Authorizing `identity:get_project(project_id=964283af581f488b90ec52639bf0384c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:58.750249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec73c9e-9732-401b-97d3-3284e0705b99 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:58.751863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 570/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:12:58 2022] GET /identity/v3/projects/964283af581f488b90ec52639bf0384c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:12:58.758056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c7384-94f3-4d4e-b4ca-bc899d6aa465 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:12:58.773406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:12:58.875111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c7384-94f3-4d4e-b4ca-bc899d6aa465 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:12:58.910381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcf0c6-c5bf-45cc-ab3b-6ce4942fda98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:12:58.911037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcf0c6-c5bf-45cc-ab3b-6ce4942fda98 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:12:58.911314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcf0c6-c5bf-45cc-ab3b-6ce4942fda98 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:12:58.911583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcf0c6-c5bf-45cc-ab3b-6ce4942fda98 None admin] PATH_INFO: `/v3/projects/964283af581f488b90ec52639bf0384c/users/56c64e06e5d9460b8627f58cd5026a8e/roles/fbc3d149dd894c219e21c220b192281a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:12:58.914492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcf0c6-c5bf-45cc-ab3b-6ce4942fda98 None admin] RBAC: Authorizing `identity:create_grant(project_id=964283af581f488b90ec52639bf0384c, user_id=56c64e06e5d9460b8627f58cd5026a8e, role_id=fbc3d149dd894c219e21c220b192281a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:12:58.916545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcf0c6-c5bf-45cc-ab3b-6ce4942fda98 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:12:58.932678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 553/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:12:58 2022] PUT /identity/v3/projects/964283af581f488b90ec52639bf0384c/users/56c64e06e5d9460b8627f58cd5026a8e/roles/fbc3d149dd894c219e21c220b192281a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:13:01.089677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1760f3-22c2-4d94-bb9c-ac5fe88e2f4e None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:01.090181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1760f3-22c2-4d94-bb9c-ac5fe88e2f4e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:01.090181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1760f3-22c2-4d94-bb9c-ac5fe88e2f4e None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:01.091457 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 571/1124] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:01.096924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a4b2-521c-4819-a2d1-8672ae7fc76c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:01.097333 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a4b2-521c-4819-a2d1-8672ae7fc76c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:01.097472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a4b2-521c-4819-a2d1-8672ae7fc76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:01.115502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4ee7a4b2-521c-4819-a2d1-8672ae7fc76c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:01.116727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4ee7a4b2-521c-4819-a2d1-8672ae7fc76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:01.185353 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 554/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:01.455129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1760f3-22c2-4d94-bb9c-ac5fe88e2f4e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:01.554893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1760f3-22c2-4d94-bb9c-ac5fe88e2f4e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:01.587772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6430f-452b-48ac-8205-a4345ec74fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:01.588495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6430f-452b-48ac-8205-a4345ec74fab None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:01.588771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6430f-452b-48ac-8205-a4345ec74fab None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:01.589045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6430f-452b-48ac-8205-a4345ec74fab None admin] PATH_INFO: `/v3/roles/fbc3d149dd894c219e21c220b192281a` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:01.590411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6430f-452b-48ac-8205-a4345ec74fab None admin] RBAC: Authorizing `identity:get_role(role_id=fbc3d149dd894c219e21c220b192281a)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:01.591772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6430f-452b-48ac-8205-a4345ec74fab None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:01.593097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 572/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:13:01 2022] GET /identity/v3/roles/fbc3d149dd894c219e21c220b192281a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:01.598803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7a4b2-521c-4819-a2d1-8672ae7fc76c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:01.601008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:01.695236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7a4b2-521c-4819-a2d1-8672ae7fc76c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:01.727858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada909f-617b-443e-82f4-1aca1c066165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:01.728466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada909f-617b-443e-82f4-1aca1c066165 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:01.728736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada909f-617b-443e-82f4-1aca1c066165 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:01.729004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada909f-617b-443e-82f4-1aca1c066165 None admin] PATH_INFO: `/v3/users/56c64e06e5d9460b8627f58cd5026a8e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:01.730096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada909f-617b-443e-82f4-1aca1c066165 None admin] RBAC: Authorizing `identity:get_user(user_id=56c64e06e5d9460b8627f58cd5026a8e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:01.731493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada909f-617b-443e-82f4-1aca1c066165 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:01.733070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 555/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:13:01 2022] GET /identity/v3/users/56c64e06e5d9460b8627f58cd5026a8e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:01.738667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6430f-452b-48ac-8205-a4345ec74fab None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:01.772353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:01.836194 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6430f-452b-48ac-8205-a4345ec74fab None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:01.869227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30dba-fec8-421f-9ab4-004f09961768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:01.869817 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30dba-fec8-421f-9ab4-004f09961768 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:01.870100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30dba-fec8-421f-9ab4-004f09961768 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:01.870371 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30dba-fec8-421f-9ab4-004f09961768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:01.934652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30dba-fec8-421f-9ab4-004f09961768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:01.936120 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30dba-fec8-421f-9ab4-004f09961768 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:01.968012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:02.031562 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 573/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:13:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:13:02.037568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada909f-617b-443e-82f4-1aca1c066165 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:02.109816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:02.139731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada909f-617b-443e-82f4-1aca1c066165 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:02.172921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ace8b0-97b4-46c8-bc01-3647789394e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:02.173528 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ace8b0-97b4-46c8-bc01-3647789394e3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:02.173801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ace8b0-97b4-46c8-bc01-3647789394e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:02.174067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ace8b0-97b4-46c8-bc01-3647789394e3 None admin] PATH_INFO: `/v3/projects/964283af581f488b90ec52639bf0384c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:02.175149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ace8b0-97b4-46c8-bc01-3647789394e3 None admin] RBAC: Authorizing `identity:get_project(project_id=964283af581f488b90ec52639bf0384c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:02.176582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ace8b0-97b4-46c8-bc01-3647789394e3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:02.178178 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 556/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:13:02 2022] GET /identity/v3/projects/964283af581f488b90ec52639bf0384c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:02.184523 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30dba-fec8-421f-9ab4-004f09961768 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:02.279355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30dba-fec8-421f-9ab4-004f09961768 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:02.312262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2692b1-6b2b-401e-8ce7-25dd3e3ab92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:02.312789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2692b1-6b2b-401e-8ce7-25dd3e3ab92e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:02.313064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2692b1-6b2b-401e-8ce7-25dd3e3ab92e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:02.313336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2692b1-6b2b-401e-8ce7-25dd3e3ab92e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:02.314044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2692b1-6b2b-401e-8ce7-25dd3e3ab92e None admin] RBAC: Adding query filter params (role.id=fbc3d149dd894c219e21c220b192281a, scope.project.id=964283af581f488b90ec52639bf0384c, user.id=56c64e06e5d9460b8627f58cd5026a8e) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:02.314352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2692b1-6b2b-401e-8ce7-25dd3e3ab92e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:02.315763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2692b1-6b2b-401e-8ce7-25dd3e3ab92e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:02.317500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:02.322325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 574/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:13:02 2022] GET /identity/v3/role_assignments?user.id=56c64e06e5d9460b8627f58cd5026a8e&scope.project.id=964283af581f488b90ec52639bf0384c&role.id=fbc3d149dd894c219e21c220b192281a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:04.461091 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c30ebd-1881-46b4-8a36-06aa82dc8177 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:04.461626 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c30ebd-1881-46b4-8a36-06aa82dc8177 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:04.461626 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c30ebd-1881-46b4-8a36-06aa82dc8177 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:04.463670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 557/1131] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:04.468851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24cad5-63b5-478c-94ae-7fbd1ea58f70 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:04.469249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24cad5-63b5-478c-94ae-7fbd1ea58f70 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:04.469408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24cad5-63b5-478c-94ae-7fbd1ea58f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:04.487670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7b24cad5-63b5-478c-94ae-7fbd1ea58f70 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:04.488886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7b24cad5-63b5-478c-94ae-7fbd1ea58f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:04.554035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 575/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:04.822746 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c30ebd-1881-46b4-8a36-06aa82dc8177 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:04.921624 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c30ebd-1881-46b4-8a36-06aa82dc8177 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:04.954076 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d48d3-6972-435a-bf53-cc4d7a4173e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:04.954684 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d48d3-6972-435a-bf53-cc4d7a4173e9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:04.954957 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d48d3-6972-435a-bf53-cc4d7a4173e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:04.955227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d48d3-6972-435a-bf53-cc4d7a4173e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:04.956340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d48d3-6972-435a-bf53-cc4d7a4173e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:04.957760 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d48d3-6972-435a-bf53-cc4d7a4173e9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:04.959343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 558/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:13:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:04.965908 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24cad5-63b5-478c-94ae-7fbd1ea58f70 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:05.061558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24cad5-63b5-478c-94ae-7fbd1ea58f70 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:05.086839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:05.095641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1435-0ffe-4e76-8100-b91ebd6d7308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:05.096256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1435-0ffe-4e76-8100-b91ebd6d7308 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:05.096528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1435-0ffe-4e76-8100-b91ebd6d7308 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:05.096794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1435-0ffe-4e76-8100-b91ebd6d7308 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:05.097417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1435-0ffe-4e76-8100-b91ebd6d7308 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:05.098835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1435-0ffe-4e76-8100-b91ebd6d7308 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:05.125030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 576/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:13:04 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:13:07.298766 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51d1f5-9157-4e3d-8bf5-813064f11486 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:07.299322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51d1f5-9157-4e3d-8bf5-813064f11486 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:07.299322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51d1f5-9157-4e3d-8bf5-813064f11486 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:07.300698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 559/1135] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:07.306650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43de1c4-5519-4e53-a33b-1f73acc37291 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:07.307069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43de1c4-5519-4e53-a33b-1f73acc37291 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:07.307187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43de1c4-5519-4e53-a33b-1f73acc37291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:07.324848 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b43de1c4-5519-4e53-a33b-1f73acc37291 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:07.326024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b43de1c4-5519-4e53-a33b-1f73acc37291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:07.389536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 577/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:07.658707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51d1f5-9157-4e3d-8bf5-813064f11486 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:07.668223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:07.760227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51d1f5-9157-4e3d-8bf5-813064f11486 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:07.793701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e58028-833c-4007-8b68-8f647ba5c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:07.794311 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58028-833c-4007-8b68-8f647ba5c6dd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:07.794585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58028-833c-4007-8b68-8f647ba5c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:07.794851 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58028-833c-4007-8b68-8f647ba5c6dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:07.795959 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e58028-833c-4007-8b68-8f647ba5c6dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:07.797507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e58028-833c-4007-8b68-8f647ba5c6dd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:07.799038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 560/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:07.804606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43de1c4-5519-4e53-a33b-1f73acc37291 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:07.903449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43de1c4-5519-4e53-a33b-1f73acc37291 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:07.913661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:07.938055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdecb9-ad75-4e22-bffb-39410ee62290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:07.938652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdecb9-ad75-4e22-bffb-39410ee62290 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:07.938927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdecb9-ad75-4e22-bffb-39410ee62290 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:07.939197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdecb9-ad75-4e22-bffb-39410ee62290 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:07.939843 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdecb9-ad75-4e22-bffb-39410ee62290 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:07.941304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdecb9-ad75-4e22-bffb-39410ee62290 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:07.961683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 578/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:13:07 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:13:10.124010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae4a10-6227-4a52-89a6-45e8ea77efb9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:10.124515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae4a10-6227-4a52-89a6-45e8ea77efb9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:10.124515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae4a10-6227-4a52-89a6-45e8ea77efb9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:10.125808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 561/1139] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:10.131167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1ee6-bb6a-4db3-bf82-f749854914bc None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:10.131592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1ee6-bb6a-4db3-bf82-f749854914bc None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:10.131714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1ee6-bb6a-4db3-bf82-f749854914bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:10.156388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a72a1ee6-bb6a-4db3-bf82-f749854914bc None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:10.157588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a72a1ee6-bb6a-4db3-bf82-f749854914bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:10.222367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 579/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:10.491726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae4a10-6227-4a52-89a6-45e8ea77efb9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:10.566559 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:10.592427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae4a10-6227-4a52-89a6-45e8ea77efb9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:10.624876 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f469d8e-6177-49a7-abd2-fa28c748927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:10.625484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f469d8e-6177-49a7-abd2-fa28c748927e None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:10.625761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f469d8e-6177-49a7-abd2-fa28c748927e None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:10.626030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f469d8e-6177-49a7-abd2-fa28c748927e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:10.636032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f469d8e-6177-49a7-abd2-fa28c748927e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3f469d8e-6177-49a7-abd2-fa28c748927e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:13:10.640711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:13:10.641656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:13:10.642789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 562/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:13:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:13:10.647760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1ee6-bb6a-4db3-bf82-f749854914bc None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:10.738275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:10.745081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1ee6-bb6a-4db3-bf82-f749854914bc None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:10.778252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c843a-520d-4b66-ad94-7b37c880f9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:10.778838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c843a-520d-4b66-ad94-7b37c880f9be None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:10.779110 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c843a-520d-4b66-ad94-7b37c880f9be None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:10.779383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c843a-520d-4b66-ad94-7b37c880f9be None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:10.780052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c843a-520d-4b66-ad94-7b37c880f9be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:10.780349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c843a-520d-4b66-ad94-7b37c880f9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:10.781707 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c843a-520d-4b66-ad94-7b37c880f9be None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:10.789235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 580/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:10.795598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f469d8e-6177-49a7-abd2-fa28c748927e None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:10.892175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f469d8e-6177-49a7-abd2-fa28c748927e None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:10.924839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b365c4-850b-4874-baf2-5285baaba334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:10.925451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b365c4-850b-4874-baf2-5285baaba334 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:10.925726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b365c4-850b-4874-baf2-5285baaba334 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:10.925997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b365c4-850b-4874-baf2-5285baaba334 None admin] PATH_INFO: `/v3/users/511972f70fe04cb8885db163ea58307e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:10.927799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:10.939618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b365c4-850b-4874-baf2-5285baaba334 None admin] RBAC: Authorizing `identity:get_user(user_id=511972f70fe04cb8885db163ea58307e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:10.941079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b365c4-850b-4874-baf2-5285baaba334 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:10.942674 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 563/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:13:10 2022] GET /identity/v3/users/511972f70fe04cb8885db163ea58307e => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:10.949164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c843a-520d-4b66-ad94-7b37c880f9be None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:11.045320 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c843a-520d-4b66-ad94-7b37c880f9be None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:11.077249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb66b7-47ae-45d5-809c-c1aa90326172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:11.077834 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb66b7-47ae-45d5-809c-c1aa90326172 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:11.078112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb66b7-47ae-45d5-809c-c1aa90326172 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:11.078383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb66b7-47ae-45d5-809c-c1aa90326172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:11.104824 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:11.145054 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb66b7-47ae-45d5-809c-c1aa90326172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:11.146495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb66b7-47ae-45d5-809c-c1aa90326172 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:11.241295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 581/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:13:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:13:11.247756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b365c4-850b-4874-baf2-5285baaba334 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:11.345148 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b365c4-850b-4874-baf2-5285baaba334 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:11.377264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b66391-483c-4c43-b4f2-79c168fd15e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:11.377869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b66391-483c-4c43-b4f2-79c168fd15e9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:11.378141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b66391-483c-4c43-b4f2-79c168fd15e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:11.378408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b66391-483c-4c43-b4f2-79c168fd15e9 None admin] PATH_INFO: `/v3/projects/eb3b8432c4e846f88671f6df86d0e54b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:11.379764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b66391-483c-4c43-b4f2-79c168fd15e9 None admin] RBAC: Authorizing `identity:get_project(project_id=eb3b8432c4e846f88671f6df86d0e54b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:11.381196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b66391-483c-4c43-b4f2-79c168fd15e9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:11.382792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 564/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:13:11 2022] GET /identity/v3/projects/eb3b8432c4e846f88671f6df86d0e54b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:11.389481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb66b7-47ae-45d5-809c-c1aa90326172 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:11.444183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:11.484563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb66b7-47ae-45d5-809c-c1aa90326172 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:11.517252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96920b-4940-44ff-863e-3e578d814b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:11.517832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96920b-4940-44ff-863e-3e578d814b70 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:11.518109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96920b-4940-44ff-863e-3e578d814b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:11.518379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96920b-4940-44ff-863e-3e578d814b70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:11.519087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96920b-4940-44ff-863e-3e578d814b70 None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=eb3b8432c4e846f88671f6df86d0e54b, user.id=511972f70fe04cb8885db163ea58307e) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:11.519393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96920b-4940-44ff-863e-3e578d814b70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:11.520836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96920b-4940-44ff-863e-3e578d814b70 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:11.525968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 582/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:13:11 2022] GET /identity/v3/role_assignments?user.id=511972f70fe04cb8885db163ea58307e&scope.project.id=eb3b8432c4e846f88671f6df86d0e54b&role.id=4494ba66c3f649febc69511a47e27b67 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:13.639387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a67b03-90e2-4ddd-9cb1-530754be76db None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:13.639962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a67b03-90e2-4ddd-9cb1-530754be76db None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:13.639962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a67b03-90e2-4ddd-9cb1-530754be76db None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:13.641298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 565/1147] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:13.646517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea38c9-29f1-4b3d-91d5-27926c554a24 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:13.646896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea38c9-29f1-4b3d-91d5-27926c554a24 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:13.647064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea38c9-29f1-4b3d-91d5-27926c554a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:13.665824 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5fea38c9-29f1-4b3d-91d5-27926c554a24 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:13.667005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5fea38c9-29f1-4b3d-91d5-27926c554a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:13.730793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 583/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:13.999259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a67b03-90e2-4ddd-9cb1-530754be76db None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:14.058299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:14.098335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a67b03-90e2-4ddd-9cb1-530754be76db None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:14.131399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ae250-aeaf-41ca-941c-cc59007844b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:14.132036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ae250-aeaf-41ca-941c-cc59007844b7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:14.132311 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ae250-aeaf-41ca-941c-cc59007844b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:14.132580 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ae250-aeaf-41ca-941c-cc59007844b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:14.142458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ae250-aeaf-41ca-941c-cc59007844b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-0d4ae250-aeaf-41ca-941c-cc59007844b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:13:14.147087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:13:14.148200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:13:14.150046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 566/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:13:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:13:14.154977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea38c9-29f1-4b3d-91d5-27926c554a24 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:14.205041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:14.251884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea38c9-29f1-4b3d-91d5-27926c554a24 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:14.284757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7632-1bf9-4672-a683-f81e73311ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:14.285348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7632-1bf9-4672-a683-f81e73311ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:14.285625 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7632-1bf9-4672-a683-f81e73311ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:14.285898 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7632-1bf9-4672-a683-f81e73311ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:14.286544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a7632-1bf9-4672-a683-f81e73311ee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:14.286843 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a7632-1bf9-4672-a683-f81e73311ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:14.288223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a7632-1bf9-4672-a683-f81e73311ee8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:14.296415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 584/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:14.302221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ae250-aeaf-41ca-941c-cc59007844b7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:14.398272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ae250-aeaf-41ca-941c-cc59007844b7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:14.417850 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:14.431655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd019-c1d3-4d16-8030-801d8a3f7443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:14.432287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd019-c1d3-4d16-8030-801d8a3f7443 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:14.432566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd019-c1d3-4d16-8030-801d8a3f7443 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:14.432837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd019-c1d3-4d16-8030-801d8a3f7443 None admin] PATH_INFO: `/v3/users/511972f70fe04cb8885db163ea58307e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:14.433931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbd019-c1d3-4d16-8030-801d8a3f7443 None admin] RBAC: Authorizing `identity:get_user(user_id=511972f70fe04cb8885db163ea58307e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:14.435343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbd019-c1d3-4d16-8030-801d8a3f7443 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:14.436920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 567/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:13:14 2022] GET /identity/v3/users/511972f70fe04cb8885db163ea58307e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:14.442837 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7632-1bf9-4672-a683-f81e73311ee8 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:14.539361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7632-1bf9-4672-a683-f81e73311ee8 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:14.552595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:14.572956 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacba7bf-85c0-49d5-b122-91bad82fe816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:14.573573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba7bf-85c0-49d5-b122-91bad82fe816 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:14.573847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba7bf-85c0-49d5-b122-91bad82fe816 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:14.574118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba7bf-85c0-49d5-b122-91bad82fe816 None admin] PATH_INFO: `/v3/projects/eb3b8432c4e846f88671f6df86d0e54b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:14.575229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacba7bf-85c0-49d5-b122-91bad82fe816 None admin] RBAC: Authorizing `identity:get_project(project_id=eb3b8432c4e846f88671f6df86d0e54b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:14.576674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacba7bf-85c0-49d5-b122-91bad82fe816 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:14.578272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 585/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:13:14 2022] GET /identity/v3/projects/eb3b8432c4e846f88671f6df86d0e54b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:14.584106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd019-c1d3-4d16-8030-801d8a3f7443 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:14.684561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd019-c1d3-4d16-8030-801d8a3f7443 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:14.717540 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a882ea7-e10c-444c-af7f-37eee07708fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:14.718172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a882ea7-e10c-444c-af7f-37eee07708fb None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:14.718448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a882ea7-e10c-444c-af7f-37eee07708fb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:14.718719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a882ea7-e10c-444c-af7f-37eee07708fb None admin] PATH_INFO: `/v3/projects/eb3b8432c4e846f88671f6df86d0e54b/users/511972f70fe04cb8885db163ea58307e/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:14.720601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a882ea7-e10c-444c-af7f-37eee07708fb None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3b8432c4e846f88671f6df86d0e54b, user_id=511972f70fe04cb8885db163ea58307e, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:14.722018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a882ea7-e10c-444c-af7f-37eee07708fb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:14.734152 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 568/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:13:14 2022] PUT /identity/v3/projects/eb3b8432c4e846f88671f6df86d0e54b/users/511972f70fe04cb8885db163ea58307e/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:13:16.850603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3dc7c-5c3d-4bbc-b8bd-aa360f5a8c6c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:16.851083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3dc7c-5c3d-4bbc-b8bd-aa360f5a8c6c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:16.851184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3dc7c-5c3d-4bbc-b8bd-aa360f5a8c6c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:16.852753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 586/1154] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:16.858140 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19168ca0-3789-4d61-9beb-97f4d908a5a4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:16.858606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19168ca0-3789-4d61-9beb-97f4d908a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:16.858711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19168ca0-3789-4d61-9beb-97f4d908a5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:16.876597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-19168ca0-3789-4d61-9beb-97f4d908a5a4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:16.877787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-19168ca0-3789-4d61-9beb-97f4d908a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:16.920690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:16.944193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 569/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:17.213356 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3dc7c-5c3d-4bbc-b8bd-aa360f5a8c6c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:17.313542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3dc7c-5c3d-4bbc-b8bd-aa360f5a8c6c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:17.345793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47337f-779e-44ec-86a4-55c56ce2bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:17.346408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47337f-779e-44ec-86a4-55c56ce2bc45 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:17.346687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47337f-779e-44ec-86a4-55c56ce2bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:17.346960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47337f-779e-44ec-86a4-55c56ce2bc45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:17.357629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47337f-779e-44ec-86a4-55c56ce2bc45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-9d47337f-779e-44ec-86a4-55c56ce2bc45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:13:17.362302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:13:17.363470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:13:17.364788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 587/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:13:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:13:17.369587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19168ca0-3789-4d61-9beb-97f4d908a5a4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:17.465466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19168ca0-3789-4d61-9beb-97f4d908a5a4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:17.497442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e07c4-f711-4566-bf64-8f3e53ef5f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:17.498034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e07c4-f711-4566-bf64-8f3e53ef5f47 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:17.498312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e07c4-f711-4566-bf64-8f3e53ef5f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:17.498583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e07c4-f711-4566-bf64-8f3e53ef5f47 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:17.499237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e07c4-f711-4566-bf64-8f3e53ef5f47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:17.499542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e07c4-f711-4566-bf64-8f3e53ef5f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:17.500921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e07c4-f711-4566-bf64-8f3e53ef5f47 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:17.509408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 570/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:13:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:17.515111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47337f-779e-44ec-86a4-55c56ce2bc45 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:17.557253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:17.611546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47337f-779e-44ec-86a4-55c56ce2bc45 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:17.643488 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569e93a-4c40-4ab0-886b-7896616af7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:17.644121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e93a-4c40-4ab0-886b-7896616af7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:17.644396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e93a-4c40-4ab0-886b-7896616af7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:17.644664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e93a-4c40-4ab0-886b-7896616af7b0 None admin] PATH_INFO: `/v3/users/511972f70fe04cb8885db163ea58307e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:17.645749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569e93a-4c40-4ab0-886b-7896616af7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=511972f70fe04cb8885db163ea58307e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:17.647161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569e93a-4c40-4ab0-886b-7896616af7b0 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:17.648711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 588/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:13:17 2022] GET /identity/v3/users/511972f70fe04cb8885db163ea58307e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:17.654938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e07c4-f711-4566-bf64-8f3e53ef5f47 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:17.694610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:17.751564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e07c4-f711-4566-bf64-8f3e53ef5f47 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:17.784527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae79aa9-2895-4ddb-951c-5ffb152bd6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:17.785093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae79aa9-2895-4ddb-951c-5ffb152bd6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:17.785365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae79aa9-2895-4ddb-951c-5ffb152bd6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:17.785632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae79aa9-2895-4ddb-951c-5ffb152bd6c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:17.849873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae79aa9-2895-4ddb-951c-5ffb152bd6c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:17.851301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae79aa9-2895-4ddb-951c-5ffb152bd6c8 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:17.890255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:17.946700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 571/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:13:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 18 06:13:17.952672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569e93a-4c40-4ab0-886b-7896616af7b0 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:18.048548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569e93a-4c40-4ab0-886b-7896616af7b0 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:18.058740 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:18.081758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82283619-9606-4ff8-b4fa-b11c64e59d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:18.082368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283619-9606-4ff8-b4fa-b11c64e59d96 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:18.082646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283619-9606-4ff8-b4fa-b11c64e59d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:18.082919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283619-9606-4ff8-b4fa-b11c64e59d96 None admin] PATH_INFO: `/v3/projects/eb3b8432c4e846f88671f6df86d0e54b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:18.084049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82283619-9606-4ff8-b4fa-b11c64e59d96 None admin] RBAC: Authorizing `identity:get_project(project_id=eb3b8432c4e846f88671f6df86d0e54b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:18.085480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82283619-9606-4ff8-b4fa-b11c64e59d96 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:18.087647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 589/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:13:17 2022] GET /identity/v3/projects/eb3b8432c4e846f88671f6df86d0e54b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:18.093832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae79aa9-2895-4ddb-951c-5ffb152bd6c8 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:18.188709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae79aa9-2895-4ddb-951c-5ffb152bd6c8 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:18.221883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ede41-f46c-4237-827c-25047c6fae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:18.222461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ede41-f46c-4237-827c-25047c6fae87 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:18.222731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ede41-f46c-4237-827c-25047c6fae87 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:18.222997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ede41-f46c-4237-827c-25047c6fae87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:18.223697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ede41-f46c-4237-827c-25047c6fae87 None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=eb3b8432c4e846f88671f6df86d0e54b, user.id=511972f70fe04cb8885db163ea58307e) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:18.224022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ede41-f46c-4237-827c-25047c6fae87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:18.225424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ede41-f46c-4237-827c-25047c6fae87 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:18.230999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 572/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:13:18 2022] GET /identity/v3/role_assignments?user.id=511972f70fe04cb8885db163ea58307e&scope.project.id=eb3b8432c4e846f88671f6df86d0e54b&role.id=4494ba66c3f649febc69511a47e27b67 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:13:20.391558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdbd79-b479-44f8-ba8c-b349d465aec5 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:20.392140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdbd79-b479-44f8-ba8c-b349d465aec5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:20.392140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdbd79-b479-44f8-ba8c-b349d465aec5 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:20.393460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 590/1162] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:20.398570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efce59-f3cb-4d10-8b23-a5d17c85aa8e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:20.399601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efce59-f3cb-4d10-8b23-a5d17c85aa8e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:20.399766 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efce59-f3cb-4d10-8b23-a5d17c85aa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:20.406923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:20.418335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e4efce59-f3cb-4d10-8b23-a5d17c85aa8e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:20.419525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e4efce59-f3cb-4d10-8b23-a5d17c85aa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:20.484189 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 573/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:20.751065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdbd79-b479-44f8-ba8c-b349d465aec5 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:20.851052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdbd79-b479-44f8-ba8c-b349d465aec5 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:20.884635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ea701-fa75-452e-a4a6-07c78838939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:20.885224 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ea701-fa75-452e-a4a6-07c78838939a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:20.885532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ea701-fa75-452e-a4a6-07c78838939a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:20.885806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ea701-fa75-452e-a4a6-07c78838939a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:20.928813 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:20.950871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ea701-fa75-452e-a4a6-07c78838939a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:20.952348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ea701-fa75-452e-a4a6-07c78838939a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:21.047520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 591/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:13:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:13:21.053368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efce59-f3cb-4d10-8b23-a5d17c85aa8e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:21.148500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efce59-f3cb-4d10-8b23-a5d17c85aa8e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:21.182101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac3524-27fa-4a6c-a848-602c6b98b426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:21.182707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3524-27fa-4a6c-a848-602c6b98b426 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:21.182984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3524-27fa-4a6c-a848-602c6b98b426 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:21.183257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3524-27fa-4a6c-a848-602c6b98b426 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:21.185101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:21.190369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac3524-27fa-4a6c-a848-602c6b98b426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:21.191948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac3524-27fa-4a6c-a848-602c6b98b426 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-28ac3524-27fa-4a6c-a848-602c6b98b426 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:13:21.204031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:13:21.205236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:13:21.206296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 574/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 18 06:13:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:13:21.211025 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ea701-fa75-452e-a4a6-07c78838939a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:21.287106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:21.308445 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ea701-fa75-452e-a4a6-07c78838939a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:21.342430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370cc2d-c57c-45f5-9c93-dc5d3c2dd5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:21.343009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370cc2d-c57c-45f5-9c93-dc5d3c2dd5bf None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:21.343288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370cc2d-c57c-45f5-9c93-dc5d3c2dd5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:21.343558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370cc2d-c57c-45f5-9c93-dc5d3c2dd5bf None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:21.344211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370cc2d-c57c-45f5-9c93-dc5d3c2dd5bf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:21.344508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370cc2d-c57c-45f5-9c93-dc5d3c2dd5bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:21.345856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370cc2d-c57c-45f5-9c93-dc5d3c2dd5bf None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:21.352763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 592/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Sun Sep 18 06:13:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:23.480830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249da4-a6ed-4882-a143-3d26d20c999e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:23.481391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249da4-a6ed-4882-a143-3d26d20c999e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:23.481391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249da4-a6ed-4882-a143-3d26d20c999e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:23.482705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 575/1167] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:23.488050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e192c8c-298b-43d2-9bdc-d9cc03186236 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:23.488473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e192c8c-298b-43d2-9bdc-d9cc03186236 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:23.488587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e192c8c-298b-43d2-9bdc-d9cc03186236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:23.506689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0e192c8c-298b-43d2-9bdc-d9cc03186236 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:23.508422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0e192c8c-298b-43d2-9bdc-d9cc03186236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:23.572495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 593/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 06:13:23.838238 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51249da4-a6ed-4882-a143-3d26d20c999e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:23.936573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51249da4-a6ed-4882-a143-3d26d20c999e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:23.969144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8271622-1baa-47cb-8c29-e7fc21d643ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:23.969721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8271622-1baa-47cb-8c29-e7fc21d643ef None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:23.969994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8271622-1baa-47cb-8c29-e7fc21d643ef None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:23.970264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8271622-1baa-47cb-8c29-e7fc21d643ef None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:23.970907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8271622-1baa-47cb-8c29-e7fc21d643ef None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:23.972281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8271622-1baa-47cb-8c29-e7fc21d643ef None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:23.987753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 576/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Sun Sep 18 06:13:23 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:13:26.168151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929143f2-0172-4558-9586-6238b1f742a1 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:26.168664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929143f2-0172-4558-9586-6238b1f742a1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:26.168775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929143f2-0172-4558-9586-6238b1f742a1 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:26.170015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 594/1170] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:26.175304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243da3d-0bab-4a13-bea8-5250fe41f50e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:26.175707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243da3d-0bab-4a13-bea8-5250fe41f50e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:26.175853 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243da3d-0bab-4a13-bea8-5250fe41f50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:26.194078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9243da3d-0bab-4a13-bea8-5250fe41f50e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:26.195892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9243da3d-0bab-4a13-bea8-5250fe41f50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:26.243406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:26.261323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 577/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:26.526608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929143f2-0172-4558-9586-6238b1f742a1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:26.595094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:26.625572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929143f2-0172-4558-9586-6238b1f742a1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:26.658200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad27ff3-cf7e-4458-94db-6bb9110ec538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:26.658808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad27ff3-cf7e-4458-94db-6bb9110ec538 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:26.659109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad27ff3-cf7e-4458-94db-6bb9110ec538 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:26.659377 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad27ff3-cf7e-4458-94db-6bb9110ec538 None admin] PATH_INFO: `/v3/domains/6ba487e3b16a439db8ae076e4be64e77` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:26.669883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad27ff3-cf7e-4458-94db-6bb9110ec538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6ba487e3b16a439db8ae076e4be64e77)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:26.671312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad27ff3-cf7e-4458-94db-6bb9110ec538 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:26.672893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 595/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Sun Sep 18 06:13:26 2022] GET /identity/v3/domains/6ba487e3b16a439db8ae076e4be64e77 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:26.678681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243da3d-0bab-4a13-bea8-5250fe41f50e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:26.776401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243da3d-0bab-4a13-bea8-5250fe41f50e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:26.809321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a625c-6511-4c91-9c1b-185c67b037d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:26.809857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a625c-6511-4c91-9c1b-185c67b037d7 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:26.810134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a625c-6511-4c91-9c1b-185c67b037d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:26.810406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a625c-6511-4c91-9c1b-185c67b037d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:26.811040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a625c-6511-4c91-9c1b-185c67b037d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:26.812502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a625c-6511-4c91-9c1b-185c67b037d7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:26.838580 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 578/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:13:26 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:13:28.989791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b510cf8-a735-4c80-9c5c-0daf2a492e37 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:28.990318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b510cf8-a735-4c80-9c5c-0daf2a492e37 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:28.990318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b510cf8-a735-4c80-9c5c-0daf2a492e37 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:28.991656 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 596/1174] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:28.997629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a2c91-3576-4d62-a10e-d8a0fe8c445c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:28.998043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a2c91-3576-4d62-a10e-d8a0fe8c445c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:28.998178 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a2c91-3576-4d62-a10e-d8a0fe8c445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:29.016191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-259a2c91-3576-4d62-a10e-d8a0fe8c445c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:29.017397 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-259a2c91-3576-4d62-a10e-d8a0fe8c445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:29.045461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:29.082101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 579/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:29.354445 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b510cf8-a735-4c80-9c5c-0daf2a492e37 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:29.453745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b510cf8-a735-4c80-9c5c-0daf2a492e37 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:29.481728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:29.486749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc979cd-2955-4f89-b367-f02855f317eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:29.487364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc979cd-2955-4f89-b367-f02855f317eb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:29.487643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc979cd-2955-4f89-b367-f02855f317eb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:29.487936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc979cd-2955-4f89-b367-f02855f317eb None admin] PATH_INFO: `/v3/domains/6ba487e3b16a439db8ae076e4be64e77` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:29.489036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc979cd-2955-4f89-b367-f02855f317eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=6ba487e3b16a439db8ae076e4be64e77)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:29.490458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc979cd-2955-4f89-b367-f02855f317eb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:29.492731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 597/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Sun Sep 18 06:13:29 2022] GET /identity/v3/domains/6ba487e3b16a439db8ae076e4be64e77 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:29.498462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a2c91-3576-4d62-a10e-d8a0fe8c445c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:29.594773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a2c91-3576-4d62-a10e-d8a0fe8c445c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:29.628267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e7a13-6b8d-4c3c-940e-523413035e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:29.628796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e7a13-6b8d-4c3c-940e-523413035e9a None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:29.629071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e7a13-6b8d-4c3c-940e-523413035e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:29.629341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e7a13-6b8d-4c3c-940e-523413035e9a None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:29.629972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e7a13-6b8d-4c3c-940e-523413035e9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:29.631378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e7a13-6b8d-4c3c-940e-523413035e9a None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:29.651896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 580/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:13:29 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:13:31.843775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279348e-6e91-437d-9651-0b3ed1fa086c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:31.844234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279348e-6e91-437d-9651-0b3ed1fa086c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:31.844374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279348e-6e91-437d-9651-0b3ed1fa086c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:31.845714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 598/1178] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:31.850897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f8cbf-8e53-47de-bc55-689c365f7c16 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:31.851432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f8cbf-8e53-47de-bc55-689c365f7c16 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:31.851767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f8cbf-8e53-47de-bc55-689c365f7c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:31.869464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-261f8cbf-8e53-47de-bc55-689c365f7c16 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:31.870629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-261f8cbf-8e53-47de-bc55-689c365f7c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:31.887577 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:31.937717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 581/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:32.217468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279348e-6e91-437d-9651-0b3ed1fa086c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:32.316255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279348e-6e91-437d-9651-0b3ed1fa086c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:32.349074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb175548-ba87-428e-bab2-8fd9982b9252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:32.349680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175548-ba87-428e-bab2-8fd9982b9252 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:32.349957 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175548-ba87-428e-bab2-8fd9982b9252 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:32.350228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175548-ba87-428e-bab2-8fd9982b9252 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:32.361108 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb175548-ba87-428e-bab2-8fd9982b9252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-fb175548-ba87-428e-bab2-8fd9982b9252 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:13:32.365744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:13:32.366830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:13:32.367692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 599/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:13:32.373089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f8cbf-8e53-47de-bc55-689c365f7c16 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:32.467742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f8cbf-8e53-47de-bc55-689c365f7c16 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:32.499654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dde9e-45f6-48d5-a020-da1032490193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:32.500263 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dde9e-45f6-48d5-a020-da1032490193 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:32.500538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dde9e-45f6-48d5-a020-da1032490193 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:32.500808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dde9e-45f6-48d5-a020-da1032490193 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:32.501454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dde9e-45f6-48d5-a020-da1032490193 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:32.501754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dde9e-45f6-48d5-a020-da1032490193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:32.503355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dde9e-45f6-48d5-a020-da1032490193 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:32.511563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 582/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:32.517251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb175548-ba87-428e-bab2-8fd9982b9252 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:32.577065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:32.617280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb175548-ba87-428e-bab2-8fd9982b9252 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:32.650269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2cef8-700f-4c3e-a32e-085d4e15509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:32.650871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2cef8-700f-4c3e-a32e-085d4e15509e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:32.651145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2cef8-700f-4c3e-a32e-085d4e15509e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:32.651413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2cef8-700f-4c3e-a32e-085d4e15509e None admin] PATH_INFO: `/v3/users/3439314fe3a844a4b84c1befaa430782` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:32.664691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2cef8-700f-4c3e-a32e-085d4e15509e None admin] RBAC: Authorizing `identity:get_user(user_id=3439314fe3a844a4b84c1befaa430782)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:32.666113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2cef8-700f-4c3e-a32e-085d4e15509e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:32.667660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 600/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:13:32 2022] GET /identity/v3/users/3439314fe3a844a4b84c1befaa430782 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:32.673488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dde9e-45f6-48d5-a020-da1032490193 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:32.689402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:32.770408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dde9e-45f6-48d5-a020-da1032490193 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:32.802534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400c341-7da1-47fb-b850-89215d1c83ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:32.803118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400c341-7da1-47fb-b850-89215d1c83ca None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:32.803394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400c341-7da1-47fb-b850-89215d1c83ca None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:32.803667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400c341-7da1-47fb-b850-89215d1c83ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:32.870044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400c341-7da1-47fb-b850-89215d1c83ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:32.871476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400c341-7da1-47fb-b850-89215d1c83ca None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:32.886023 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:32.966318 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 583/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:13:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:13:32.972274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2cef8-700f-4c3e-a32e-085d4e15509e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:33.068140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2cef8-700f-4c3e-a32e-085d4e15509e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:33.085119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:33.101598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6966765-4828-4f33-868b-c99739c9c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:33.102207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6966765-4828-4f33-868b-c99739c9c1ff None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:33.102483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6966765-4828-4f33-868b-c99739c9c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:33.102757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6966765-4828-4f33-868b-c99739c9c1ff None admin] PATH_INFO: `/v3/projects/6590f2bd61b14c87b1a1f7d3a8e10528` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:33.103855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6966765-4828-4f33-868b-c99739c9c1ff None admin] RBAC: Authorizing `identity:get_project(project_id=6590f2bd61b14c87b1a1f7d3a8e10528)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:33.105298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6966765-4828-4f33-868b-c99739c9c1ff None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:33.106878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 601/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:13:32 2022] GET /identity/v3/projects/6590f2bd61b14c87b1a1f7d3a8e10528 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:33.112860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400c341-7da1-47fb-b850-89215d1c83ca None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:33.208378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400c341-7da1-47fb-b850-89215d1c83ca None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:33.221700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:33.242606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e805e5-126a-4cfe-8afc-709a71fdc902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:33.243189 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e805e5-126a-4cfe-8afc-709a71fdc902 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:33.243464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e805e5-126a-4cfe-8afc-709a71fdc902 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:33.243733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e805e5-126a-4cfe-8afc-709a71fdc902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:33.244474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e805e5-126a-4cfe-8afc-709a71fdc902 None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=6590f2bd61b14c87b1a1f7d3a8e10528, user.id=3439314fe3a844a4b84c1befaa430782) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:33.244777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e805e5-126a-4cfe-8afc-709a71fdc902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:33.246182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e805e5-126a-4cfe-8afc-709a71fdc902 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:33.251309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 584/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:13:33 2022] GET /identity/v3/role_assignments?user.id=3439314fe3a844a4b84c1befaa430782&scope.project.id=6590f2bd61b14c87b1a1f7d3a8e10528&role.id=4494ba66c3f649febc69511a47e27b67 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:13:35.350997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920468-783b-4727-bc9d-3fda36fb4a18 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:35.351533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920468-783b-4727-bc9d-3fda36fb4a18 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:35.351646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920468-783b-4727-bc9d-3fda36fb4a18 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:35.353002 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 602/1186] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:35.358675 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fef2f-4fc4-4dfb-b092-3b1c670a8f54 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:35.359070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fef2f-4fc4-4dfb-b092-3b1c670a8f54 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:35.359213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fef2f-4fc4-4dfb-b092-3b1c670a8f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:35.376907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-868fef2f-4fc4-4dfb-b092-3b1c670a8f54 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:35.378349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-868fef2f-4fc4-4dfb-b092-3b1c670a8f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:35.442180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 585/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:35.709758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc920468-783b-4727-bc9d-3fda36fb4a18 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:35.809188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc920468-783b-4727-bc9d-3fda36fb4a18 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:35.842280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee1125-b08d-4f7e-8645-e612250a6ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:35.842901 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee1125-b08d-4f7e-8645-e612250a6ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:35.843181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee1125-b08d-4f7e-8645-e612250a6ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:35.843455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee1125-b08d-4f7e-8645-e612250a6ad6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:35.853912 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee1125-b08d-4f7e-8645-e612250a6ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6eee1125-b08d-4f7e-8645-e612250a6ad6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:13:35.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:13:35.859714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:13:35.860811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 603/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:13:35.865702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fef2f-4fc4-4dfb-b092-3b1c670a8f54 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:35.961042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fef2f-4fc4-4dfb-b092-3b1c670a8f54 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:35.969751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:35.994168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ab500-3453-469c-aafd-ce5b7dd60638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:35.994758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ab500-3453-469c-aafd-ce5b7dd60638 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:35.995038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ab500-3453-469c-aafd-ce5b7dd60638 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:35.995312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ab500-3453-469c-aafd-ce5b7dd60638 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:35.995989 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ab500-3453-469c-aafd-ce5b7dd60638 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:35.996294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ab500-3453-469c-aafd-ce5b7dd60638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:35.997656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ab500-3453-469c-aafd-ce5b7dd60638 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:36.005596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 586/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:36.011540 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee1125-b08d-4f7e-8645-e612250a6ad6 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:36.057904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:36.109563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee1125-b08d-4f7e-8645-e612250a6ad6 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:36.142223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45e0a-f1e7-4586-ad19-89b85909446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:36.142822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45e0a-f1e7-4586-ad19-89b85909446a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:36.143092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45e0a-f1e7-4586-ad19-89b85909446a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:36.143358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45e0a-f1e7-4586-ad19-89b85909446a None admin] PATH_INFO: `/v3/users/3439314fe3a844a4b84c1befaa430782` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:36.144474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d45e0a-f1e7-4586-ad19-89b85909446a None admin] RBAC: Authorizing `identity:get_user(user_id=3439314fe3a844a4b84c1befaa430782)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:36.145889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d45e0a-f1e7-4586-ad19-89b85909446a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:36.147430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 604/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:13:36 2022] GET /identity/v3/users/3439314fe3a844a4b84c1befaa430782 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:36.153805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ab500-3453-469c-aafd-ce5b7dd60638 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:36.250248 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ab500-3453-469c-aafd-ce5b7dd60638 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:36.282888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857f6d4-1060-4230-86c4-22e621a8b49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:36.283491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857f6d4-1060-4230-86c4-22e621a8b49f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:36.283765 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857f6d4-1060-4230-86c4-22e621a8b49f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:36.284064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857f6d4-1060-4230-86c4-22e621a8b49f None admin] PATH_INFO: `/v3/projects/6590f2bd61b14c87b1a1f7d3a8e10528` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:36.285157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857f6d4-1060-4230-86c4-22e621a8b49f None admin] RBAC: Authorizing `identity:get_project(project_id=6590f2bd61b14c87b1a1f7d3a8e10528)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:36.286570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857f6d4-1060-4230-86c4-22e621a8b49f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:36.288316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 587/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:13:36 2022] GET /identity/v3/projects/6590f2bd61b14c87b1a1f7d3a8e10528 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:36.294223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45e0a-f1e7-4586-ad19-89b85909446a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:36.391560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45e0a-f1e7-4586-ad19-89b85909446a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:36.405466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:36.425457 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4522b35-d68c-4b32-8b45-f95d99ba299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:36.426095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522b35-d68c-4b32-8b45-f95d99ba299d None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:36.426369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522b35-d68c-4b32-8b45-f95d99ba299d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:36.426639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522b35-d68c-4b32-8b45-f95d99ba299d None admin] PATH_INFO: `/v3/projects/6590f2bd61b14c87b1a1f7d3a8e10528/users/3439314fe3a844a4b84c1befaa430782/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:36.428538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4522b35-d68c-4b32-8b45-f95d99ba299d None admin] RBAC: Authorizing `identity:create_grant(project_id=6590f2bd61b14c87b1a1f7d3a8e10528, user_id=3439314fe3a844a4b84c1befaa430782, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:36.429945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4522b35-d68c-4b32-8b45-f95d99ba299d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:36.441716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 605/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:13:36 2022] PUT /identity/v3/projects/6590f2bd61b14c87b1a1f7d3a8e10528/users/3439314fe3a844a4b84c1befaa430782/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:13:38.588591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89cd2e-2804-4ccd-b58e-31b35b9f1730 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:38.589121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89cd2e-2804-4ccd-b58e-31b35b9f1730 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:38.589121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89cd2e-2804-4ccd-b58e-31b35b9f1730 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:38.590448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 588/1193] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:13:38.595624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2e21-7be2-4f55-9b7c-c6e9a961a4b1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:38.596030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2e21-7be2-4f55-9b7c-c6e9a961a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:38.596192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2e21-7be2-4f55-9b7c-c6e9a961a4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:38.613831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-025a2e21-7be2-4f55-9b7c-c6e9a961a4b1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:13:38.615011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-025a2e21-7be2-4f55-9b7c-c6e9a961a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:13:38.679065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 606/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:13:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:13:38.953978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89cd2e-2804-4ccd-b58e-31b35b9f1730 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:38.996598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:39.057117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89cd2e-2804-4ccd-b58e-31b35b9f1730 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:39.093974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff77d9a-8e01-4ff0-9e53-2b331bb382f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:39.094647 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77d9a-8e01-4ff0-9e53-2b331bb382f5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:39.095010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77d9a-8e01-4ff0-9e53-2b331bb382f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:39.095279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77d9a-8e01-4ff0-9e53-2b331bb382f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:39.105840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff77d9a-8e01-4ff0-9e53-2b331bb382f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3ff77d9a-8e01-4ff0-9e53-2b331bb382f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:13:39.110481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:13:39.111596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:13:39.112693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 589/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:13:39.118332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2e21-7be2-4f55-9b7c-c6e9a961a4b1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:39.214013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2e21-7be2-4f55-9b7c-c6e9a961a4b1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:39.216189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:39.247305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdb94c-77c4-4b4e-aa01-df0f38140e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:39.247891 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdb94c-77c4-4b4e-aa01-df0f38140e5a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:39.248202 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdb94c-77c4-4b4e-aa01-df0f38140e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:39.248473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdb94c-77c4-4b4e-aa01-df0f38140e5a None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:39.249115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdb94c-77c4-4b4e-aa01-df0f38140e5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:39.249411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdb94c-77c4-4b4e-aa01-df0f38140e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:39.250770 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdb94c-77c4-4b4e-aa01-df0f38140e5a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:39.259274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 607/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:39.265213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff77d9a-8e01-4ff0-9e53-2b331bb382f5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:39.357213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:39.361191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff77d9a-8e01-4ff0-9e53-2b331bb382f5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:39.394186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60282f1f-c9af-428b-a08c-2a3d9023e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:39.394793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60282f1f-c9af-428b-a08c-2a3d9023e056 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:39.395067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60282f1f-c9af-428b-a08c-2a3d9023e056 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:39.395340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60282f1f-c9af-428b-a08c-2a3d9023e056 None admin] PATH_INFO: `/v3/users/3439314fe3a844a4b84c1befaa430782` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:39.396466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60282f1f-c9af-428b-a08c-2a3d9023e056 None admin] RBAC: Authorizing `identity:get_user(user_id=3439314fe3a844a4b84c1befaa430782)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:39.398636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60282f1f-c9af-428b-a08c-2a3d9023e056 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:39.400214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 590/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Sun Sep 18 06:13:39 2022] GET /identity/v3/users/3439314fe3a844a4b84c1befaa430782 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:39.406016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdb94c-77c4-4b4e-aa01-df0f38140e5a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:39.501376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdb94c-77c4-4b4e-aa01-df0f38140e5a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:39.534678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5252932-701b-44c6-945d-b55a1691b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:39.535268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5252932-701b-44c6-945d-b55a1691b9ff None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:39.535546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5252932-701b-44c6-945d-b55a1691b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:39.535818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5252932-701b-44c6-945d-b55a1691b9ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:39.567381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:39.601496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5252932-701b-44c6-945d-b55a1691b9ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:39.602930 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5252932-701b-44c6-945d-b55a1691b9ff None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:39.698198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 608/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:13:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:13:39.704306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60282f1f-c9af-428b-a08c-2a3d9023e056 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:39.800752 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60282f1f-c9af-428b-a08c-2a3d9023e056 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:39.833298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585a367-dbd1-4660-aa27-73a7c4be7305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:39.833926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a367-dbd1-4660-aa27-73a7c4be7305 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:39.834200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a367-dbd1-4660-aa27-73a7c4be7305 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:39.834468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a367-dbd1-4660-aa27-73a7c4be7305 None admin] PATH_INFO: `/v3/projects/6590f2bd61b14c87b1a1f7d3a8e10528` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:39.836606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585a367-dbd1-4660-aa27-73a7c4be7305 None admin] RBAC: Authorizing `identity:get_project(project_id=6590f2bd61b14c87b1a1f7d3a8e10528)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:39.838027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585a367-dbd1-4660-aa27-73a7c4be7305 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:39.839660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 591/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Sun Sep 18 06:13:39 2022] GET /identity/v3/projects/6590f2bd61b14c87b1a1f7d3a8e10528 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:39.845709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5252932-701b-44c6-945d-b55a1691b9ff None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:13:39.908696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:39.942608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5252932-701b-44c6-945d-b55a1691b9ff None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:13:39.974870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39d661-14c1-4a31-a816-bef39b212913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:13:39.976028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d661-14c1-4a31-a816-bef39b212913 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:13:39.976310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d661-14c1-4a31-a816-bef39b212913 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:13:39.976581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d661-14c1-4a31-a816-bef39b212913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:13:39.977285 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39d661-14c1-4a31-a816-bef39b212913 None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=6590f2bd61b14c87b1a1f7d3a8e10528, user.id=3439314fe3a844a4b84c1befaa430782) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:13:39.977588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39d661-14c1-4a31-a816-bef39b212913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:13:39.979002 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39d661-14c1-4a31-a816-bef39b212913 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:13:39.984512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 609/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:13:39 2022] GET /identity/v3/role_assignments?user.id=3439314fe3a844a4b84c1befaa430782&scope.project.id=6590f2bd61b14c87b1a1f7d3a8e10528&role.id=4494ba66c3f649febc69511a47e27b67 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:13:49.829175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=83 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:13:49.982020 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=35 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:35.742057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcf1e4-4351-4df9-a753-3871b88e807d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:35.742657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcf1e4-4351-4df9-a753-3871b88e807d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:35.742657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcf1e4-4351-4df9-a753-3871b88e807d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:35.743963 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 592/1201] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:14:35.750043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3437-94cc-4846-97b3-8dd4af8b125f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:35.750897 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3437-94cc-4846-97b3-8dd4af8b125f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:35.750897 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a3437-94cc-4846-97b3-8dd4af8b125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:35.771713 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b72a3437-94cc-4846-97b3-8dd4af8b125f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:14:35.773036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b72a3437-94cc-4846-97b3-8dd4af8b125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:14:35.868576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 610/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:14:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:14:36.151127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcf1e4-4351-4df9-a753-3871b88e807d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:36.301956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcf1e4-4351-4df9-a753-3871b88e807d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:36.348199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac0dfd-c167-4b77-af37-27c7ccbb2768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:36.348831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac0dfd-c167-4b77-af37-27c7ccbb2768 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:36.349137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac0dfd-c167-4b77-af37-27c7ccbb2768 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:36.349379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac0dfd-c167-4b77-af37-27c7ccbb2768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:36.360339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac0dfd-c167-4b77-af37-27c7ccbb2768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:36.361770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac0dfd-c167-4b77-af37-27c7ccbb2768 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-47ac0dfd-c167-4b77-af37-27c7ccbb2768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:14:36.384793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:36.388163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:14:36.389395 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:14:36.389395 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:36.389395 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:36.389395 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 593/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:14:36.392059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a3437-94cc-4846-97b3-8dd4af8b125f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:36.533218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a3437-94cc-4846-97b3-8dd4af8b125f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:36.572784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:36.582829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed7f37-2ea4-4d6e-be0b-b97c92e398fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:36.583727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed7f37-2ea4-4d6e-be0b-b97c92e398fe None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:36.583878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed7f37-2ea4-4d6e-be0b-b97c92e398fe None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:36.584245 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed7f37-2ea4-4d6e-be0b-b97c92e398fe None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:36.585090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed7f37-2ea4-4d6e-be0b-b97c92e398fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:36.585478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed7f37-2ea4-4d6e-be0b-b97c92e398fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:36.586972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed7f37-2ea4-4d6e-be0b-b97c92e398fe None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:36.603847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 611/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:36.609671 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac0dfd-c167-4b77-af37-27c7ccbb2768 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:36.682949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:36.739935 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac0dfd-c167-4b77-af37-27c7ccbb2768 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:36.780565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a78b17-d2a7-44fd-9fcf-2cf2ed061d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:36.781258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78b17-d2a7-44fd-9fcf-2cf2ed061d10 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:36.781497 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78b17-d2a7-44fd-9fcf-2cf2ed061d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:36.781846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a78b17-d2a7-44fd-9fcf-2cf2ed061d10 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:36.782498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a78b17-d2a7-44fd-9fcf-2cf2ed061d10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:36.784600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a78b17-d2a7-44fd-9fcf-2cf2ed061d10 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:36.808422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 594/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Sun Sep 18 06:14:36 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:14:39.211743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172053-3596-482c-8533-6893e8590457 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:39.212340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172053-3596-482c-8533-6893e8590457 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:39.212512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172053-3596-482c-8533-6893e8590457 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:39.214773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 612/1206] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:14:39.221979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a55d-dc90-4197-9fba-f15db4872cd2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:39.222589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a55d-dc90-4197-9fba-f15db4872cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:39.222589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a55d-dc90-4197-9fba-f15db4872cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:39.241825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-51c2a55d-dc90-4197-9fba-f15db4872cd2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:14:39.243071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-51c2a55d-dc90-4197-9fba-f15db4872cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:14:39.321076 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 595/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:14:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:14:39.595308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7172053-3596-482c-8533-6893e8590457 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:39.716515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7172053-3596-482c-8533-6893e8590457 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:39.758875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44845ffd-d6e4-4158-835d-77df3de4bd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:39.759513 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44845ffd-d6e4-4158-835d-77df3de4bd33 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:39.759839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44845ffd-d6e4-4158-835d-77df3de4bd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:39.760103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44845ffd-d6e4-4158-835d-77df3de4bd33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:39.773092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44845ffd-d6e4-4158-835d-77df3de4bd33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-44845ffd-d6e4-4158-835d-77df3de4bd33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:14:39.778535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:39.779522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:14:39.780420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:39.785597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 613/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:14:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:39.786864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2a55d-dc90-4197-9fba-f15db4872cd2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:39.830062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:39.898556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2a55d-dc90-4197-9fba-f15db4872cd2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:39.939413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa60353-b0b4-4d20-920d-b6539c5c6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:39.940842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60353-b0b4-4d20-920d-b6539c5c6ffd None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:39.941169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60353-b0b4-4d20-920d-b6539c5c6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:39.941478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60353-b0b4-4d20-920d-b6539c5c6ffd None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:39.942334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa60353-b0b4-4d20-920d-b6539c5c6ffd None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:39.942668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa60353-b0b4-4d20-920d-b6539c5c6ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:39.944183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa60353-b0b4-4d20-920d-b6539c5c6ffd None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:39.958297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 596/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:14:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:39.959568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44845ffd-d6e4-4158-835d-77df3de4bd33 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:40.013458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:40.078090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44845ffd-d6e4-4158-835d-77df3de4bd33 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:40.118050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b645179-6386-4871-a895-27b78369fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:40.118050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b645179-6386-4871-a895-27b78369fb04 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:40.118050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b645179-6386-4871-a895-27b78369fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:40.118050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b645179-6386-4871-a895-27b78369fb04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:40.130082 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b645179-6386-4871-a895-27b78369fb04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:40.131524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b645179-6386-4871-a895-27b78369fb04 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-7b645179-6386-4871-a895-27b78369fb04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:14:40.147470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:40.148859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:14:40.150114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:14:40.150114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:40.150114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:40.151614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 614/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:40.157762 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa60353-b0b4-4d20-920d-b6539c5c6ffd None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:40.275402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:40.280317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa60353-b0b4-4d20-920d-b6539c5c6ffd None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:40.322796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168c950-f387-4bf2-8647-e2db7e6aba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:40.323572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168c950-f387-4bf2-8647-e2db7e6aba1f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:40.323968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168c950-f387-4bf2-8647-e2db7e6aba1f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:40.324262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168c950-f387-4bf2-8647-e2db7e6aba1f None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:40.325052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168c950-f387-4bf2-8647-e2db7e6aba1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:40.325467 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168c950-f387-4bf2-8647-e2db7e6aba1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:40.327492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168c950-f387-4bf2-8647-e2db7e6aba1f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:40.347233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 597/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:40.348790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b645179-6386-4871-a895-27b78369fb04 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:40.467607 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b645179-6386-4871-a895-27b78369fb04 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:40.469520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:40.507445 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a43eb3-029a-492c-8db8-8b82cd2f9b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:40.508310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43eb3-029a-492c-8db8-8b82cd2f9b8a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:40.508567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43eb3-029a-492c-8db8-8b82cd2f9b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:40.508816 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a43eb3-029a-492c-8db8-8b82cd2f9b8a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:40.516869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a43eb3-029a-492c-8db8-8b82cd2f9b8a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:40.518397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a43eb3-029a-492c-8db8-8b82cd2f9b8a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-83a43eb3-029a-492c-8db8-8b82cd2f9b8a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:14:40.530721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:40.531792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:40.533216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:40.533216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:40.533216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:14:40.533216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:14:40.533216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:14:40.533216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:14:40.533216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:14:40.533216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:14:40.533216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:14:40.533216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:40.533216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 615/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:40.538940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168c950-f387-4bf2-8647-e2db7e6aba1f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:40.670525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168c950-f387-4bf2-8647-e2db7e6aba1f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:40.717271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acdd3e-8192-4c3f-bc34-c1ad190ed7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:40.718137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acdd3e-8192-4c3f-bc34-c1ad190ed7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:40.718412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acdd3e-8192-4c3f-bc34-c1ad190ed7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:40.718786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acdd3e-8192-4c3f-bc34-c1ad190ed7e9 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:40.719631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acdd3e-8192-4c3f-bc34-c1ad190ed7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:40.720174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acdd3e-8192-4c3f-bc34-c1ad190ed7e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:40.722832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acdd3e-8192-4c3f-bc34-c1ad190ed7e9 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:40.741924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 598/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 18 06:14:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:14:40.747876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a43eb3-029a-492c-8db8-8b82cd2f9b8a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:40.867479 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a43eb3-029a-492c-8db8-8b82cd2f9b8a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:40.906229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44837810-dd09-4ddf-b3a4-7d6e1c5a9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:40.906833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44837810-dd09-4ddf-b3a4-7d6e1c5a9744 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:40.907112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44837810-dd09-4ddf-b3a4-7d6e1c5a9744 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:40.907449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44837810-dd09-4ddf-b3a4-7d6e1c5a9744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:40.944181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:40.996307 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44837810-dd09-4ddf-b3a4-7d6e1c5a9744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:40.997691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44837810-dd09-4ddf-b3a4-7d6e1c5a9744 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:41.113900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 616/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:14:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 18 06:14:41.119561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acdd3e-8192-4c3f-bc34-c1ad190ed7e9 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:41.140567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:41.233923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acdd3e-8192-4c3f-bc34-c1ad190ed7e9 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:41.276040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05725214-9ea5-4ac5-9a38-ee1c2335e9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:41.276838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05725214-9ea5-4ac5-9a38-ee1c2335e9ec None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:41.276838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05725214-9ea5-4ac5-9a38-ee1c2335e9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:41.277120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05725214-9ea5-4ac5-9a38-ee1c2335e9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:41.288363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05725214-9ea5-4ac5-9a38-ee1c2335e9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:41.289807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05725214-9ea5-4ac5-9a38-ee1c2335e9ec None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-05725214-9ea5-4ac5-9a38-ee1c2335e9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:14:41.308073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:41.309159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:14:41.314685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:14:41.314685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:41.314685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:41.314685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 599/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:41.315490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44837810-dd09-4ddf-b3a4-7d6e1c5a9744 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:41.387405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:41.431773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44837810-dd09-4ddf-b3a4-7d6e1c5a9744 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:41.477471 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eef893-ace6-4ae9-8ff5-1e47214012eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:41.478112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eef893-ace6-4ae9-8ff5-1e47214012eb None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:41.478361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eef893-ace6-4ae9-8ff5-1e47214012eb None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:41.478657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eef893-ace6-4ae9-8ff5-1e47214012eb None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:41.479281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eef893-ace6-4ae9-8ff5-1e47214012eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:41.479583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eef893-ace6-4ae9-8ff5-1e47214012eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:41.481048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eef893-ace6-4ae9-8ff5-1e47214012eb None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:41.495116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 617/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:41.501429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05725214-9ea5-4ac5-9a38-ee1c2335e9ec None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:41.587351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:41.620864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05725214-9ea5-4ac5-9a38-ee1c2335e9ec None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:41.669591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0bbbe-cbe2-47bf-8d48-b7ac4912f5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:41.670273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0bbbe-cbe2-47bf-8d48-b7ac4912f5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:41.670593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0bbbe-cbe2-47bf-8d48-b7ac4912f5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:41.670924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0bbbe-cbe2-47bf-8d48-b7ac4912f5f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:41.680445 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0bbbe-cbe2-47bf-8d48-b7ac4912f5f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:41.682054 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0bbbe-cbe2-47bf-8d48-b7ac4912f5f7 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-5ac0bbbe-cbe2-47bf-8d48-b7ac4912f5f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:14:41.697795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:41.699013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:41.699967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:14:41.699967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:14:41.699967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:14:41.699967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:14:41.699967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:14:41.699967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:14:41.699967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:14:41.699967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:41.706733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 600/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:14:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:41.706961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eef893-ace6-4ae9-8ff5-1e47214012eb None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:41.828468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eef893-ace6-4ae9-8ff5-1e47214012eb None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:41.853565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:41.867620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bbc78-7dd1-48f7-80df-921a0c1fe900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:41.868346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bbc78-7dd1-48f7-80df-921a0c1fe900 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:41.868645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bbc78-7dd1-48f7-80df-921a0c1fe900 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:41.868926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bbc78-7dd1-48f7-80df-921a0c1fe900 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:41.869611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bbc78-7dd1-48f7-80df-921a0c1fe900 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:41.869913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bbc78-7dd1-48f7-80df-921a0c1fe900 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:41.871362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bbc78-7dd1-48f7-80df-921a0c1fe900 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:41.884835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 618/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:14:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:41.890918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0bbbe-cbe2-47bf-8d48-b7ac4912f5f7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:41.992073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0bbbe-cbe2-47bf-8d48-b7ac4912f5f7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:42.021825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:42.028130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab16024-18a3-4604-a64a-4786bb4d4f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:42.028803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab16024-18a3-4604-a64a-4786bb4d4f33 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:42.029151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab16024-18a3-4604-a64a-4786bb4d4f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:42.029490 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab16024-18a3-4604-a64a-4786bb4d4f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:42.030279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab16024-18a3-4604-a64a-4786bb4d4f33 None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=320a1c60b5b6461c8e2e2b6ec74ce78d) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:42.030661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab16024-18a3-4604-a64a-4786bb4d4f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:42.032172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab16024-18a3-4604-a64a-4786bb4d4f33 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:42.037874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 601/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:14:41 2022] GET /identity/v3/role_assignments?user.id=320a1c60b5b6461c8e2e2b6ec74ce78d&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:44.227776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162ed3e-99c4-4fc9-8ecf-46b28f36de07 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:44.228365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162ed3e-99c4-4fc9-8ecf-46b28f36de07 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:44.228365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162ed3e-99c4-4fc9-8ecf-46b28f36de07 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:44.229814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 619/1220] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:14:44.235204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecefcb-361c-48d7-a322-d9992736692b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:44.235668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecefcb-361c-48d7-a322-d9992736692b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:44.235773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecefcb-361c-48d7-a322-d9992736692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:44.255062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-81ecefcb-361c-48d7-a322-d9992736692b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:14:44.256331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-81ecefcb-361c-48d7-a322-d9992736692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:14:44.326249 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 602/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:14:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:14:44.612872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162ed3e-99c4-4fc9-8ecf-46b28f36de07 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:44.733044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162ed3e-99c4-4fc9-8ecf-46b28f36de07 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:44.772407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e21555-ebd1-4415-be2a-1d3a87fc08ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:44.773045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21555-ebd1-4415-be2a-1d3a87fc08ef None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:44.773321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21555-ebd1-4415-be2a-1d3a87fc08ef None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:44.773649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21555-ebd1-4415-be2a-1d3a87fc08ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:44.785905 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e21555-ebd1-4415-be2a-1d3a87fc08ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-b6e21555-ebd1-4415-be2a-1d3a87fc08ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:14:44.790696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:44.791618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:44.800225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 620/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:14:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:44.801297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecefcb-361c-48d7-a322-d9992736692b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:44.921291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecefcb-361c-48d7-a322-d9992736692b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:44.950855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:44.964544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c05bf-47e6-4b85-80a0-d4345e587147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:44.965209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c05bf-47e6-4b85-80a0-d4345e587147 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:44.965563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c05bf-47e6-4b85-80a0-d4345e587147 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:44.965857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c05bf-47e6-4b85-80a0-d4345e587147 None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:44.966560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c05bf-47e6-4b85-80a0-d4345e587147 None admin] RBAC: Adding query filter params (name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:44.966867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c05bf-47e6-4b85-80a0-d4345e587147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:44.968365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c05bf-47e6-4b85-80a0-d4345e587147 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:44.977837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 603/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:14:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:44.984274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e21555-ebd1-4415-be2a-1d3a87fc08ef None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:45.035084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:45.106020 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e21555-ebd1-4415-be2a-1d3a87fc08ef None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:45.144223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70848e98-714b-43d3-927c-3b73df6c779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:45.144894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848e98-714b-43d3-927c-3b73df6c779a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:45.145158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848e98-714b-43d3-927c-3b73df6c779a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:45.145431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70848e98-714b-43d3-927c-3b73df6c779a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:45.156260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70848e98-714b-43d3-927c-3b73df6c779a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:45.157826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70848e98-714b-43d3-927c-3b73df6c779a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-70848e98-714b-43d3-927c-3b73df6c779a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:14:45.174393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:45.175630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:14:45.176924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:14:45.176924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:45.176924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:45.176924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 621/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:45.182098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c05bf-47e6-4b85-80a0-d4345e587147 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:45.306148 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c05bf-47e6-4b85-80a0-d4345e587147 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:45.342206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac732269-e352-4968-a1b1-347ea120c92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:45.342882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac732269-e352-4968-a1b1-347ea120c92c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:45.343165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac732269-e352-4968-a1b1-347ea120c92c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:45.343504 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac732269-e352-4968-a1b1-347ea120c92c None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:45.344246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac732269-e352-4968-a1b1-347ea120c92c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:45.344571 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac732269-e352-4968-a1b1-347ea120c92c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:45.346019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac732269-e352-4968-a1b1-347ea120c92c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:45.358856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 604/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:45.364969 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70848e98-714b-43d3-927c-3b73df6c779a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:45.467259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:45.474814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70848e98-714b-43d3-927c-3b73df6c779a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:45.513786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53107ec-cb5f-47ee-84d2-52a7d142d72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:45.514556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53107ec-cb5f-47ee-84d2-52a7d142d72a None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:45.514884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53107ec-cb5f-47ee-84d2-52a7d142d72a None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:45.515199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53107ec-cb5f-47ee-84d2-52a7d142d72a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:45.523689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53107ec-cb5f-47ee-84d2-52a7d142d72a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:45.525296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53107ec-cb5f-47ee-84d2-52a7d142d72a None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-a53107ec-cb5f-47ee-84d2-52a7d142d72a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:14:45.538215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:45.539458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:45.540684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:45.540684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:45.540684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:14:45.540684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:14:45.540684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:14:45.540684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:14:45.540684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:14:45.540684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:14:45.540684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:14:45.540684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:45.540684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 622/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:45.547658 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac732269-e352-4968-a1b1-347ea120c92c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:45.608131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:45.665756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac732269-e352-4968-a1b1-347ea120c92c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:45.706855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c66bb-5b3a-4fa1-b8e1-49fc0fa1d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:45.707471 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c66bb-5b3a-4fa1-b8e1-49fc0fa1d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:45.707770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c66bb-5b3a-4fa1-b8e1-49fc0fa1d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:45.708159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c66bb-5b3a-4fa1-b8e1-49fc0fa1d9a3 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:45.708906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c66bb-5b3a-4fa1-b8e1-49fc0fa1d9a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:45.709265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c66bb-5b3a-4fa1-b8e1-49fc0fa1d9a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:45.710739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c66bb-5b3a-4fa1-b8e1-49fc0fa1d9a3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:45.731264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 605/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 18 06:14:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:45.737778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53107ec-cb5f-47ee-84d2-52a7d142d72a None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:45.849162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53107ec-cb5f-47ee-84d2-52a7d142d72a None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:45.884947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb411d-328c-402c-a6ea-2e3cbe67e2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:45.885817 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb411d-328c-402c-a6ea-2e3cbe67e2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:45.886243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb411d-328c-402c-a6ea-2e3cbe67e2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:45.886638 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb411d-328c-402c-a6ea-2e3cbe67e2e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:45.898926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb411d-328c-402c-a6ea-2e3cbe67e2e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:45.900406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb411d-328c-402c-a6ea-2e3cbe67e2e1 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-a0fb411d-328c-402c-a6ea-2e3cbe67e2e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:14:45.914794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:45.916331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:14:45.917663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:14:45.917663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:45.917663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:45.917663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 623/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:14:45.921988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c66bb-5b3a-4fa1-b8e1-49fc0fa1d9a3 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:46.031102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c66bb-5b3a-4fa1-b8e1-49fc0fa1d9a3 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:46.034179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:46.071552 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9899213-532a-4982-a3e2-9205841fa7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:46.072246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899213-532a-4982-a3e2-9205841fa7dc None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:46.072530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899213-532a-4982-a3e2-9205841fa7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:46.072924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899213-532a-4982-a3e2-9205841fa7dc None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:46.073456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9899213-532a-4982-a3e2-9205841fa7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:46.073763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9899213-532a-4982-a3e2-9205841fa7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:46.075147 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9899213-532a-4982-a3e2-9205841fa7dc None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:46.091880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 606/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:46.093296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb411d-328c-402c-a6ea-2e3cbe67e2e1 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:46.107118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:46.206582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb411d-328c-402c-a6ea-2e3cbe67e2e1 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:46.243673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88bfa5-2228-4bd0-911a-afc94857ad2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:46.244355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88bfa5-2228-4bd0-911a-afc94857ad2e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:46.244634 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88bfa5-2228-4bd0-911a-afc94857ad2e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:46.244907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88bfa5-2228-4bd0-911a-afc94857ad2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:46.251752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88bfa5-2228-4bd0-911a-afc94857ad2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:46.253252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88bfa5-2228-4bd0-911a-afc94857ad2e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-6f88bfa5-2228-4bd0-911a-afc94857ad2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:14:46.265704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:46.266802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:46.267883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:14:46.267883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:14:46.267883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:14:46.267883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:14:46.267883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:14:46.267883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:14:46.267883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:14:46.267883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:46.267883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 624/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:46.272818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9899213-532a-4982-a3e2-9205841fa7dc None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:46.381948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9899213-532a-4982-a3e2-9205841fa7dc None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:46.418999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37e073-2c46-4373-99ba-8a64fe02f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:46.419596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e073-2c46-4373-99ba-8a64fe02f122 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:46.419869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e073-2c46-4373-99ba-8a64fe02f122 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:46.420166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e073-2c46-4373-99ba-8a64fe02f122 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:46.420846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37e073-2c46-4373-99ba-8a64fe02f122 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:46.421146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37e073-2c46-4373-99ba-8a64fe02f122 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:46.422605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37e073-2c46-4373-99ba-8a64fe02f122 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:46.438284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 607/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:46.446572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88bfa5-2228-4bd0-911a-afc94857ad2e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:46.522039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:46.566528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88bfa5-2228-4bd0-911a-afc94857ad2e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:46.606168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459a4ca-34b6-4d6f-9c66-914b07ccdc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:46.606861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459a4ca-34b6-4d6f-9c66-914b07ccdc21 None admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:46.607104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459a4ca-34b6-4d6f-9c66-914b07ccdc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:46.607378 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459a4ca-34b6-4d6f-9c66-914b07ccdc21 None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/320a1c60b5b6461c8e2e2b6ec74ce78d/roles/7a2c1ebe84c94165a42716d4de2d3290` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:46.623374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459a4ca-34b6-4d6f-9c66-914b07ccdc21 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=320a1c60b5b6461c8e2e2b6ec74ce78d, role_id=7a2c1ebe84c94165a42716d4de2d3290)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:46.624918 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459a4ca-34b6-4d6f-9c66-914b07ccdc21 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:46.639151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 625/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:14:46 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/320a1c60b5b6461c8e2e2b6ec74ce78d/roles/7a2c1ebe84c94165a42716d4de2d3290 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:14:48.832955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89887e-6ffb-4ad1-90df-2b1a6d93e115 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:48.833481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89887e-6ffb-4ad1-90df-2b1a6d93e115 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:48.833481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89887e-6ffb-4ad1-90df-2b1a6d93e115 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:48.834838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 608/1233] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:14:48.840504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d83c1c-8004-4668-aa8a-812a7c8da717 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:48.840985 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d83c1c-8004-4668-aa8a-812a7c8da717 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:48.841134 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d83c1c-8004-4668-aa8a-812a7c8da717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:48.860714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-49d83c1c-8004-4668-aa8a-812a7c8da717 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:14:48.861990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-49d83c1c-8004-4668-aa8a-812a7c8da717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:14:48.943778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 626/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:14:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:14:49.282281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89887e-6ffb-4ad1-90df-2b1a6d93e115 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:49.309873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:49.396990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89887e-6ffb-4ad1-90df-2b1a6d93e115 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:49.432412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490170d-15f7-40c9-b185-5ebf8186b142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:49.433036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490170d-15f7-40c9-b185-5ebf8186b142 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:49.433313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490170d-15f7-40c9-b185-5ebf8186b142 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:49.433587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490170d-15f7-40c9-b185-5ebf8186b142 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:49.443624 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490170d-15f7-40c9-b185-5ebf8186b142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-1490170d-15f7-40c9-b185-5ebf8186b142 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:14:49.448403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:49.449589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:49.450511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 609/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Sun Sep 18 06:14:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:49.456123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d83c1c-8004-4668-aa8a-812a7c8da717 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:49.504772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:49.566753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d83c1c-8004-4668-aa8a-812a7c8da717 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:49.605334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e23bf-da5c-4aa0-8293-1b8f71b6e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:49.606019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e23bf-da5c-4aa0-8293-1b8f71b6e245 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:49.606345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e23bf-da5c-4aa0-8293-1b8f71b6e245 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:49.606626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e23bf-da5c-4aa0-8293-1b8f71b6e245 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:49.607355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e23bf-da5c-4aa0-8293-1b8f71b6e245 None admin] RBAC: Adding query filter params (name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:49.607663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e23bf-da5c-4aa0-8293-1b8f71b6e245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:49.609136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e23bf-da5c-4aa0-8293-1b8f71b6e245 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:49.618011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 627/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Sun Sep 18 06:14:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:49.627203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490170d-15f7-40c9-b185-5ebf8186b142 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:49.727109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:49.745521 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490170d-15f7-40c9-b185-5ebf8186b142 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:49.787837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e62f99-6d5c-4d11-b980-bfd0e123e998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:49.788557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e62f99-6d5c-4d11-b980-bfd0e123e998 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:49.788889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e62f99-6d5c-4d11-b980-bfd0e123e998 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:49.789224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e62f99-6d5c-4d11-b980-bfd0e123e998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:49.801074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e62f99-6d5c-4d11-b980-bfd0e123e998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:49.802520 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e62f99-6d5c-4d11-b980-bfd0e123e998 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-86e62f99-6d5c-4d11-b980-bfd0e123e998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:14:49.819242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:49.825795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:14:49.827295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:14:49.827295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:49.827295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:49.827295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 610/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:49.827679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e23bf-da5c-4aa0-8293-1b8f71b6e245 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:49.934430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e23bf-da5c-4aa0-8293-1b8f71b6e245 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:49.944844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:49.973173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba9231-c732-4ea3-99cc-a6a154cd304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:49.973776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba9231-c732-4ea3-99cc-a6a154cd304f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:49.974050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba9231-c732-4ea3-99cc-a6a154cd304f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:49.974325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba9231-c732-4ea3-99cc-a6a154cd304f None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:49.974964 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba9231-c732-4ea3-99cc-a6a154cd304f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:49.975259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba9231-c732-4ea3-99cc-a6a154cd304f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:49.976665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba9231-c732-4ea3-99cc-a6a154cd304f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:49.991374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 628/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:49.997140 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e62f99-6d5c-4d11-b980-bfd0e123e998 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:50.103820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e62f99-6d5c-4d11-b980-bfd0e123e998 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:50.138586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84960d-29fa-4e2c-a519-7f6e3547e325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:50.139255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84960d-29fa-4e2c-a519-7f6e3547e325 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:50.139488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84960d-29fa-4e2c-a519-7f6e3547e325 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:50.139763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84960d-29fa-4e2c-a519-7f6e3547e325 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:50.143453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:50.150221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84960d-29fa-4e2c-a519-7f6e3547e325 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:50.152063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84960d-29fa-4e2c-a519-7f6e3547e325 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ef84960d-29fa-4e2c-a519-7f6e3547e325 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:14:50.163948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:50.165327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:50.166603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:50.166603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:50.166603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:14:50.166603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:14:50.166603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:14:50.166603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:14:50.166603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:14:50.166603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:14:50.166603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:14:50.166603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:50.166603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 611/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:50.171280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba9231-c732-4ea3-99cc-a6a154cd304f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:50.276712 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba9231-c732-4ea3-99cc-a6a154cd304f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:50.316183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cfe23-246d-47ea-a177-8626d015793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:50.316791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cfe23-246d-47ea-a177-8626d015793f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:50.317140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cfe23-246d-47ea-a177-8626d015793f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:50.317345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cfe23-246d-47ea-a177-8626d015793f None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:50.318066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cfe23-246d-47ea-a177-8626d015793f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:50.318365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cfe23-246d-47ea-a177-8626d015793f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:50.319803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cfe23-246d-47ea-a177-8626d015793f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:50.339460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 629/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 18 06:14:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:50.345125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84960d-29fa-4e2c-a519-7f6e3547e325 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:50.466429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84960d-29fa-4e2c-a519-7f6e3547e325 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:50.509713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75d440-8597-40f7-8b4f-5e7ac40df709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:50.510407 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d440-8597-40f7-8b4f-5e7ac40df709 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:50.510680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d440-8597-40f7-8b4f-5e7ac40df709 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:50.510979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d440-8597-40f7-8b4f-5e7ac40df709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:50.597597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:50.607483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75d440-8597-40f7-8b4f-5e7ac40df709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:50.609180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75d440-8597-40f7-8b4f-5e7ac40df709 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:50.729521 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 612/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:14:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:14:50.735730 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cfe23-246d-47ea-a177-8626d015793f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:50.768662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:50.858480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cfe23-246d-47ea-a177-8626d015793f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:50.896682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e9b49-c2d2-47ee-8b36-1c8a4f3d588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:50.897303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9b49-c2d2-47ee-8b36-1c8a4f3d588c None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:50.897577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9b49-c2d2-47ee-8b36-1c8a4f3d588c None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:50.897841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e9b49-c2d2-47ee-8b36-1c8a4f3d588c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:50.909900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e9b49-c2d2-47ee-8b36-1c8a4f3d588c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:50.911538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e9b49-c2d2-47ee-8b36-1c8a4f3d588c None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-e27e9b49-c2d2-47ee-8b36-1c8a4f3d588c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:14:50.926759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:50.934327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:14:50.935879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:14:50.935879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:50.935879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:50.935879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 630/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:50.936225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75d440-8597-40f7-8b4f-5e7ac40df709 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:51.045130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:51.052201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75d440-8597-40f7-8b4f-5e7ac40df709 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:51.089780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a47e95-a782-4b4d-bb40-1d63b79207f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:51.090379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a47e95-a782-4b4d-bb40-1d63b79207f5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:51.090654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a47e95-a782-4b4d-bb40-1d63b79207f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:51.090925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a47e95-a782-4b4d-bb40-1d63b79207f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:51.091563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a47e95-a782-4b4d-bb40-1d63b79207f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:51.091865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a47e95-a782-4b4d-bb40-1d63b79207f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:51.093278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a47e95-a782-4b4d-bb40-1d63b79207f5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:51.106885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 613/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:51.114163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e9b49-c2d2-47ee-8b36-1c8a4f3d588c None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:51.199398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:51.224244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e9b49-c2d2-47ee-8b36-1c8a4f3d588c None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:51.262315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eebe43-7c29-49ab-beeb-a6d2f22308fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:51.262942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebe43-7c29-49ab-beeb-a6d2f22308fe None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:51.263221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebe43-7c29-49ab-beeb-a6d2f22308fe None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:51.263495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebe43-7c29-49ab-beeb-a6d2f22308fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:51.270655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eebe43-7c29-49ab-beeb-a6d2f22308fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:51.272352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eebe43-7c29-49ab-beeb-a6d2f22308fe None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-d9eebe43-7c29-49ab-beeb-a6d2f22308fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:14:51.285632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:51.286785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:51.287869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:14:51.287869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:14:51.287869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:14:51.287869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:14:51.287869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:14:51.287869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:14:51.287869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:14:51.287869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:51.287869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 631/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:14:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:51.292962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a47e95-a782-4b4d-bb40-1d63b79207f5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:51.405768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a47e95-a782-4b4d-bb40-1d63b79207f5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:51.443493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142339c-2f76-4dd7-8f28-76335850523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:51.444122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142339c-2f76-4dd7-8f28-76335850523b None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:51.444402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142339c-2f76-4dd7-8f28-76335850523b None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:51.444686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142339c-2f76-4dd7-8f28-76335850523b None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:51.445390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142339c-2f76-4dd7-8f28-76335850523b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:51.445725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142339c-2f76-4dd7-8f28-76335850523b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:51.447213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142339c-2f76-4dd7-8f28-76335850523b None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:51.465327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 614/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:14:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:51.466552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eebe43-7c29-49ab-beeb-a6d2f22308fe None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:51.581648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eebe43-7c29-49ab-beeb-a6d2f22308fe None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:51.622502 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347560aa-98b8-49d7-b14e-af740c24ea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:51.623112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347560aa-98b8-49d7-b14e-af740c24ea0f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:51.623385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347560aa-98b8-49d7-b14e-af740c24ea0f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:51.623652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347560aa-98b8-49d7-b14e-af740c24ea0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:51.624414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347560aa-98b8-49d7-b14e-af740c24ea0f None admin] RBAC: Adding query filter params (role.id=7a2c1ebe84c94165a42716d4de2d3290, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=320a1c60b5b6461c8e2e2b6ec74ce78d) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:51.624715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347560aa-98b8-49d7-b14e-af740c24ea0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:51.626430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347560aa-98b8-49d7-b14e-af740c24ea0f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:51.632592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 632/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:14:51 2022] GET /identity/v3/role_assignments?user.id=320a1c60b5b6461c8e2e2b6ec74ce78d&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=7a2c1ebe84c94165a42716d4de2d3290 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:54.269729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f045-5141-4f9b-8558-b00307b1c743 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:54.270304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f045-5141-4f9b-8558-b00307b1c743 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:54.270304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f045-5141-4f9b-8558-b00307b1c743 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:54.271677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 615/1247] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:14:54.277104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e9e3-3ead-49ab-a439-822f9026c0f8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:54.277573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e9e3-3ead-49ab-a439-822f9026c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:54.277802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e9e3-3ead-49ab-a439-822f9026c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:54.284829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:54.297521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1f43e9e3-3ead-49ab-a439-822f9026c0f8 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:14:54.299367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1f43e9e3-3ead-49ab-a439-822f9026c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:14:54.367086 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 633/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:14:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:14:54.640586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8f045-5141-4f9b-8558-b00307b1c743 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:54.660789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:54.761554 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8f045-5141-4f9b-8558-b00307b1c743 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:54.799175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14405e5-ccc1-4766-bd1c-093d89d79920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:54.799940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14405e5-ccc1-4766-bd1c-093d89d79920 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:54.800216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14405e5-ccc1-4766-bd1c-093d89d79920 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:54.800490 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14405e5-ccc1-4766-bd1c-093d89d79920 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:54.811165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14405e5-ccc1-4766-bd1c-093d89d79920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-f14405e5-ccc1-4766-bd1c-093d89d79920 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:14:54.816926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:54.818141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:54.819285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 616/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:14:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:54.826786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e9e3-3ead-49ab-a439-822f9026c0f8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:54.934269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e9e3-3ead-49ab-a439-822f9026c0f8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:54.966176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:54.973124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d6dd-5f77-4a13-90c6-d16063fb83f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:54.973746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d6dd-5f77-4a13-90c6-d16063fb83f3 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:54.974021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d6dd-5f77-4a13-90c6-d16063fb83f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:54.974288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d6dd-5f77-4a13-90c6-d16063fb83f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:54.974954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d6dd-5f77-4a13-90c6-d16063fb83f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:54.975250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d6dd-5f77-4a13-90c6-d16063fb83f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:54.976682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d6dd-5f77-4a13-90c6-d16063fb83f3 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:54.991437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 634/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:14:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:54.992786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14405e5-ccc1-4766-bd1c-093d89d79920 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:55.074720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:55.098683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14405e5-ccc1-4766-bd1c-093d89d79920 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:55.133820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b22ed0-2d77-4088-8753-fd4c06fde24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:55.134445 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b22ed0-2d77-4088-8753-fd4c06fde24f None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:55.134717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b22ed0-2d77-4088-8753-fd4c06fde24f None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:55.134989 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b22ed0-2d77-4088-8753-fd4c06fde24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:55.145013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b22ed0-2d77-4088-8753-fd4c06fde24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:55.146443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b22ed0-2d77-4088-8753-fd4c06fde24f None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-82b22ed0-2d77-4088-8753-fd4c06fde24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:14:55.161416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:55.162642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:14:55.164286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:14:55.164286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:55.164286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:55.164286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 617/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:55.168372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d6dd-5f77-4a13-90c6-d16063fb83f3 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:55.271411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d6dd-5f77-4a13-90c6-d16063fb83f3 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:55.306484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559d2f7-1005-4af6-97a3-6fa7cb404f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:55.307114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559d2f7-1005-4af6-97a3-6fa7cb404f5d None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:55.307341 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559d2f7-1005-4af6-97a3-6fa7cb404f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:55.307610 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559d2f7-1005-4af6-97a3-6fa7cb404f5d None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:55.308262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559d2f7-1005-4af6-97a3-6fa7cb404f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:55.308557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559d2f7-1005-4af6-97a3-6fa7cb404f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:55.309913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559d2f7-1005-4af6-97a3-6fa7cb404f5d None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:55.321600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 635/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:55.327487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b22ed0-2d77-4088-8753-fd4c06fde24f None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:55.426010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b22ed0-2d77-4088-8753-fd4c06fde24f None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:55.451021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:55.459737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f4370-a479-43cd-b65c-afb0f09242e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:55.460383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f4370-a479-43cd-b65c-afb0f09242e4 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:55.460658 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f4370-a479-43cd-b65c-afb0f09242e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:55.460932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f4370-a479-43cd-b65c-afb0f09242e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:55.468168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f4370-a479-43cd-b65c-afb0f09242e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:55.469593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f4370-a479-43cd-b65c-afb0f09242e4 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-e81f4370-a479-43cd-b65c-afb0f09242e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:14:55.480479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:55.481638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:55.482606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:55.482606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:55.482606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:14:55.482606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:14:55.482606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:14:55.482606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:14:55.482606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:14:55.482606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:14:55.482606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:14:55.482606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:55.482606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 618/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:55.488159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559d2f7-1005-4af6-97a3-6fa7cb404f5d None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:55.541738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:55.588431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559d2f7-1005-4af6-97a3-6fa7cb404f5d None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:55.621129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb7395-6dd6-4be7-a7b7-dff45a4bd9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:55.621715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7395-6dd6-4be7-a7b7-dff45a4bd9ab None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:55.621992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7395-6dd6-4be7-a7b7-dff45a4bd9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:55.622261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7395-6dd6-4be7-a7b7-dff45a4bd9ab None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:55.622976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb7395-6dd6-4be7-a7b7-dff45a4bd9ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:55.623276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb7395-6dd6-4be7-a7b7-dff45a4bd9ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:55.624722 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb7395-6dd6-4be7-a7b7-dff45a4bd9ab None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:55.641154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 636/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 18 06:14:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:55.647774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f4370-a479-43cd-b65c-afb0f09242e4 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:55.745670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f4370-a479-43cd-b65c-afb0f09242e4 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:55.778727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06272c0-8eff-4406-ab42-d3b60d31385c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:55.779310 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06272c0-8eff-4406-ab42-d3b60d31385c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:55.779590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06272c0-8eff-4406-ab42-d3b60d31385c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:55.779864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06272c0-8eff-4406-ab42-d3b60d31385c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:55.833618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:55.846129 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06272c0-8eff-4406-ab42-d3b60d31385c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:55.847561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06272c0-8eff-4406-ab42-d3b60d31385c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:55.944466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 619/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:14:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:14:55.950208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb7395-6dd6-4be7-a7b7-dff45a4bd9ab None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:56.046015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb7395-6dd6-4be7-a7b7-dff45a4bd9ab None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:56.058565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:56.080226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec486f-4f79-4b6b-b4da-905fc18eb825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:56.080757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec486f-4f79-4b6b-b4da-905fc18eb825 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:56.081030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec486f-4f79-4b6b-b4da-905fc18eb825 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:56.081297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec486f-4f79-4b6b-b4da-905fc18eb825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:56.090934 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec486f-4f79-4b6b-b4da-905fc18eb825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:56.092406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec486f-4f79-4b6b-b4da-905fc18eb825 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-f3ec486f-4f79-4b6b-b4da-905fc18eb825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:14:56.106420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:56.107535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:14:56.108507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:14:56.108507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:56.108507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:56.108507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 637/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:56.113723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06272c0-8eff-4406-ab42-d3b60d31385c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:56.197738 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:56.209561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06272c0-8eff-4406-ab42-d3b60d31385c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:56.242369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225db7e1-1551-4e0c-99d5-be0102ae06a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:56.242959 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225db7e1-1551-4e0c-99d5-be0102ae06a5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:56.243235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225db7e1-1551-4e0c-99d5-be0102ae06a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:56.243508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225db7e1-1551-4e0c-99d5-be0102ae06a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:56.244169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225db7e1-1551-4e0c-99d5-be0102ae06a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:56.244470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225db7e1-1551-4e0c-99d5-be0102ae06a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:56.245827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225db7e1-1551-4e0c-99d5-be0102ae06a5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:56.257497 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 620/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:56.263093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec486f-4f79-4b6b-b4da-905fc18eb825 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:56.360034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec486f-4f79-4b6b-b4da-905fc18eb825 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:56.392395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94624f2-4fc0-4e8d-ae22-bf5de6e38a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:56.393009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94624f2-4fc0-4e8d-ae22-bf5de6e38a1f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:56.393287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94624f2-4fc0-4e8d-ae22-bf5de6e38a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:56.393561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94624f2-4fc0-4e8d-ae22-bf5de6e38a1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:56.399871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94624f2-4fc0-4e8d-ae22-bf5de6e38a1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:56.401332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94624f2-4fc0-4e8d-ae22-bf5de6e38a1f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-c94624f2-4fc0-4e8d-ae22-bf5de6e38a1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:14:56.412739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:56.413622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:56.414558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:14:56.414558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:14:56.414558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:14:56.414558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:14:56.414558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:14:56.414558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:14:56.414558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:14:56.414558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:14:56.414558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 638/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:56.419574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225db7e1-1551-4e0c-99d5-be0102ae06a5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:56.515799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225db7e1-1551-4e0c-99d5-be0102ae06a5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:56.551616 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309f113-98c7-4fb8-86d1-8c0a86b6a760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:56.552285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309f113-98c7-4fb8-86d1-8c0a86b6a760 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:56.552597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309f113-98c7-4fb8-86d1-8c0a86b6a760 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:56.552913 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309f113-98c7-4fb8-86d1-8c0a86b6a760 None admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:56.553693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309f113-98c7-4fb8-86d1-8c0a86b6a760 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:56.554046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309f113-98c7-4fb8-86d1-8c0a86b6a760 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:56.555641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309f113-98c7-4fb8-86d1-8c0a86b6a760 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:56.569730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 621/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:56.575865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94624f2-4fc0-4e8d-ae22-bf5de6e38a1f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:56.605000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:56.677700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94624f2-4fc0-4e8d-ae22-bf5de6e38a1f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:56.710983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8afafd-b854-45b8-ad98-640f5d10f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:56.711567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8afafd-b854-45b8-ad98-640f5d10f8ea None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:56.711844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8afafd-b854-45b8-ad98-640f5d10f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:56.712145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8afafd-b854-45b8-ad98-640f5d10f8ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:56.712849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8afafd-b854-45b8-ad98-640f5d10f8ea None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=320a1c60b5b6461c8e2e2b6ec74ce78d) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:56.713152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8afafd-b854-45b8-ad98-640f5d10f8ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:56.714571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8afafd-b854-45b8-ad98-640f5d10f8ea None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:56.719686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 639/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:14:56 2022] GET /identity/v3/role_assignments?user.id=320a1c60b5b6461c8e2e2b6ec74ce78d&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=4494ba66c3f649febc69511a47e27b67 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:58.848492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbff2a-8491-46cd-b58b-647f964b27e9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:58.848967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbff2a-8491-46cd-b58b-647f964b27e9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:58.849069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbff2a-8491-46cd-b58b-647f964b27e9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:58.850373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 622/1261] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:14:58.855451 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a115-e79e-40ed-bb0e-d5af539777cc None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:58.855834 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a115-e79e-40ed-bb0e-d5af539777cc None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:58.856028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a115-e79e-40ed-bb0e-d5af539777cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:58.873805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b4b6a115-e79e-40ed-bb0e-d5af539777cc None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:14:58.875238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b4b6a115-e79e-40ed-bb0e-d5af539777cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:14:58.940397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 640/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:14:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:14:59.206948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbff2a-8491-46cd-b58b-647f964b27e9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:59.217753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:59.306887 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbff2a-8491-46cd-b58b-647f964b27e9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:59.339347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ead02-cd13-4cc3-b8d4-e2d101614fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:59.339976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ead02-cd13-4cc3-b8d4-e2d101614fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:59.340250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ead02-cd13-4cc3-b8d4-e2d101614fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:59.340520 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ead02-cd13-4cc3-b8d4-e2d101614fb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:59.350701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ead02-cd13-4cc3-b8d4-e2d101614fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-ab1ead02-cd13-4cc3-b8d4-e2d101614fb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:14:59.355343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:59.356478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:59.357349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 623/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:14:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:59.362424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a115-e79e-40ed-bb0e-d5af539777cc None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:59.380414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:59.459237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a115-e79e-40ed-bb0e-d5af539777cc None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:59.491052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7e96c-3ee6-4d7a-819e-d4d11fe289ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:59.491641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7e96c-3ee6-4d7a-819e-d4d11fe289ca None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:59.491945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7e96c-3ee6-4d7a-819e-d4d11fe289ca None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:59.492218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7e96c-3ee6-4d7a-819e-d4d11fe289ca None admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:59.492861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7e96c-3ee6-4d7a-819e-d4d11fe289ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:59.493159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7e96c-3ee6-4d7a-819e-d4d11fe289ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:59.494516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7e96c-3ee6-4d7a-819e-d4d11fe289ca None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:59.502965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 641/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:59.508581 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ead02-cd13-4cc3-b8d4-e2d101614fb7 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:59.578962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:59.616128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ead02-cd13-4cc3-b8d4-e2d101614fb7 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:59.649563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd4c72-8fba-457d-aa2d-3d6bcf3605cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:59.650180 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd4c72-8fba-457d-aa2d-3d6bcf3605cb None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:59.650459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd4c72-8fba-457d-aa2d-3d6bcf3605cb None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:59.650732 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd4c72-8fba-457d-aa2d-3d6bcf3605cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:59.660826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd4c72-8fba-457d-aa2d-3d6bcf3605cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:59.662261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd4c72-8fba-457d-aa2d-3d6bcf3605cb None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-07dd4c72-8fba-457d-aa2d-3d6bcf3605cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:14:59.675874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:59.677038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:14:59.678460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:14:59.678460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:14:59.678460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:59.678460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 624/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:59.682778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7e96c-3ee6-4d7a-819e-d4d11fe289ca None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:59.760923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:59.780180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7e96c-3ee6-4d7a-819e-d4d11fe289ca None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:59.812130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae055238-4bf3-4af7-9861-a048319bd260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:59.812721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055238-4bf3-4af7-9861-a048319bd260 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:59.813000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055238-4bf3-4af7-9861-a048319bd260 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:59.813272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055238-4bf3-4af7-9861-a048319bd260 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:59.814426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae055238-4bf3-4af7-9861-a048319bd260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:14:59.814721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae055238-4bf3-4af7-9861-a048319bd260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:59.816101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae055238-4bf3-4af7-9861-a048319bd260 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:59.827624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 642/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:14:59.833685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd4c72-8fba-457d-aa2d-3d6bcf3605cb None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:14:59.929923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd4c72-8fba-457d-aa2d-3d6bcf3605cb None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:14:59.949085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:14:59.962988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4732-9202-4c47-a8d7-9fae2075b931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:14:59.963593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4732-9202-4c47-a8d7-9fae2075b931 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:14:59.963867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4732-9202-4c47-a8d7-9fae2075b931 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:14:59.964168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4732-9202-4c47-a8d7-9fae2075b931 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:14:59.971491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4732-9202-4c47-a8d7-9fae2075b931 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:14:59.972950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4732-9202-4c47-a8d7-9fae2075b931 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-76bb4732-9202-4c47-a8d7-9fae2075b931 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:14:59.983516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:14:59.984701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:14:59.986506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:14:59.986506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:14:59.986506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:14:59.986506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:14:59.986506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:14:59.986506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:14:59.986506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:14:59.986506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:14:59.986506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:14:59.986506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:14:59.986506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 625/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:14:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:14:59.990987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae055238-4bf3-4af7-9861-a048319bd260 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:00.089143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae055238-4bf3-4af7-9861-a048319bd260 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:00.121552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6a1cb-bff2-43dc-9fd1-01f7830c5c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:00.122138 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a1cb-bff2-43dc-9fd1-01f7830c5c91 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:00.122416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a1cb-bff2-43dc-9fd1-01f7830c5c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:00.122688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a1cb-bff2-43dc-9fd1-01f7830c5c91 None admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:00.123399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6a1cb-bff2-43dc-9fd1-01f7830c5c91 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:00.123702 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6a1cb-bff2-43dc-9fd1-01f7830c5c91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:00.125420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6a1cb-bff2-43dc-9fd1-01f7830c5c91 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:00.134213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:00.143359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 643/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 18 06:14:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:15:00.149133 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4732-9202-4c47-a8d7-9fae2075b931 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:00.253899 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4732-9202-4c47-a8d7-9fae2075b931 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:00.287082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4e352-2532-4c29-9e23-fffab9004787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:00.287687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4e352-2532-4c29-9e23-fffab9004787 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:00.288001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4e352-2532-4c29-9e23-fffab9004787 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:00.288274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4e352-2532-4c29-9e23-fffab9004787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:00.298350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4e352-2532-4c29-9e23-fffab9004787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:00.299767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4e352-2532-4c29-9e23-fffab9004787 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9fc4e352-2532-4c29-9e23-fffab9004787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:15:00.313121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:15:00.314845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:15:00.315943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:15:00.315943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:15:00.315943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:15:00.315943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 626/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:15:00.321077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6a1cb-bff2-43dc-9fd1-01f7830c5c91 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:00.435713 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6a1cb-bff2-43dc-9fd1-01f7830c5c91 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:00.487197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e21fef-952a-40e5-a418-de010b112987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:00.487797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21fef-952a-40e5-a418-de010b112987 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:00.488100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21fef-952a-40e5-a418-de010b112987 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:00.488370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21fef-952a-40e5-a418-de010b112987 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:00.489006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e21fef-952a-40e5-a418-de010b112987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:00.489300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e21fef-952a-40e5-a418-de010b112987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:00.490661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e21fef-952a-40e5-a418-de010b112987 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:00.503861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 644/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:15:00.509769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4e352-2532-4c29-9e23-fffab9004787 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:00.545086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:00.623496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4e352-2532-4c29-9e23-fffab9004787 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:00.660324 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f396eaa-d58a-46d3-910e-fa2390c7e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:00.660941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f396eaa-d58a-46d3-910e-fa2390c7e95d None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:00.661218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f396eaa-d58a-46d3-910e-fa2390c7e95d None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:00.661492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f396eaa-d58a-46d3-910e-fa2390c7e95d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:00.668488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f396eaa-d58a-46d3-910e-fa2390c7e95d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:00.669927 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f396eaa-d58a-46d3-910e-fa2390c7e95d None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-9f396eaa-d58a-46d3-910e-fa2390c7e95d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:15:00.682470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:15:00.683544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:15:00.685322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:15:00.685322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:15:00.685322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:15:00.685322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:15:00.685322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:15:00.685322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:15:00.685322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:15:00.685322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:15:00.685322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 627/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 06:15:00.690750 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e21fef-952a-40e5-a418-de010b112987 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:00.751601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:00.794006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e21fef-952a-40e5-a418-de010b112987 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:00.835247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee2751-b3e0-4765-97b6-6734e771e5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:00.835863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee2751-b3e0-4765-97b6-6734e771e5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:00.836166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee2751-b3e0-4765-97b6-6734e771e5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:00.836442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee2751-b3e0-4765-97b6-6734e771e5f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:00.837138 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee2751-b3e0-4765-97b6-6734e771e5f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:00.837444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee2751-b3e0-4765-97b6-6734e771e5f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:00.839530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee2751-b3e0-4765-97b6-6734e771e5f6 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:00.856724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 645/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:15:00.863801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f396eaa-d58a-46d3-910e-fa2390c7e95d None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:00.965927 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:00.975798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f396eaa-d58a-46d3-910e-fa2390c7e95d None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:01.014829 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990511f9-dbfe-4eb6-bdcb-a4d6d499a178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:01.015494 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990511f9-dbfe-4eb6-bdcb-a4d6d499a178 None admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:01.015772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990511f9-dbfe-4eb6-bdcb-a4d6d499a178 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:01.016074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990511f9-dbfe-4eb6-bdcb-a4d6d499a178 None admin] PATH_INFO: `/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/320a1c60b5b6461c8e2e2b6ec74ce78d/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:01.018130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990511f9-dbfe-4eb6-bdcb-a4d6d499a178 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23310cf87d443fa8ff3dab6c84ad33d, user_id=320a1c60b5b6461c8e2e2b6ec74ce78d, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:01.019557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990511f9-dbfe-4eb6-bdcb-a4d6d499a178 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:01.032982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 628/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Sun Sep 18 06:15:00 2022] PUT /identity/v3/projects/b23310cf87d443fa8ff3dab6c84ad33d/users/320a1c60b5b6461c8e2e2b6ec74ce78d/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:15:03.179787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e493-8783-4a2f-8289-11c84034f705 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:03.180330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e493-8783-4a2f-8289-11c84034f705 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:03.180419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e493-8783-4a2f-8289-11c84034f705 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:03.181680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 646/1274] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:15:03.186774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b2a3-d6e2-4167-8e57-820d9463bf66 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:03.187202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b2a3-d6e2-4167-8e57-820d9463bf66 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:03.187304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b2a3-d6e2-4167-8e57-820d9463bf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:03.206279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8443b2a3-d6e2-4167-8e57-820d9463bf66 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:15:03.208204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8443b2a3-d6e2-4167-8e57-820d9463bf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:15:03.274285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 629/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:15:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:15:03.549299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e493-8783-4a2f-8289-11c84034f705 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:03.655367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e493-8783-4a2f-8289-11c84034f705 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:03.671723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:03.689712 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a2cf-b6cf-488c-b7d9-576f3b292f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:03.690317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a2cf-b6cf-488c-b7d9-576f3b292f5e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:03.690590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a2cf-b6cf-488c-b7d9-576f3b292f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:03.690855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a2cf-b6cf-488c-b7d9-576f3b292f5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:03.700588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a2cf-b6cf-488c-b7d9-576f3b292f5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8705a2cf-b6cf-488c-b7d9-576f3b292f5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 06:15:03.705395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:15:03.706507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:03.707711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 647/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Sun Sep 18 06:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:15:03.712536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443b2a3-d6e2-4167-8e57-820d9463bf66 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:03.791657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:03.810330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443b2a3-d6e2-4167-8e57-820d9463bf66 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:03.843461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb88756-a9bb-4c2d-94b4-a1774980d6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:03.844097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb88756-a9bb-4c2d-94b4-a1774980d6de None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:03.844405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb88756-a9bb-4c2d-94b4-a1774980d6de None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:03.844786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb88756-a9bb-4c2d-94b4-a1774980d6de None admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:03.845427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb88756-a9bb-4c2d-94b4-a1774980d6de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:03.845728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb88756-a9bb-4c2d-94b4-a1774980d6de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:03.847090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb88756-a9bb-4c2d-94b4-a1774980d6de None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:03.855018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 630/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Sun Sep 18 06:15:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:15:03.861646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a2cf-b6cf-488c-b7d9-576f3b292f5e None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:03.958388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a2cf-b6cf-488c-b7d9-576f3b292f5e None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:03.990883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1b09-e609-4b60-9fde-2248ca4bae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:03.991481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1b09-e609-4b60-9fde-2248ca4bae59 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:03.991753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1b09-e609-4b60-9fde-2248ca4bae59 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:03.992048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1b09-e609-4b60-9fde-2248ca4bae59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:04.002478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c1b09-e609-4b60-9fde-2248ca4bae59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:04.003920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c1b09-e609-4b60-9fde-2248ca4bae59 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-737c1b09-e609-4b60-9fde-2248ca4bae59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:15:04.018109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:15:04.019261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:15:04.020216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:15:04.020216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:15:04.020216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:04.020216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 648/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:15:04.024886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb88756-a9bb-4c2d-94b4-a1774980d6de None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:04.120364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb88756-a9bb-4c2d-94b4-a1774980d6de None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:04.151989 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d2661-7d12-44eb-a421-9032b57b3198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:04.152574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2661-7d12-44eb-a421-9032b57b3198 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:04.152851 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2661-7d12-44eb-a421-9032b57b3198 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:04.153122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2661-7d12-44eb-a421-9032b57b3198 None admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:04.153744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d2661-7d12-44eb-a421-9032b57b3198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:04.154043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d2661-7d12-44eb-a421-9032b57b3198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:04.155387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d2661-7d12-44eb-a421-9032b57b3198 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:04.167205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 631/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:15:04.173400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1b09-e609-4b60-9fde-2248ca4bae59 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:04.202889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:04.271442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1b09-e609-4b60-9fde-2248ca4bae59 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:04.304008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23819060-e135-4769-bc2c-52e694f987b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:04.304616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23819060-e135-4769-bc2c-52e694f987b8 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:04.304890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23819060-e135-4769-bc2c-52e694f987b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:04.305157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23819060-e135-4769-bc2c-52e694f987b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:04.312189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23819060-e135-4769-bc2c-52e694f987b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:04.313618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23819060-e135-4769-bc2c-52e694f987b8 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-23819060-e135-4769-bc2c-52e694f987b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 06:15:04.324664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:15:04.325798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:15:04.326975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:15:04.326975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:15:04.326975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 06:15:04.326975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 06:15:04.326975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 06:15:04.326975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 06:15:04.326975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 06:15:04.326975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 06:15:04.326975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 06:15:04.326975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:04.326975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 649/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:15:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:15:04.331526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d2661-7d12-44eb-a421-9032b57b3198 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:04.335267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:04.429333 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d2661-7d12-44eb-a421-9032b57b3198 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:04.461499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150ce67-ca07-43f0-bcb8-3a1fea94bf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:04.462085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150ce67-ca07-43f0-bcb8-3a1fea94bf92 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:04.462361 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150ce67-ca07-43f0-bcb8-3a1fea94bf92 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:04.462632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150ce67-ca07-43f0-bcb8-3a1fea94bf92 None admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:04.463345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150ce67-ca07-43f0-bcb8-3a1fea94bf92 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:04.463648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150ce67-ca07-43f0-bcb8-3a1fea94bf92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:04.465086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150ce67-ca07-43f0-bcb8-3a1fea94bf92 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:04.481890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 632/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Sun Sep 18 06:15:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:15:04.488384 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23819060-e135-4769-bc2c-52e694f987b8 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:04.576163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:04.585811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23819060-e135-4769-bc2c-52e694f987b8 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:04.618655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5115b-c773-4280-a9e1-1b9f82417ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:04.619243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5115b-c773-4280-a9e1-1b9f82417ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:04.619518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5115b-c773-4280-a9e1-1b9f82417ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:04.619786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5115b-c773-4280-a9e1-1b9f82417ff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:04.684180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5115b-c773-4280-a9e1-1b9f82417ff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:04.685554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5115b-c773-4280-a9e1-1b9f82417ff2 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:04.777501 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:04.787753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 650/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Sun Sep 18 06:15:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 06:15:04.793715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150ce67-ca07-43f0-bcb8-3a1fea94bf92 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:04.860530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:04.898716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150ce67-ca07-43f0-bcb8-3a1fea94bf92 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:04.931542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49aa4f-6622-4fa5-8cc6-623f6436b48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:04.932181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49aa4f-6622-4fa5-8cc6-623f6436b48c None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:04.932460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49aa4f-6622-4fa5-8cc6-623f6436b48c None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:04.932734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49aa4f-6622-4fa5-8cc6-623f6436b48c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:04.943040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49aa4f-6622-4fa5-8cc6-623f6436b48c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:04.944452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49aa4f-6622-4fa5-8cc6-623f6436b48c None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-3e49aa4f-6622-4fa5-8cc6-623f6436b48c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 06:15:04.963245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:15:04.964446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 06:15:04.965560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 06:15:04.965560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 06:15:04.965560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:15:04.965560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 633/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:15:04.970303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5115b-c773-4280-a9e1-1b9f82417ff2 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:05.065916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5115b-c773-4280-a9e1-1b9f82417ff2 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:05.098321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e5342-9bae-4be2-afcc-1fcfce32eb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:05.098903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e5342-9bae-4be2-afcc-1fcfce32eb05 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:05.099176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e5342-9bae-4be2-afcc-1fcfce32eb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:05.099443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e5342-9bae-4be2-afcc-1fcfce32eb05 None admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:05.100091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e5342-9bae-4be2-afcc-1fcfce32eb05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:05.100386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e5342-9bae-4be2-afcc-1fcfce32eb05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:05.101739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e5342-9bae-4be2-afcc-1fcfce32eb05 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:05.113153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 651/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Sun Sep 18 06:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:15:05.118766 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49aa4f-6622-4fa5-8cc6-623f6436b48c None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:05.215450 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49aa4f-6622-4fa5-8cc6-623f6436b48c None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:05.229139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:05.250341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b2a8-649e-4f7b-8d08-11ac1fb5b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:05.251006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b2a8-649e-4f7b-8d08-11ac1fb5b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:05.251423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b2a8-649e-4f7b-8d08-11ac1fb5b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:05.251701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b2a8-649e-4f7b-8d08-11ac1fb5b0a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:05.258138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36b2a8-649e-4f7b-8d08-11ac1fb5b0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:05.259566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36b2a8-649e-4f7b-8d08-11ac1fb5b0a5 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application [None req-7b36b2a8-649e-4f7b-8d08-11ac1fb5b0a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 06:15:05.270686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application with Lock( Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:15:05.271709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:15:05.272973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 06:15:05.272973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 06:15:05.272973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 06:15:05.272973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 06:15:05.272973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 06:15:05.272973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 06:15:05.272973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 06:15:05.272973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: ERROR keystone.server.flask.application Sep 18 06:15:05.272973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 634/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Sun Sep 18 06:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:15:05.277667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e5342-9bae-4be2-afcc-1fcfce32eb05 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:05.326177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:05.375398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e5342-9bae-4be2-afcc-1fcfce32eb05 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:05.407608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1059498-9cb1-4280-bc42-a758f2e04d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:05.408225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1059498-9cb1-4280-bc42-a758f2e04d71 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:05.408504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1059498-9cb1-4280-bc42-a758f2e04d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:05.408773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1059498-9cb1-4280-bc42-a758f2e04d71 None admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:05.409445 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1059498-9cb1-4280-bc42-a758f2e04d71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:05.409745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1059498-9cb1-4280-bc42-a758f2e04d71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:05.411155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1059498-9cb1-4280-bc42-a758f2e04d71 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:05.423276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 652/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Sun Sep 18 06:15:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:15:05.429376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b2a8-649e-4f7b-8d08-11ac1fb5b0a5 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:05.526308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b2a8-649e-4f7b-8d08-11ac1fb5b0a5 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:05.561182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885fa5-1280-489f-abf3-b1b8ba441305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:05.561745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885fa5-1280-489f-abf3-b1b8ba441305 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:05.562018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885fa5-1280-489f-abf3-b1b8ba441305 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:05.562287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885fa5-1280-489f-abf3-b1b8ba441305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:05.562986 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c885fa5-1280-489f-abf3-b1b8ba441305 None admin] RBAC: Adding query filter params (role.id=4494ba66c3f649febc69511a47e27b67, scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d, user.id=320a1c60b5b6461c8e2e2b6ec74ce78d) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:05.563294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c885fa5-1280-489f-abf3-b1b8ba441305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:05.564725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c885fa5-1280-489f-abf3-b1b8ba441305 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:05.570219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 635/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Sun Sep 18 06:15:05 2022] GET /identity/v3/role_assignments?user.id=320a1c60b5b6461c8e2e2b6ec74ce78d&scope.project.id=b23310cf87d443fa8ff3dab6c84ad33d&role.id=4494ba66c3f649febc69511a47e27b67 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:15:07.708115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774acbb3-e2a9-4a60-b962-b25bc9242c93 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:07.708646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774acbb3-e2a9-4a60-b962-b25bc9242c93 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:07.708646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774acbb3-e2a9-4a60-b962-b25bc9242c93 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:07.709965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 653/1288] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:15:07.715266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37272371-2b5a-42a5-ad0b-f806cceb8a93 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:07.715660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37272371-2b5a-42a5-ad0b-f806cceb8a93 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:07.715779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37272371-2b5a-42a5-ad0b-f806cceb8a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:07.733673 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-37272371-2b5a-42a5-ad0b-f806cceb8a93 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:15:07.735356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-37272371-2b5a-42a5-ad0b-f806cceb8a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:15:07.764226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:07.800604 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 636/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:15:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:15:08.062196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774acbb3-e2a9-4a60-b962-b25bc9242c93 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:08.161398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774acbb3-e2a9-4a60-b962-b25bc9242c93 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:08.171464 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:08.194283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a7f87-7bff-4b7b-9bd6-6937140c3719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:08.194895 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a7f87-7bff-4b7b-9bd6-6937140c3719 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:08.195169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a7f87-7bff-4b7b-9bd6-6937140c3719 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:08.195434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a7f87-7bff-4b7b-9bd6-6937140c3719 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:08.196028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a7f87-7bff-4b7b-9bd6-6937140c3719 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:08.197392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a7f87-7bff-4b7b-9bd6-6937140c3719 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-8c1a7f87-7bff-4b7b-9bd6-6937140c3719 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:15:08.206612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:15:08.207994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:08.208991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 654/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 18 06:15:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:15:08.213672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37272371-2b5a-42a5-ad0b-f806cceb8a93 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:08.308014 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37272371-2b5a-42a5-ad0b-f806cceb8a93 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:08.341172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4918d7-4ba0-4ac1-b161-4f254e263837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:08.341702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4918d7-4ba0-4ac1-b161-4f254e263837 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:08.341978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4918d7-4ba0-4ac1-b161-4f254e263837 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:08.342249 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4918d7-4ba0-4ac1-b161-4f254e263837 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:08.342859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4918d7-4ba0-4ac1-b161-4f254e263837 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:08.343158 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4918d7-4ba0-4ac1-b161-4f254e263837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:08.344573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4918d7-4ba0-4ac1-b161-4f254e263837 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:08.349194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 637/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 18 06:15:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:15:08.354828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a7f87-7bff-4b7b-9bd6-6937140c3719 None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:08.450927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a7f87-7bff-4b7b-9bd6-6937140c3719 None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:08.484229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6337d-4867-45ad-8b09-8d902668500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:08.484910 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6337d-4867-45ad-8b09-8d902668500e None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:08.485414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6337d-4867-45ad-8b09-8d902668500e None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:08.485874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6337d-4867-45ad-8b09-8d902668500e None admin] PATH_INFO: `/v3/services` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:08.486673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6337d-4867-45ad-8b09-8d902668500e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:08.486973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6337d-4867-45ad-8b09-8d902668500e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:08.488356 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6337d-4867-45ad-8b09-8d902668500e None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:08.492619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 655/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 18 06:15:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:15:10.619264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7e646-881a-43f5-9fd4-5dc78982bb7a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:10.619834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7e646-881a-43f5-9fd4-5dc78982bb7a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:10.619834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7e646-881a-43f5-9fd4-5dc78982bb7a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:10.621285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 638/1293] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:15:10.626920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b22204-f25e-44b1-abcd-7c95c4602098 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:10.627316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b22204-f25e-44b1-abcd-7c95c4602098 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:10.627458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b22204-f25e-44b1-abcd-7c95c4602098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:10.645090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c4b22204-f25e-44b1-abcd-7c95c4602098 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:15:10.646272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c4b22204-f25e-44b1-abcd-7c95c4602098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:15:10.675515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:10.712590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 656/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:15:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:15:10.982162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7e646-881a-43f5-9fd4-5dc78982bb7a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:11.013139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:11.082895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7e646-881a-43f5-9fd4-5dc78982bb7a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:11.115137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4553b9-df1d-4ef0-9a64-93c55044e9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:11.115725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4553b9-df1d-4ef0-9a64-93c55044e9e3 None admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:11.116028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4553b9-df1d-4ef0-9a64-93c55044e9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:11.116298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4553b9-df1d-4ef0-9a64-93c55044e9e3 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:11.116926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4553b9-df1d-4ef0-9a64-93c55044e9e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:11.118259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4553b9-df1d-4ef0-9a64-93c55044e9e3 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:11.133368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 639/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Sun Sep 18 06:15:10 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:15:13.296707 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c7035-feaa-4da1-a30b-a33e0f5eb57c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:13.297860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c7035-feaa-4da1-a30b-a33e0f5eb57c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:13.297860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c7035-feaa-4da1-a30b-a33e0f5eb57c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:13.299103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 657/1296] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:15:13.304402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98a24-e82c-4897-b3d9-6a99cb8cd561 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:13.304847 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98a24-e82c-4897-b3d9-6a99cb8cd561 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:13.304941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98a24-e82c-4897-b3d9-6a99cb8cd561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:13.323395 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-69d98a24-e82c-4897-b3d9-6a99cb8cd561 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:15:13.324620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-69d98a24-e82c-4897-b3d9-6a99cb8cd561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:15:13.394124 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 640/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:15:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:15:13.671639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c7035-feaa-4da1-a30b-a33e0f5eb57c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:13.769874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c7035-feaa-4da1-a30b-a33e0f5eb57c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:13.802169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc03b2-17a9-400d-8ec9-3afce4f6a19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:13.802776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc03b2-17a9-400d-8ec9-3afce4f6a19b None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:13.803051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc03b2-17a9-400d-8ec9-3afce4f6a19b None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:13.803319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc03b2-17a9-400d-8ec9-3afce4f6a19b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:13.803881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc03b2-17a9-400d-8ec9-3afce4f6a19b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:13.805263 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc03b2-17a9-400d-8ec9-3afce4f6a19b None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-37cc03b2-17a9-400d-8ec9-3afce4f6a19b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:15:13.813687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:15:13.814977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:13.816235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 658/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 18 06:15:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:15:13.820712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98a24-e82c-4897-b3d9-6a99cb8cd561 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:13.839256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:13.918837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98a24-e82c-4897-b3d9-6a99cb8cd561 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:13.950758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe73ae-a73a-45a0-8fa9-5cee7fb18468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:13.951287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe73ae-a73a-45a0-8fa9-5cee7fb18468 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:13.951561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe73ae-a73a-45a0-8fa9-5cee7fb18468 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:13.951830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe73ae-a73a-45a0-8fa9-5cee7fb18468 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:13.952468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe73ae-a73a-45a0-8fa9-5cee7fb18468 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:13.952765 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe73ae-a73a-45a0-8fa9-5cee7fb18468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:13.954651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe73ae-a73a-45a0-8fa9-5cee7fb18468 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:13.959556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 641/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 18 06:15:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:15:13.965455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc03b2-17a9-400d-8ec9-3afce4f6a19b None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:13.996140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:14.063103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc03b2-17a9-400d-8ec9-3afce4f6a19b None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:14.095823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d8f6f-9393-43c1-a1b7-75865a72b6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:14.096428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8f6f-9393-43c1-a1b7-75865a72b6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:14.096704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8f6f-9393-43c1-a1b7-75865a72b6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:14.096975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8f6f-9393-43c1-a1b7-75865a72b6e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:14.097653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d8f6f-9393-43c1-a1b7-75865a72b6e5 None admin] RBAC: Adding query filter params (interface=public, service_id=6fade0bd70b64be19c0139c6cf825ff3, region_id=RegionOne) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:14.097954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d8f6f-9393-43c1-a1b7-75865a72b6e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:14.099303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d8f6f-9393-43c1-a1b7-75865a72b6e5 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:14.104119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 659/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Sun Sep 18 06:15:13 2022] GET /identity/v3/endpoints?service_id=6fade0bd70b64be19c0139c6cf825ff3&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:15:14.109821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe73ae-a73a-45a0-8fa9-5cee7fb18468 None admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:14.187323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:14.206348 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe73ae-a73a-45a0-8fa9-5cee7fb18468 None admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:14.237845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd683012-0984-46f0-932e-8ca99cdcb8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:14.238429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd683012-0984-46f0-932e-8ca99cdcb8ff None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:14.238702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd683012-0984-46f0-932e-8ca99cdcb8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:14.238971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd683012-0984-46f0-932e-8ca99cdcb8ff None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:14.239561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd683012-0984-46f0-932e-8ca99cdcb8ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:14.240928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd683012-0984-46f0-932e-8ca99cdcb8ff None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:14.247437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 642/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Sun Sep 18 06:15:14 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:15:16.387823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b93a-985b-4847-a6c1-cfe14a25667a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:16.388382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b93a-985b-4847-a6c1-cfe14a25667a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:16.388382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b93a-985b-4847-a6c1-cfe14a25667a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:16.389741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 660/1302] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:15:16.395250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c949-b97b-4225-a80a-c0a69d28813c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:16.395772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c949-b97b-4225-a80a-c0a69d28813c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:16.395772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c949-b97b-4225-a80a-c0a69d28813c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:16.414098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a2f8c949-b97b-4225-a80a-c0a69d28813c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:15:16.415283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a2f8c949-b97b-4225-a80a-c0a69d28813c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:15:16.479617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 643/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:15:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 06:15:16.750441 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6b93a-985b-4847-a6c1-cfe14a25667a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:16.844230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:16.851109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6b93a-985b-4847-a6c1-cfe14a25667a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:16.883436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b408eb-c172-4f73-a7d2-8218ac3ba64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:16.884080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b408eb-c172-4f73-a7d2-8218ac3ba64f None admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:16.884357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b408eb-c172-4f73-a7d2-8218ac3ba64f None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:16.884624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b408eb-c172-4f73-a7d2-8218ac3ba64f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:16.885188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b408eb-c172-4f73-a7d2-8218ac3ba64f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:16.886547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b408eb-c172-4f73-a7d2-8218ac3ba64f None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application [None req-82b408eb-c172-4f73-a7d2-8218ac3ba64f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 06:15:16.895564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 06:15:16.896757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application with Lock( Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self._enter() Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application return self.creator() Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application created_value = creator( Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: ERROR keystone.server.flask.application Sep 18 06:15:16.897619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 661/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Sun Sep 18 06:15:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 06:15:16.902759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c949-b97b-4225-a80a-c0a69d28813c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:16.976967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:16.999840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c949-b97b-4225-a80a-c0a69d28813c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:17.033588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2ee2e-6836-49e6-8190-04d01fb92c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:17.034123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2ee2e-6836-49e6-8190-04d01fb92c20 None admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:17.034403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2ee2e-6836-49e6-8190-04d01fb92c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:17.034680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2ee2e-6836-49e6-8190-04d01fb92c20 None admin] PATH_INFO: `/v3/services` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:17.035301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2ee2e-6836-49e6-8190-04d01fb92c20 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:15:17.035602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2ee2e-6836-49e6-8190-04d01fb92c20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:17.036993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2ee2e-6836-49e6-8190-04d01fb92c20 None admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:17.041937 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 644/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Sun Sep 18 06:15:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:15:17.047821 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b408eb-c172-4f73-a7d2-8218ac3ba64f None admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:15:17.145179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b408eb-c172-4f73-a7d2-8218ac3ba64f None admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:15:17.176977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12112998-9657-45fe-9452-fd2a80b437f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:15:17.177563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12112998-9657-45fe-9452-fd2a80b437f7 None admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:15:17.177842 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12112998-9657-45fe-9452-fd2a80b437f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:15:17.178116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12112998-9657-45fe-9452-fd2a80b437f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:15:17.178759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12112998-9657-45fe-9452-fd2a80b437f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:15:17.180145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12112998-9657-45fe-9452-fd2a80b437f7 None admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:15:17.199277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 662/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:15:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:15:27.039060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=30 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:15:27.195526 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:21.033042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9955565-f51a-47cf-9b07-b27cfc24e124 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:21.033519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9955565-f51a-47cf-9b07-b27cfc24e124 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:21.033745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9955565-f51a-47cf-9b07-b27cfc24e124 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:21.035262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 645/1307] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:21.040519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e502f44-54b3-4c4c-92ac-b9c9d7cda725 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:21.040999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e502f44-54b3-4c4c-92ac-b9c9d7cda725 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:21.041082 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e502f44-54b3-4c4c-92ac-b9c9d7cda725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:21.176218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-3e502f44-54b3-4c4c-92ac-b9c9d7cda725 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:21.177748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3e502f44-54b3-4c4c-92ac-b9c9d7cda725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:21.286429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 663/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:16:21.586337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c1360-d204-4dc8-9dc9-011fe50bc173 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:21.586678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c1360-d204-4dc8-9dc9-011fe50bc173 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:21.586878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c1360-d204-4dc8-9dc9-011fe50bc173 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:21.588396 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 646/1309] 10.222.0.16 () {54 vars in 963 bytes} [Sun Sep 18 06:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:21.594976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c846d-6e6a-4c6e-8f60-eae5b7e5fe17 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:21.595338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c846d-6e6a-4c6e-8f60-eae5b7e5fe17 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:21.595680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c846d-6e6a-4c6e-8f60-eae5b7e5fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:21.684388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-dc2c846d-6e6a-4c6e-8f60-eae5b7e5fe17 None None] MFA Rules not processed for user `1d78e909fc894ddd9b35ead5fe68b898`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:21.685832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dc2c846d-6e6a-4c6e-8f60-eae5b7e5fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:21.710383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:21.788738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 664/1310] 10.222.0.16 () {58 vars in 1060 bytes} [Sun Sep 18 06:16:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:16:21.798600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c1360-d204-4dc8-9dc9-011fe50bc173 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:21.800365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-696c1360-d204-4dc8-9dc9-011fe50bc173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:21.922177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c1360-d204-4dc8-9dc9-011fe50bc173 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:22.003214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43f4ec-20fd-47b5-b7a0-92433bf20851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:22.003841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43f4ec-20fd-47b5-b7a0-92433bf20851 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:22.004146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43f4ec-20fd-47b5-b7a0-92433bf20851 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:22.004419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43f4ec-20fd-47b5-b7a0-92433bf20851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:22.006029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fd43f4ec-20fd-47b5-b7a0-92433bf20851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:22.064282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:22.129403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43f4ec-20fd-47b5-b7a0-92433bf20851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:22.130780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43f4ec-20fd-47b5-b7a0-92433bf20851 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:22.154864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 647/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:16:24.612152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3efffd-b569-4553-910a-8eaa1bd9de3c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:24.612684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3efffd-b569-4553-910a-8eaa1bd9de3c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:24.612684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3efffd-b569-4553-910a-8eaa1bd9de3c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:24.614191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 665/1312] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:24.619235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1641-7838-4e6d-a854-7e6fa7cef12b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:24.619706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1641-7838-4e6d-a854-7e6fa7cef12b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:24.619967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1641-7838-4e6d-a854-7e6fa7cef12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:24.701851 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cc1e1641-7838-4e6d-a854-7e6fa7cef12b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:24.703072 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cc1e1641-7838-4e6d-a854-7e6fa7cef12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:24.803875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 648/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:16:25.087854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3efffd-b569-4553-910a-8eaa1bd9de3c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:25.090326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cb3efffd-b569-4553-910a-8eaa1bd9de3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:25.194823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3efffd-b569-4553-910a-8eaa1bd9de3c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:25.269909 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:25.272580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a485d-cd29-4562-a78b-1d6a1a459db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:25.273373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a485d-cd29-4562-a78b-1d6a1a459db1 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:25.273834 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a485d-cd29-4562-a78b-1d6a1a459db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:25.274288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a485d-cd29-4562-a78b-1d6a1a459db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:25.275976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-965a485d-cd29-4562-a78b-1d6a1a459db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:25.384815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a485d-cd29-4562-a78b-1d6a1a459db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:25.386832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a485d-cd29-4562-a78b-1d6a1a459db1 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:25.405236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 666/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:16:27.848569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ce541-7c2b-4b99-821c-7aa8656cea8f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:27.849031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ce541-7c2b-4b99-821c-7aa8656cea8f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:27.849147 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ce541-7c2b-4b99-821c-7aa8656cea8f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:27.850459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 649/1315] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:27.856286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3b0d6-4bca-47ce-b554-f0ac2b0c708c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:27.856709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3b0d6-4bca-47ce-b554-f0ac2b0c708c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:27.856842 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3b0d6-4bca-47ce-b554-f0ac2b0c708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:27.922623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9af3b0d6-4bca-47ce-b554-f0ac2b0c708c None None] MFA Rules not processed for user `157f75ac057d4058925eb8b5162a75ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:27.923820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9af3b0d6-4bca-47ce-b554-f0ac2b0c708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:27.974320 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:28.018864 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 667/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:16:28.305834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ce541-7c2b-4b99-821c-7aa8656cea8f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:28.308198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-720ce541-7c2b-4b99-821c-7aa8656cea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:28.317792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:28.411249 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ce541-7c2b-4b99-821c-7aa8656cea8f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:28.484211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871f8a-9c69-4928-9126-947cd4d03256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:28.484809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871f8a-9c69-4928-9126-947cd4d03256 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:28.485086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871f8a-9c69-4928-9126-947cd4d03256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:28.485357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871f8a-9c69-4928-9126-947cd4d03256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:28.486953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2d871f8a-9c69-4928-9126-947cd4d03256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:28.549077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:28.594962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871f8a-9c69-4928-9126-947cd4d03256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:28.596359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871f8a-9c69-4928-9126-947cd4d03256 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:28.615102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 650/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:28 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:16:31.323365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba818-1612-4b1e-9ca4-b8451b65d359 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:31.323973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba818-1612-4b1e-9ca4-b8451b65d359 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:31.323973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba818-1612-4b1e-9ca4-b8451b65d359 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:31.325274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 668/1318] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:31.330567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edccde5-c67a-4573-bd6e-a4b1886db86d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:31.330946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edccde5-c67a-4573-bd6e-a4b1886db86d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:31.331107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edccde5-c67a-4573-bd6e-a4b1886db86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:31.396425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6edccde5-c67a-4573-bd6e-a4b1886db86d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:31.397634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6edccde5-c67a-4573-bd6e-a4b1886db86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:31.496133 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 651/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:16:31.786621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ba818-1612-4b1e-9ca4-b8451b65d359 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:31.788191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-302ba818-1612-4b1e-9ca4-b8451b65d359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:31.892253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ba818-1612-4b1e-9ca4-b8451b65d359 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:31.964910 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688eb45e-3811-4882-9fe5-d709d0236cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:31.965505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb45e-3811-4882-9fe5-d709d0236cdb service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:31.965783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb45e-3811-4882-9fe5-d709d0236cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:31.966055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688eb45e-3811-4882-9fe5-d709d0236cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:31.967638 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-688eb45e-3811-4882-9fe5-d709d0236cdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:31.974346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:32.073193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eb45e-3811-4882-9fe5-d709d0236cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:32.074630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688eb45e-3811-4882-9fe5-d709d0236cdb service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:32.091973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 669/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:16:34.894199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d14eb-77e5-46c7-8e3c-36a5b3f2f51d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:34.894736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d14eb-77e5-46c7-8e3c-36a5b3f2f51d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:34.894736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d14eb-77e5-46c7-8e3c-36a5b3f2f51d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:34.896123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 652/1321] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:34.902232 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f02d7-6298-4134-8f0b-17a837774ee5 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:34.902677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f02d7-6298-4134-8f0b-17a837774ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:34.902769 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f02d7-6298-4134-8f0b-17a837774ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:34.975422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-572f02d7-6298-4134-8f0b-17a837774ee5 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:34.976729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-572f02d7-6298-4134-8f0b-17a837774ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:35.038880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:35.080930 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 670/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:16:35.382039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b54cf1-0527-4cc2-a5be-f18e9757b6ae None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:35.382313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b54cf1-0527-4cc2-a5be-f18e9757b6ae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:35.382579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b54cf1-0527-4cc2-a5be-f18e9757b6ae None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:35.383930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 653/1323] 10.222.0.16 () {54 vars in 963 bytes} [Sun Sep 18 06:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:35.390621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d219-36c1-4662-86d1-7f5f8c17aa2f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:35.391015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d219-36c1-4662-86d1-7f5f8c17aa2f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:35.391365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d219-36c1-4662-86d1-7f5f8c17aa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:35.468299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5889d219-36c1-4662-86d1-7f5f8c17aa2f None None] MFA Rules not processed for user `1d78e909fc894ddd9b35ead5fe68b898`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:35.469514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5889d219-36c1-4662-86d1-7f5f8c17aa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:35.546974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 671/1324] 10.222.0.16 () {58 vars in 1060 bytes} [Sun Sep 18 06:16:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:16:35.556419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b54cf1-0527-4cc2-a5be-f18e9757b6ae None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:35.558231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-94b54cf1-0527-4cc2-a5be-f18e9757b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:35.578362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:35.664346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b54cf1-0527-4cc2-a5be-f18e9757b6ae None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:35.738486 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57dd4ab-2aa3-48cb-ab27-05b5be1e5481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:35.739105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dd4ab-2aa3-48cb-ab27-05b5be1e5481 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:35.739378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dd4ab-2aa3-48cb-ab27-05b5be1e5481 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:35.740073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dd4ab-2aa3-48cb-ab27-05b5be1e5481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:35.741518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e57dd4ab-2aa3-48cb-ab27-05b5be1e5481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:35.812120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:35.852571 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57dd4ab-2aa3-48cb-ab27-05b5be1e5481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:35.854093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57dd4ab-2aa3-48cb-ab27-05b5be1e5481 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:35.872295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 654/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:16:38.356130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def3e43-e944-4e8f-9dbe-dcd0ca4ff2af None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:38.356642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def3e43-e944-4e8f-9dbe-dcd0ca4ff2af None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:38.356642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def3e43-e944-4e8f-9dbe-dcd0ca4ff2af None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:38.357894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 672/1326] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:38.363165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a8d08-f06c-4d0a-b637-2838fdceaf74 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:38.363607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a8d08-f06c-4d0a-b637-2838fdceaf74 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:38.363701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a8d08-f06c-4d0a-b637-2838fdceaf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:38.431309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-128a8d08-f06c-4d0a-b637-2838fdceaf74 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:38.433205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-128a8d08-f06c-4d0a-b637-2838fdceaf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:38.531882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 655/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:16:38.814658 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def3e43-e944-4e8f-9dbe-dcd0ca4ff2af None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:38.816333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9def3e43-e944-4e8f-9dbe-dcd0ca4ff2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:38.879217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:38.923024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def3e43-e944-4e8f-9dbe-dcd0ca4ff2af None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:38.997019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388829f-4499-4791-b057-789fb7b8a546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:38.997904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388829f-4499-4791-b057-789fb7b8a546 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:38.998179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388829f-4499-4791-b057-789fb7b8a546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:38.998451 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388829f-4499-4791-b057-789fb7b8a546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:39.000116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6388829f-4499-4791-b057-789fb7b8a546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:39.106905 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:39.109470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388829f-4499-4791-b057-789fb7b8a546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:39.111477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388829f-4499-4791-b057-789fb7b8a546 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:39.130108 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 673/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:16:41.360143 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d4b2b-4a7d-4d64-9db1-a5977dbbc321 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:41.360675 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d4b2b-4a7d-4d64-9db1-a5977dbbc321 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:41.360675 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d4b2b-4a7d-4d64-9db1-a5977dbbc321 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:41.362062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 656/1329] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:41.367618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897106-93a0-4930-9bbf-4148a11d72d0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:41.368085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897106-93a0-4930-9bbf-4148a11d72d0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:41.368172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897106-93a0-4930-9bbf-4148a11d72d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:41.439154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-35897106-93a0-4930-9bbf-4148a11d72d0 None None] MFA Rules not processed for user `157f75ac057d4058925eb8b5162a75ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:41.440453 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-35897106-93a0-4930-9bbf-4148a11d72d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:41.537994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 674/1330] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:16:41.820276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d4b2b-4a7d-4d64-9db1-a5977dbbc321 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:41.822421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e55d4b2b-4a7d-4d64-9db1-a5977dbbc321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:41.854977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:41.932130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d4b2b-4a7d-4d64-9db1-a5977dbbc321 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:42.004717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087e80-d3c9-478d-a58a-82a8e83d64d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:42.005316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087e80-d3c9-478d-a58a-82a8e83d64d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:42.005586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087e80-d3c9-478d-a58a-82a8e83d64d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:42.005853 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087e80-d3c9-478d-a58a-82a8e83d64d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:42.007435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f5087e80-d3c9-478d-a58a-82a8e83d64d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:42.094781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:42.132881 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5087e80-d3c9-478d-a58a-82a8e83d64d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:42.134480 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5087e80-d3c9-478d-a58a-82a8e83d64d2 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:42.158149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 657/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:16:44.570758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65039839-eafd-4778-8387-0c1299a33f03 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:44.571285 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65039839-eafd-4778-8387-0c1299a33f03 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:44.571285 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65039839-eafd-4778-8387-0c1299a33f03 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:44.572933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 675/1332] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:44.578187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379323fa-bd78-49b2-b9b7-c49890263e7e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:44.578604 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379323fa-bd78-49b2-b9b7-c49890263e7e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:44.578735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379323fa-bd78-49b2-b9b7-c49890263e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:44.644505 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-379323fa-bd78-49b2-b9b7-c49890263e7e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:44.645698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-379323fa-bd78-49b2-b9b7-c49890263e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:44.740456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 658/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:16:45.022908 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65039839-eafd-4778-8387-0c1299a33f03 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:45.024463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-65039839-eafd-4778-8387-0c1299a33f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:45.092219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:45.125447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65039839-eafd-4778-8387-0c1299a33f03 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:45.196445 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0f210-732c-45d0-9fd2-9198ddac667b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:45.197557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0f210-732c-45d0-9fd2-9198ddac667b service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:45.197825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0f210-732c-45d0-9fd2-9198ddac667b service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:45.198092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0f210-732c-45d0-9fd2-9198ddac667b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:45.199657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2fd0f210-732c-45d0-9fd2-9198ddac667b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:45.306620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0f210-732c-45d0-9fd2-9198ddac667b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:45.308043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0f210-732c-45d0-9fd2-9198ddac667b service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:45.318487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:45.330700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 676/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:16:47.550777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb94531-7a60-4dac-a048-daa053fd4078 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:47.551340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb94531-7a60-4dac-a048-daa053fd4078 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:47.551340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb94531-7a60-4dac-a048-daa053fd4078 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:47.552688 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 659/1335] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:47.558063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13467183-2cae-42b3-a3cd-679cc4a56da8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:47.558456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13467183-2cae-42b3-a3cd-679cc4a56da8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:47.558602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13467183-2cae-42b3-a3cd-679cc4a56da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:47.623692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-13467183-2cae-42b3-a3cd-679cc4a56da8 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:47.624926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-13467183-2cae-42b3-a3cd-679cc4a56da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:47.724229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 677/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:16:48.012725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb94531-7a60-4dac-a048-daa053fd4078 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:48.014278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6fb94531-7a60-4dac-a048-daa053fd4078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:48.053514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:48.116757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb94531-7a60-4dac-a048-daa053fd4078 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:48.190700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0007da-252d-420d-a60d-7a4d9277832f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:48.191288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0007da-252d-420d-a60d-7a4d9277832f service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:48.191559 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0007da-252d-420d-a60d-7a4d9277832f service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:48.191826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0007da-252d-420d-a60d-7a4d9277832f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:48.193431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dd0007da-252d-420d-a60d-7a4d9277832f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:48.273822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:48.299290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0007da-252d-420d-a60d-7a4d9277832f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:48.300743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0007da-252d-420d-a60d-7a4d9277832f service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:48.319090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 660/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:16:50.795520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45af7d-e96b-4f56-ba79-61b0e8949b05 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:50.796102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45af7d-e96b-4f56-ba79-61b0e8949b05 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:50.796102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45af7d-e96b-4f56-ba79-61b0e8949b05 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:50.797434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 678/1338] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:50.802452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dbd41-73da-4a14-a6e4-29934d55db37 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:50.802871 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dbd41-73da-4a14-a6e4-29934d55db37 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:50.802994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dbd41-73da-4a14-a6e4-29934d55db37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:50.868790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e16dbd41-73da-4a14-a6e4-29934d55db37 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:50.869997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e16dbd41-73da-4a14-a6e4-29934d55db37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:50.966912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 661/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:16:51.248755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45af7d-e96b-4f56-ba79-61b0e8949b05 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:51.250297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3c45af7d-e96b-4f56-ba79-61b0e8949b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:51.325492 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:51.355187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45af7d-e96b-4f56-ba79-61b0e8949b05 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:51.433491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed56ee-e95a-4bc5-afb1-c02169259942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:51.434096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed56ee-e95a-4bc5-afb1-c02169259942 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:51.434370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed56ee-e95a-4bc5-afb1-c02169259942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:51.434635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed56ee-e95a-4bc5-afb1-c02169259942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:51.436464 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ffed56ee-e95a-4bc5-afb1-c02169259942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:51.542754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed56ee-e95a-4bc5-afb1-c02169259942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:51.544209 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed56ee-e95a-4bc5-afb1-c02169259942 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:51.563028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 679/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:16:55.597818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cd09d-9cbb-46f7-8556-0e7818abd08e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:55.598348 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cd09d-9cbb-46f7-8556-0e7818abd08e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:55.598348 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cd09d-9cbb-46f7-8556-0e7818abd08e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:55.599854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 662/1341] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:55.605251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f523-48ae-48d1-be64-056d7f49ee02 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:55.605689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f523-48ae-48d1-be64-056d7f49ee02 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:55.605784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f523-48ae-48d1-be64-056d7f49ee02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:55.611200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:55.676706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-dc24f523-48ae-48d1-be64-056d7f49ee02 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:55.677959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dc24f523-48ae-48d1-be64-056d7f49ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:55.784214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 680/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:16:56.073919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cd09d-9cbb-46f7-8556-0e7818abd08e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:56.075454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9b3cd09d-9cbb-46f7-8556-0e7818abd08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:56.124451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:56.179965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cd09d-9cbb-46f7-8556-0e7818abd08e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:56.254478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79df8ff-ec6a-4b80-bbbe-1005f366df72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:56.255077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79df8ff-ec6a-4b80-bbbe-1005f366df72 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:56.255353 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79df8ff-ec6a-4b80-bbbe-1005f366df72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:56.255621 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79df8ff-ec6a-4b80-bbbe-1005f366df72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:56.257244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e79df8ff-ec6a-4b80-bbbe-1005f366df72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:56.350667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:56.367221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79df8ff-ec6a-4b80-bbbe-1005f366df72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:56.369412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79df8ff-ec6a-4b80-bbbe-1005f366df72 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:56.388024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 663/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:16:59.202998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7138db9-de7c-481b-b53a-493b59332012 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:59.203524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7138db9-de7c-481b-b53a-493b59332012 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:59.203524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7138db9-de7c-481b-b53a-493b59332012 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:59.204908 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 681/1344] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:16:59.210105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b744-7f40-4995-a124-fbe532ef3178 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:59.210514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b744-7f40-4995-a124-fbe532ef3178 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:59.210651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b744-7f40-4995-a124-fbe532ef3178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:59.276346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5974b744-7f40-4995-a124-fbe532ef3178 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:16:59.277552 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5974b744-7f40-4995-a124-fbe532ef3178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:59.375327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 664/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:16:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:16:59.664057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7138db9-de7c-481b-b53a-493b59332012 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:16:59.666265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a7138db9-de7c-481b-b53a-493b59332012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:59.757553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:16:59.776132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7138db9-de7c-481b-b53a-493b59332012 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:16:59.858991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d579bf-6e06-4973-a39a-0161d14d8129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:16:59.859594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d579bf-6e06-4973-a39a-0161d14d8129 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:16:59.859869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d579bf-6e06-4973-a39a-0161d14d8129 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:16:59.860165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d579bf-6e06-4973-a39a-0161d14d8129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:16:59.861738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b5d579bf-6e06-4973-a39a-0161d14d8129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:16:59.971525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d579bf-6e06-4973-a39a-0161d14d8129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:16:59.972916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d579bf-6e06-4973-a39a-0161d14d8129 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:16:59.991850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 682/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:16:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:17:04.158526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a1d2-3ac7-4b85-baeb-ffe8d75f3ec5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:04.159064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a1d2-3ac7-4b85-baeb-ffe8d75f3ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:04.159064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a1d2-3ac7-4b85-baeb-ffe8d75f3ec5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:04.160590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 665/1347] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:04.165837 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bff57f-9e22-436f-8cac-66640fda16ff None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:04.166278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bff57f-9e22-436f-8cac-66640fda16ff None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:04.166582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bff57f-9e22-436f-8cac-66640fda16ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:04.182958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:04.235873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-62bff57f-9e22-436f-8cac-66640fda16ff None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:04.237131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-62bff57f-9e22-436f-8cac-66640fda16ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:04.332882 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 683/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:04.620126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311a1d2-3ac7-4b85-baeb-ffe8d75f3ec5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:04.621960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2311a1d2-3ac7-4b85-baeb-ffe8d75f3ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:04.681602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:04.727866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311a1d2-3ac7-4b85-baeb-ffe8d75f3ec5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:04.803659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cf9cd-b89e-4cd5-b300-1ba143c1a7f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:04.804189 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cf9cd-b89e-4cd5-b300-1ba143c1a7f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:04.804466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cf9cd-b89e-4cd5-b300-1ba143c1a7f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:04.805287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cf9cd-b89e-4cd5-b300-1ba143c1a7f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:04.806882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9e4cf9cd-b89e-4cd5-b300-1ba143c1a7f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:04.912409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:04.917153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cf9cd-b89e-4cd5-b300-1ba143c1a7f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:04.918579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cf9cd-b89e-4cd5-b300-1ba143c1a7f0 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:04.937406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 666/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:17:09.823371 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e6935-aee2-4d0a-91ea-4055a72eed65 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:09.823823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e6935-aee2-4d0a-91ea-4055a72eed65 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:09.823823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e6935-aee2-4d0a-91ea-4055a72eed65 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:09.827319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 684/1350] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:09.842076 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3422ede-a769-4e48-80c8-304cac16103d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:09.843074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3422ede-a769-4e48-80c8-304cac16103d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:09.843508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3422ede-a769-4e48-80c8-304cac16103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:09.940030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e3422ede-a769-4e48-80c8-304cac16103d None None] MFA Rules not processed for user `320a1c60b5b6461c8e2e2b6ec74ce78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:09.941402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e3422ede-a769-4e48-80c8-304cac16103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:10.111983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 667/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:17:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:14.316903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ec809-7f1e-4cbd-af4b-4b9ebb0fc3e2 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:14.317407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ec809-7f1e-4cbd-af4b-4b9ebb0fc3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:14.317506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ec809-7f1e-4cbd-af4b-4b9ebb0fc3e2 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:14.318948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 685/1352] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:14.324600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdf53b-09e1-445f-b995-252e96aace6d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:14.325074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdf53b-09e1-445f-b995-252e96aace6d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:14.325197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdf53b-09e1-445f-b995-252e96aace6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:14.331233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=59 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:14.384168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:14.407945 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8abdf53b-09e1-445f-b995-252e96aace6d None None] MFA Rules not processed for user `320a1c60b5b6461c8e2e2b6ec74ce78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:14.409153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8abdf53b-09e1-445f-b995-252e96aace6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:14.519555 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 668/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:17:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:15.814842 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516672-3bf4-4bc9-bf49-29449482edfd None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:15.815409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516672-3bf4-4bc9-bf49-29449482edfd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:15.815409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a516672-3bf4-4bc9-bf49-29449482edfd None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:15.816723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 686/1354] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:15.822768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf6c36-0c11-4d66-9a01-4f997ba14f17 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:15.823182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf6c36-0c11-4d66-9a01-4f997ba14f17 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:15.823353 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf6c36-0c11-4d66-9a01-4f997ba14f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:15.902704 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8aaf6c36-0c11-4d66-9a01-4f997ba14f17 None None] MFA Rules not processed for user `320a1c60b5b6461c8e2e2b6ec74ce78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:15.903920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8aaf6c36-0c11-4d66-9a01-4f997ba14f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:15.946607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:16.013172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 669/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:17:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:19.621960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eba97a-5237-4796-b327-28979c8f57b6 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:19.622950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eba97a-5237-4796-b327-28979c8f57b6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:19.623447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eba97a-5237-4796-b327-28979c8f57b6 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:19.625029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 687/1356] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:19.630632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b2d4b-93e0-4396-98df-9d4c01d2b3c1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:19.631130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b2d4b-93e0-4396-98df-9d4c01d2b3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:19.631366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b2d4b-93e0-4396-98df-9d4c01d2b3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:19.701586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c45b2d4b-93e0-4396-98df-9d4c01d2b3c1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:19.702808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c45b2d4b-93e0-4396-98df-9d4c01d2b3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:19.804398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 670/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:20.113140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b4d4-bd7b-416e-bac3-5dc103b601cd None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:20.113589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b4d4-bd7b-416e-bac3-5dc103b601cd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:20.113990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b4d4-bd7b-416e-bac3-5dc103b601cd None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:20.116664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 688/1358] 10.222.0.16 () {54 vars in 965 bytes} [Sun Sep 18 06:17:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:20.123837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40217a9-9e2d-40b3-b500-d832b717356e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:20.124160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40217a9-9e2d-40b3-b500-d832b717356e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:20.124438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40217a9-9e2d-40b3-b500-d832b717356e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:20.152633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:20.231300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b40217a9-9e2d-40b3-b500-d832b717356e None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:20.232693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b40217a9-9e2d-40b3-b500-d832b717356e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:20.381038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 671/1359] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 18 06:17:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:20.389480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74b4d4-bd7b-416e-bac3-5dc103b601cd None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:20.391198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-df74b4d4-bd7b-416e-bac3-5dc103b601cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:20.551317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74b4d4-bd7b-416e-bac3-5dc103b601cd None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:20.631246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:20.676202 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d430-744d-4605-927c-fa32062dbd1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:20.676936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d430-744d-4605-927c-fa32062dbd1a service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:20.677279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d430-744d-4605-927c-fa32062dbd1a service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:20.677618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d430-744d-4605-927c-fa32062dbd1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:20.679577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e550d430-744d-4605-927c-fa32062dbd1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:20.777843 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550d430-744d-4605-927c-fa32062dbd1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:20.779534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550d430-744d-4605-927c-fa32062dbd1a service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:20.799168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 689/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:17:23.187042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4fae5-82bf-4687-9698-0115889091df None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:23.187042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4fae5-82bf-4687-9698-0115889091df None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:23.187042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4fae5-82bf-4687-9698-0115889091df None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:23.188681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 672/1361] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:23.195945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da35c9-c39b-4782-b57b-f3a2b96be85b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:23.196347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da35c9-c39b-4782-b57b-f3a2b96be85b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:23.197129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da35c9-c39b-4782-b57b-f3a2b96be85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:23.270616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-80da35c9-c39b-4782-b57b-f3a2b96be85b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:23.271767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-80da35c9-c39b-4782-b57b-f3a2b96be85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:23.314503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:23.378044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 690/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:23.671708 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4fae5-82bf-4687-9698-0115889091df None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:23.673635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-46d4fae5-82bf-4687-9698-0115889091df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:23.752520 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:23.866583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4fae5-82bf-4687-9698-0115889091df None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:24.001983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928798b4-b571-42a0-9375-37ce2b4bce97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:24.002564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928798b4-b571-42a0-9375-37ce2b4bce97 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:24.002845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928798b4-b571-42a0-9375-37ce2b4bce97 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:24.003118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928798b4-b571-42a0-9375-37ce2b4bce97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:24.004773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-928798b4-b571-42a0-9375-37ce2b4bce97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:24.028249 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:24.097815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928798b4-b571-42a0-9375-37ce2b4bce97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:24.099460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928798b4-b571-42a0-9375-37ce2b4bce97 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:24.119511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 673/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:17:26.639308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac93fc-e45e-42de-95e4-78d395dba708 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:26.639831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac93fc-e45e-42de-95e4-78d395dba708 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:26.639831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac93fc-e45e-42de-95e4-78d395dba708 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:26.641125 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 691/1364] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:26.646597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb15e53-e300-4475-a00d-92d2966dd305 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:26.647593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb15e53-e300-4475-a00d-92d2966dd305 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:26.648165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb15e53-e300-4475-a00d-92d2966dd305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:26.719343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5bb15e53-e300-4475-a00d-92d2966dd305 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:26.720730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5bb15e53-e300-4475-a00d-92d2966dd305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:26.830797 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:26.830925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 674/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:27.128733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d22e-8113-44b6-85ed-8ae3cae1401c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:27.129012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d22e-8113-44b6-85ed-8ae3cae1401c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:27.129288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d22e-8113-44b6-85ed-8ae3cae1401c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:27.130604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 692/1366] 10.222.0.16 () {54 vars in 965 bytes} [Sun Sep 18 06:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:27.136266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38980f-3e38-4d3d-bcff-2bedad97692f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:27.136557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38980f-3e38-4d3d-bcff-2bedad97692f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:27.136837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38980f-3e38-4d3d-bcff-2bedad97692f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:27.224387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ca38980f-3e38-4d3d-bcff-2bedad97692f None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:27.225718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ca38980f-3e38-4d3d-bcff-2bedad97692f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:27.352909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 675/1367] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 18 06:17:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:27.361163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74d22e-8113-44b6-85ed-8ae3cae1401c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:27.362669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-aa74d22e-8113-44b6-85ed-8ae3cae1401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:27.519934 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74d22e-8113-44b6-85ed-8ae3cae1401c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:27.542048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:27.644255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7fe14-3d2e-48ce-a9bf-5dc69b88c2ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:27.644961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7fe14-3d2e-48ce-a9bf-5dc69b88c2ae service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:27.645195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7fe14-3d2e-48ce-a9bf-5dc69b88c2ae service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:27.645385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7fe14-3d2e-48ce-a9bf-5dc69b88c2ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:27.648151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-91c7fe14-3d2e-48ce-a9bf-5dc69b88c2ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:27.749679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7fe14-3d2e-48ce-a9bf-5dc69b88c2ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:27.751343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7fe14-3d2e-48ce-a9bf-5dc69b88c2ae service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:27.771399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 693/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:17:27.805036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefe6eb-8a29-4c0d-8117-f758cf241330 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:27.806057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefe6eb-8a29-4c0d-8117-f758cf241330 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:27.806573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefe6eb-8a29-4c0d-8117-f758cf241330 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:27.808980 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 676/1369] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:27.814091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05307b89-02ad-48f9-9ea4-b24c649df8ce None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:27.814372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05307b89-02ad-48f9-9ea4-b24c649df8ce None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:27.814644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05307b89-02ad-48f9-9ea4-b24c649df8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:27.848089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:27.887835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-05307b89-02ad-48f9-9ea4-b24c649df8ce None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:27.892764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-05307b89-02ad-48f9-9ea4-b24c649df8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:28.015970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 694/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:28.315153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c2faa-364e-4f2d-97c0-70b7c796b76d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:28.315437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c2faa-364e-4f2d-97c0-70b7c796b76d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:28.315714 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c2faa-364e-4f2d-97c0-70b7c796b76d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:28.317185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 677/1371] 10.222.0.16 () {54 vars in 964 bytes} [Sun Sep 18 06:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:28.322351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306503-2c66-437d-bf61-07153d83b588 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:28.322645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306503-2c66-437d-bf61-07153d83b588 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:28.322920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306503-2c66-437d-bf61-07153d83b588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:28.402512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-05306503-2c66-437d-bf61-07153d83b588 None None] MFA Rules not processed for user `1bb483203d3b4210a53a317443206d35`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:28.403725 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-05306503-2c66-437d-bf61-07153d83b588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:28.454400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:28.487917 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 695/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 18 06:17:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:28.495870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c2faa-364e-4f2d-97c0-70b7c796b76d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:28.497434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-938c2faa-364e-4f2d-97c0-70b7c796b76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:28.552284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:28.610315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c2faa-364e-4f2d-97c0-70b7c796b76d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:28.692291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9635e1-58e0-41c5-98fe-3b1b6cfa4845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:28.692902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9635e1-58e0-41c5-98fe-3b1b6cfa4845 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:28.693169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9635e1-58e0-41c5-98fe-3b1b6cfa4845 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:28.694113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9635e1-58e0-41c5-98fe-3b1b6cfa4845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:28.695858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2f9635e1-58e0-41c5-98fe-3b1b6cfa4845 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:28.844661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:28.865790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9635e1-58e0-41c5-98fe-3b1b6cfa4845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:28.867821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9635e1-58e0-41c5-98fe-3b1b6cfa4845 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:28.894173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 678/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:17:30.077396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11d91-e27a-4b5b-967d-85e5a26a0175 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:30.077945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11d91-e27a-4b5b-967d-85e5a26a0175 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:30.077945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11d91-e27a-4b5b-967d-85e5a26a0175 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:30.079288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 696/1374] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:30.085001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a980-0d60-4345-9a75-5557a1687fb4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:30.085461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a980-0d60-4345-9a75-5557a1687fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:30.085582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a980-0d60-4345-9a75-5557a1687fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:30.153948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a9b5a980-0d60-4345-9a75-5557a1687fb4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:30.155178 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a9b5a980-0d60-4345-9a75-5557a1687fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:30.251717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 679/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:30.555704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea11d91-e27a-4b5b-967d-85e5a26a0175 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:30.557276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5ea11d91-e27a-4b5b-967d-85e5a26a0175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:30.707628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea11d91-e27a-4b5b-967d-85e5a26a0175 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:30.761127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:30.835258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f932ce7-a714-40a1-a105-7359de61a7bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:30.835887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f932ce7-a714-40a1-a105-7359de61a7bc service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:30.836191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f932ce7-a714-40a1-a105-7359de61a7bc service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:30.836462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f932ce7-a714-40a1-a105-7359de61a7bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:30.838081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1f932ce7-a714-40a1-a105-7359de61a7bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:30.939244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f932ce7-a714-40a1-a105-7359de61a7bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:30.940877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f932ce7-a714-40a1-a105-7359de61a7bc service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:30.960855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 697/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:17:33.224246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a96c5-694a-46b1-b5a8-9711006db58f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:33.225394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a96c5-694a-46b1-b5a8-9711006db58f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:33.225394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a96c5-694a-46b1-b5a8-9711006db58f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:33.226895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 680/1377] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:33.232536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8663ea8-f772-481c-a4f9-fb6d71499528 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:33.233080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8663ea8-f772-481c-a4f9-fb6d71499528 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:33.233080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8663ea8-f772-481c-a4f9-fb6d71499528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:33.309412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e8663ea8-f772-481c-a4f9-fb6d71499528 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:33.310622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e8663ea8-f772-481c-a4f9-fb6d71499528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:33.318385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:33.420014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 698/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:33.712664 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a96c5-694a-46b1-b5a8-9711006db58f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:33.714198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a41a96c5-694a-46b1-b5a8-9711006db58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:33.780336 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:33.889035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a96c5-694a-46b1-b5a8-9711006db58f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:34.024122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdbe5d-a479-4018-b243-87812157f7cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:34.024846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdbe5d-a479-4018-b243-87812157f7cf service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:34.025201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdbe5d-a479-4018-b243-87812157f7cf service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:34.025601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdbe5d-a479-4018-b243-87812157f7cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:34.027831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-07cdbe5d-a479-4018-b243-87812157f7cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:34.055754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:34.160316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdbe5d-a479-4018-b243-87812157f7cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:34.164088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdbe5d-a479-4018-b243-87812157f7cf service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:34.191264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 681/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:17:36.488445 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b856c1-c405-4f8b-984c-454d4ab9a354 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:36.489088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b856c1-c405-4f8b-984c-454d4ab9a354 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:36.489088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b856c1-c405-4f8b-984c-454d4ab9a354 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:36.492204 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 699/1380] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:36.497627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebf4f5-af8b-42e2-a24b-0d7fb65162b2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:36.498142 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebf4f5-af8b-42e2-a24b-0d7fb65162b2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:36.498271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebf4f5-af8b-42e2-a24b-0d7fb65162b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:36.610169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d4ebf4f5-af8b-42e2-a24b-0d7fb65162b2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:36.611572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d4ebf4f5-af8b-42e2-a24b-0d7fb65162b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:36.720994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:36.728607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 682/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:37.026266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b856c1-c405-4f8b-984c-454d4ab9a354 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:37.027790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-62b856c1-c405-4f8b-984c-454d4ab9a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:37.164212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:37.175171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b856c1-c405-4f8b-984c-454d4ab9a354 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:37.290588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3828b-3c59-4f3f-a621-b314071f74b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:37.291225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3828b-3c59-4f3f-a621-b314071f74b4 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:37.291475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3828b-3c59-4f3f-a621-b314071f74b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:37.291750 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3828b-3c59-4f3f-a621-b314071f74b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:37.293397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a4e3828b-3c59-4f3f-a621-b314071f74b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:37.385357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3828b-3c59-4f3f-a621-b314071f74b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:37.387123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3828b-3c59-4f3f-a621-b314071f74b4 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:37.397774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:37.406641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 700/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:17:39.653639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1127e5b-1ae1-4130-a385-b66ea24472d3 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:39.654301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1127e5b-1ae1-4130-a385-b66ea24472d3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:39.654301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1127e5b-1ae1-4130-a385-b66ea24472d3 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:39.655540 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 683/1383] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:39.661529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c7d59-82ba-4f6f-a3ca-3da137e80b9c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:39.662119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c7d59-82ba-4f6f-a3ca-3da137e80b9c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:39.662274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c7d59-82ba-4f6f-a3ca-3da137e80b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:39.730956 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-266c7d59-82ba-4f6f-a3ca-3da137e80b9c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:39.732188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-266c7d59-82ba-4f6f-a3ca-3da137e80b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:39.832367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 701/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:40.131121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1127e5b-1ae1-4130-a385-b66ea24472d3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:40.132700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e1127e5b-1ae1-4130-a385-b66ea24472d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:40.290311 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1127e5b-1ae1-4130-a385-b66ea24472d3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:40.359924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:40.410433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d584f0-4215-4235-b09a-65d886860ce2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:40.411038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d584f0-4215-4235-b09a-65d886860ce2 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:40.411324 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d584f0-4215-4235-b09a-65d886860ce2 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:40.411784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d584f0-4215-4235-b09a-65d886860ce2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:40.413485 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-57d584f0-4215-4235-b09a-65d886860ce2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:40.510007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d584f0-4215-4235-b09a-65d886860ce2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:40.511629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d584f0-4215-4235-b09a-65d886860ce2 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:40.532151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 684/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:17:42.714558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e026877-e50f-491b-a7f0-b143e773b22f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:42.715122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e026877-e50f-491b-a7f0-b143e773b22f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:42.715122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e026877-e50f-491b-a7f0-b143e773b22f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:42.716484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 702/1386] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:42.722861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524bc88-7bfb-4449-bdb9-a382752b504f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:42.723356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524bc88-7bfb-4449-bdb9-a382752b504f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:42.723510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524bc88-7bfb-4449-bdb9-a382752b504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:42.794113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f524bc88-7bfb-4449-bdb9-a382752b504f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:42.795354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f524bc88-7bfb-4449-bdb9-a382752b504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:42.833856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:42.907178 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 685/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:43.292606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e026877-e50f-491b-a7f0-b143e773b22f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:43.294169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4e026877-e50f-491b-a7f0-b143e773b22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:43.386391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:43.460850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e026877-e50f-491b-a7f0-b143e773b22f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:43.578831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23251258-ba9f-4ac2-a29c-02df33a6c14c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:43.579361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23251258-ba9f-4ac2-a29c-02df33a6c14c service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:43.579640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23251258-ba9f-4ac2-a29c-02df33a6c14c service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:43.579989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23251258-ba9f-4ac2-a29c-02df33a6c14c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:43.581561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-23251258-ba9f-4ac2-a29c-02df33a6c14c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:43.622747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:43.674456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23251258-ba9f-4ac2-a29c-02df33a6c14c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:43.676086 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23251258-ba9f-4ac2-a29c-02df33a6c14c service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:43.695408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 703/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:17:45.652965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505674-57e3-4131-aed0-924d23a5ece3 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:45.653481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505674-57e3-4131-aed0-924d23a5ece3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:45.653678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505674-57e3-4131-aed0-924d23a5ece3 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:45.662647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72035e88-c242-49f4-bd27-e7dfe5ebf2e9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:45.663272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72035e88-c242-49f4-bd27-e7dfe5ebf2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:45.664295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72035e88-c242-49f4-bd27-e7dfe5ebf2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:45.667828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 686/1389] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:45 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:45.765593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-72035e88-c242-49f4-bd27-e7dfe5ebf2e9 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:45.767580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-72035e88-c242-49f4-bd27-e7dfe5ebf2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:45.908755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 704/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:45.914523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354f8b-258a-4370-b063-8884d844f929 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:45.914802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354f8b-258a-4370-b063-8884d844f929 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:45.915075 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354f8b-258a-4370-b063-8884d844f929 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:45.916743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 687/1391] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:45.921832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e7a0-21f8-4ca9-9bac-2bfb321f05d4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:45.922116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e7a0-21f8-4ca9-9bac-2bfb321f05d4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:45.922387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e7a0-21f8-4ca9-9bac-2bfb321f05d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:45.938211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:45.988506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1fa9e7a0-21f8-4ca9-9bac-2bfb321f05d4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:45.990569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1fa9e7a0-21f8-4ca9-9bac-2bfb321f05d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:46.086603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 705/1392] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:46.212045 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe486a82-a49d-4689-a409-58a54a227dde None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:46.212325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe486a82-a49d-4689-a409-58a54a227dde None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:46.212600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe486a82-a49d-4689-a409-58a54a227dde None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:46.213959 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 688/1393] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 18 06:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:46.219233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa530-7f03-4c47-9b02-f358ada2044b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:46.219591 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa530-7f03-4c47-9b02-f358ada2044b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:46.219954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa530-7f03-4c47-9b02-f358ada2044b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:46.300948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-deeaa530-7f03-4c47-9b02-f358ada2044b None None] MFA Rules not processed for user `03c498b5857f42f2ab84423f8f4ea11a`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:46.302944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-deeaa530-7f03-4c47-9b02-f358ada2044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:46.342995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:46.379373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe486a82-a49d-4689-a409-58a54a227dde None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:46.381873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fe486a82-a49d-4689-a409-58a54a227dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:46.387063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 706/1394] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 18 06:17:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:46.396578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaa530-7f03-4c47-9b02-f358ada2044b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:46.404982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaa530-7f03-4c47-9b02-f358ada2044b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:46.480757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cbdc3-9319-4b17-907b-17bec40fb26b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c498b5857f42f2ab84423f8f4ea11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:46.481355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cbdc3-9319-4b17-907b-17bec40fb26b service glance] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:46.481631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cbdc3-9319-4b17-907b-17bec40fb26b service glance] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:46.481902 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cbdc3-9319-4b17-907b-17bec40fb26b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:46.483512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c33cbdc3-9319-4b17-907b-17bec40fb26b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:46.531495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe486a82-a49d-4689-a409-58a54a227dde None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:46.548876 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:46.592334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:46.596955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cbdc3-9319-4b17-907b-17bec40fb26b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:46.598337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cbdc3-9319-4b17-907b-17bec40fb26b service glance] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:46.618651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 707/1395] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:17:46.650933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7bc06-9341-4b36-8635-62f56f8b6acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:46.651529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7bc06-9341-4b36-8635-62f56f8b6acc service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:46.651803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7bc06-9341-4b36-8635-62f56f8b6acc service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:46.652097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7bc06-9341-4b36-8635-62f56f8b6acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:46.653681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1ae7bc06-9341-4b36-8635-62f56f8b6acc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:46.742976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7bc06-9341-4b36-8635-62f56f8b6acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:46.744859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7bc06-9341-4b36-8635-62f56f8b6acc service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:46.763529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 689/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:17:47.375016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75603c-34ab-4ca3-8f0a-a3d1df493ea6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:47.375539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75603c-34ab-4ca3-8f0a-a3d1df493ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:47.375682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75603c-34ab-4ca3-8f0a-a3d1df493ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:47.442628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2f75603c-34ab-4ca3-8f0a-a3d1df493ea6 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:47.444058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2f75603c-34ab-4ca3-8f0a-a3d1df493ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:47.531200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 708/1397] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:17:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:47.579241 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd346787-d895-4e66-ac84-8da831bc0bf0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:47.579616 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd346787-d895-4e66-ac84-8da831bc0bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:47.579889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd346787-d895-4e66-ac84-8da831bc0bf0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:47.581299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 690/1398] 10.222.0.16 () {54 vars in 943 bytes} [Sun Sep 18 06:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:47.589165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b77d4-3bed-416e-a1b5-00274cb73d9d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:47.589508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b77d4-3bed-416e-a1b5-00274cb73d9d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:47.589788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b77d4-3bed-416e-a1b5-00274cb73d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:47.667595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8b4b77d4-3bed-416e-a1b5-00274cb73d9d None None] MFA Rules not processed for user `3e0f04f474124698a46bed8dac01e30e`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:47.669136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8b4b77d4-3bed-416e-a1b5-00274cb73d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:47.688068 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:47.781767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 709/1399] 10.222.0.16 () {58 vars in 1040 bytes} [Sun Sep 18 06:17:47 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:47.791118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd346787-d895-4e66-ac84-8da831bc0bf0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:47.792685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dd346787-d895-4e66-ac84-8da831bc0bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:47.814861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:47.932491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd346787-d895-4e66-ac84-8da831bc0bf0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:48.038990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d7433-0281-4510-a0dc-76bb42d18523 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:48.039587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d7433-0281-4510-a0dc-76bb42d18523 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:48.039861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d7433-0281-4510-a0dc-76bb42d18523 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:48.040158 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d7433-0281-4510-a0dc-76bb42d18523 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:48.041801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ec1d7433-0281-4510-a0dc-76bb42d18523 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:48.045481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:48.128122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d7433-0281-4510-a0dc-76bb42d18523 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:48.129694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d7433-0281-4510-a0dc-76bb42d18523 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:48.138080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 691/1400] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:17:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:17:49.008201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529aa42-42b8-46fe-b68b-cc017da82d70 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:49.008763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529aa42-42b8-46fe-b68b-cc017da82d70 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:49.008763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529aa42-42b8-46fe-b68b-cc017da82d70 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:49.010119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 710/1401] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:49.015542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33debd-9444-43a4-acb0-0015e91cc822 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:49.016006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33debd-9444-43a4-acb0-0015e91cc822 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:49.016195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33debd-9444-43a4-acb0-0015e91cc822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:49.094273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1d33debd-9444-43a4-acb0-0015e91cc822 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:49.095406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1d33debd-9444-43a4-acb0-0015e91cc822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:49.203210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:49.220100 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 692/1402] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:49.507322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529aa42-42b8-46fe-b68b-cc017da82d70 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:49.509228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1529aa42-42b8-46fe-b68b-cc017da82d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:49.659421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:49.674552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529aa42-42b8-46fe-b68b-cc017da82d70 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:49.819927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715db7b-1841-468c-b3a0-52b506efe397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:49.820481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715db7b-1841-468c-b3a0-52b506efe397 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:49.820760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715db7b-1841-468c-b3a0-52b506efe397 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:49.821033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715db7b-1841-468c-b3a0-52b506efe397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:49.822746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c715db7b-1841-468c-b3a0-52b506efe397 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:49.943623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715db7b-1841-468c-b3a0-52b506efe397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:49.945271 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715db7b-1841-468c-b3a0-52b506efe397 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:49.954773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:49.968065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 711/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:17:52.220123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4961-8e22-4cf1-96b1-1f1855116cb9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:52.220724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4961-8e22-4cf1-96b1-1f1855116cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:52.220724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4961-8e22-4cf1-96b1-1f1855116cb9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:52.223573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 693/1404] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:52.228181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1295-b491-4e1f-a6d0-0f553f84ce9c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:52.228963 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1295-b491-4e1f-a6d0-0f553f84ce9c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:52.229408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1295-b491-4e1f-a6d0-0f553f84ce9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:52.304493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-433a1295-b491-4e1f-a6d0-0f553f84ce9c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:52.305798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-433a1295-b491-4e1f-a6d0-0f553f84ce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:52.431949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 712/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:17:52.722786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4961-8e22-4cf1-96b1-1f1855116cb9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:52.725277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7bcf4961-8e22-4cf1-96b1-1f1855116cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:52.899721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4961-8e22-4cf1-96b1-1f1855116cb9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:52.982486 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:53.028149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158aa9e-de30-4574-abc2-f2ef2bd6f452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:53.029063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158aa9e-de30-4574-abc2-f2ef2bd6f452 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:53.029498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158aa9e-de30-4574-abc2-f2ef2bd6f452 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:53.029930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158aa9e-de30-4574-abc2-f2ef2bd6f452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:53.031723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0158aa9e-de30-4574-abc2-f2ef2bd6f452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:53.132299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158aa9e-de30-4574-abc2-f2ef2bd6f452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:53.134166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158aa9e-de30-4574-abc2-f2ef2bd6f452 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:53.157411 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 694/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:17:55.387613 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6200d-847e-4d97-819a-35b1ab88cbe9 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:55.388228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6200d-847e-4d97-819a-35b1ab88cbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:55.388228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6200d-847e-4d97-819a-35b1ab88cbe9 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:55.393712 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 713/1407] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:17:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:17:55.395478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266533a-47cf-4d3c-8873-4fdc92e051ad None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:55.395946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266533a-47cf-4d3c-8873-4fdc92e051ad None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:55.396288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266533a-47cf-4d3c-8873-4fdc92e051ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:55.470081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4266533a-47cf-4d3c-8873-4fdc92e051ad None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:17:55.471312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4266533a-47cf-4d3c-8873-4fdc92e051ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:55.513570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:55.612286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 695/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:17:55.928237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6200d-847e-4d97-819a-35b1ab88cbe9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:17:55.929905 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5fd6200d-847e-4d97-819a-35b1ab88cbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:56.013192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:56.104752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6200d-847e-4d97-819a-35b1ab88cbe9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:17:56.233142 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d37c8-5dc8-4999-b47f-0650ccbd177b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:17:56.233754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d37c8-5dc8-4999-b47f-0650ccbd177b service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:17:56.234029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d37c8-5dc8-4999-b47f-0650ccbd177b service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:17:56.234300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d37c8-5dc8-4999-b47f-0650ccbd177b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:17:56.235924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-583d37c8-5dc8-4999-b47f-0650ccbd177b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:17:56.276594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:17:56.336625 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d37c8-5dc8-4999-b47f-0650ccbd177b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:17:56.338224 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d37c8-5dc8-4999-b47f-0650ccbd177b service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:17:56.360138 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 714/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:05.610517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=28 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:06.357399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=30 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:10.884962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221936bf-478e-4c1f-ae18-5a4e4459046f None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:10.885512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221936bf-478e-4c1f-ae18-5a4e4459046f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:10.885512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221936bf-478e-4c1f-ae18-5a4e4459046f None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:10.886844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 696/1410] 10.222.0.16 () {54 vars in 918 bytes} [Sun Sep 18 06:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:10.891846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29c5cb-e2ce-4f57-a29c-02ef75a056bb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:10.892271 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29c5cb-e2ce-4f57-a29c-02ef75a056bb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:10.892422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29c5cb-e2ce-4f57-a29c-02ef75a056bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:10.966661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5a29c5cb-e2ce-4f57-a29c-02ef75a056bb None None] MFA Rules not processed for user `320a1c60b5b6461c8e2e2b6ec74ce78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:10.967861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5a29c5cb-e2ce-4f57-a29c-02ef75a056bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:11.072506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 715/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Sep 18 06:18:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:11.087257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66335-4f08-414f-8255-482b8eb84454 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:11.087474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66335-4f08-414f-8255-482b8eb84454 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:11.087748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66335-4f08-414f-8255-482b8eb84454 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:11.089112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 697/1412] 10.222.0.16 () {54 vars in 918 bytes} [Sun Sep 18 06:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:11.094084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4684671-7b87-4c59-8c6b-7411a18d0893 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:11.094365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4684671-7b87-4c59-8c6b-7411a18d0893 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:11.094666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4684671-7b87-4c59-8c6b-7411a18d0893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:11.167200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:11.170249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d4684671-7b87-4c59-8c6b-7411a18d0893 None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:11.172366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d4684671-7b87-4c59-8c6b-7411a18d0893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:11.286294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 716/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Sun Sep 18 06:18:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:13.898658 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa73e75-091b-4e23-8e2f-c2051058aca1 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:13.899207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa73e75-091b-4e23-8e2f-c2051058aca1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:13.899207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa73e75-091b-4e23-8e2f-c2051058aca1 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:13.900593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:13.905900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af7fa6-9db5-41cd-b7a6-1fbdc6b26ff5 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:13.906318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af7fa6-9db5-41cd-b7a6-1fbdc6b26ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:13.906436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af7fa6-9db5-41cd-b7a6-1fbdc6b26ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:13.971198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f6af7fa6-9db5-41cd-b7a6-1fbdc6b26ff5 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:13.972672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f6af7fa6-9db5-41cd-b7a6-1fbdc6b26ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:14.026875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:14.069016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:14.370172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa73e75-091b-4e23-8e2f-c2051058aca1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:14.371884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6fa73e75-091b-4e23-8e2f-c2051058aca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:14.519045 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa73e75-091b-4e23-8e2f-c2051058aca1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:14.590628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:14.632172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932fbdd-f730-43be-aa53-2f326acc777d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:14.632687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932fbdd-f730-43be-aa53-2f326acc777d service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:14.632965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932fbdd-f730-43be-aa53-2f326acc777d service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:14.633239 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932fbdd-f730-43be-aa53-2f326acc777d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:14.634875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6932fbdd-f730-43be-aa53-2f326acc777d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:14.723817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932fbdd-f730-43be-aa53-2f326acc777d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:14.725423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932fbdd-f730-43be-aa53-2f326acc777d service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:14.743869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 699/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:15.882964 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc0a5-343f-4a22-9fe1-8f285020d0fc None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:15.883475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc0a5-343f-4a22-9fe1-8f285020d0fc None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:15.883572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcc0a5-343f-4a22-9fe1-8f285020d0fc None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:15.884865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:15.891028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a52f30-2939-4657-8c59-1a6945c5ed35 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:15.891440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a52f30-2939-4657-8c59-1a6945c5ed35 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:15.891590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a52f30-2939-4657-8c59-1a6945c5ed35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:15.968799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d1a52f30-2939-4657-8c59-1a6945c5ed35 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:15.969990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d1a52f30-2939-4657-8c59-1a6945c5ed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:15.997580 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:16.067667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:16.220157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcc0a5-343f-4a22-9fe1-8f285020d0fc None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:16.222237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b0fcc0a5-343f-4a22-9fe1-8f285020d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:16.368984 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcc0a5-343f-4a22-9fe1-8f285020d0fc None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:16.410254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:16.482066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be915-d7de-45cf-a92b-1b16ed38be8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:16.482717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be915-d7de-45cf-a92b-1b16ed38be8b service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:16.482994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be915-d7de-45cf-a92b-1b16ed38be8b service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:16.483263 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be915-d7de-45cf-a92b-1b16ed38be8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:16.484894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-618be915-d7de-45cf-a92b-1b16ed38be8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:16.572715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618be915-d7de-45cf-a92b-1b16ed38be8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:16.574304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618be915-d7de-45cf-a92b-1b16ed38be8b service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:16.592080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 719/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:17.727676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4ddf8-270a-4ed3-899b-d354d94ec2c1 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:17.728228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4ddf8-270a-4ed3-899b-d354d94ec2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:17.728362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4ddf8-270a-4ed3-899b-d354d94ec2c1 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:17.729634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:17.735920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90827c19-89f2-4b22-8053-c07ec5654fa5 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:17.736483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90827c19-89f2-4b22-8053-c07ec5654fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:17.736798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90827c19-89f2-4b22-8053-c07ec5654fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:17.790922 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:17.813058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-90827c19-89f2-4b22-8053-c07ec5654fa5 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:17.814277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-90827c19-89f2-4b22-8053-c07ec5654fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:17.912561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:18.063787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4ddf8-270a-4ed3-899b-d354d94ec2c1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:18.065573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-20f4ddf8-270a-4ed3-899b-d354d94ec2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:18.211341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4ddf8-270a-4ed3-899b-d354d94ec2c1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:18.223474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:18.323484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e44773-6b2f-4b4f-b666-84a1e8a49c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:18.324110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e44773-6b2f-4b4f-b666-84a1e8a49c2d service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:18.324387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e44773-6b2f-4b4f-b666-84a1e8a49c2d service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:18.324656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e44773-6b2f-4b4f-b666-84a1e8a49c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:18.326237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f2e44773-6b2f-4b4f-b666-84a1e8a49c2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:18.414106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e44773-6b2f-4b4f-b666-84a1e8a49c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:18.415791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e44773-6b2f-4b4f-b666-84a1e8a49c2d service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:18.433110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 702/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:19.547516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84dc06-5e90-400d-9b9e-35839ff6144e None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:19.548077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84dc06-5e90-400d-9b9e-35839ff6144e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:19.548077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84dc06-5e90-400d-9b9e-35839ff6144e None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:19.549967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:19.556623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3080a-c9aa-4b94-850a-cb601cd3c6fd None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:19.557064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3080a-c9aa-4b94-850a-cb601cd3c6fd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:19.557167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3080a-c9aa-4b94-850a-cb601cd3c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:19.577443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:19.634631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-21c3080a-c9aa-4b94-850a-cb601cd3c6fd None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:19.635835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-21c3080a-c9aa-4b94-850a-cb601cd3c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:19.730904 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:19.886371 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84dc06-5e90-400d-9b9e-35839ff6144e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:19.887979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1b84dc06-5e90-400d-9b9e-35839ff6144e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:19.997121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:20.032063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84dc06-5e90-400d-9b9e-35839ff6144e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:20.146183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb0bc0-c9f8-469c-b0fe-8e2475e78a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:20.146700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb0bc0-c9f8-469c-b0fe-8e2475e78a5b service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:20.146997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb0bc0-c9f8-469c-b0fe-8e2475e78a5b service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:20.147273 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb0bc0-c9f8-469c-b0fe-8e2475e78a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:20.148981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-50eb0bc0-c9f8-469c-b0fe-8e2475e78a5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:20.231919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:20.246211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb0bc0-c9f8-469c-b0fe-8e2475e78a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:20.247822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb0bc0-c9f8-469c-b0fe-8e2475e78a5b service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:20.266288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 722/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:21.380701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b9388-ba01-42fb-b1be-807353cb5018 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:21.381166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b9388-ba01-42fb-b1be-807353cb5018 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:21.381264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b9388-ba01-42fb-b1be-807353cb5018 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:21.382595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:21.389210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13d20-61ad-4370-8cbd-200d4988b909 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:21.389762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13d20-61ad-4370-8cbd-200d4988b909 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:21.389762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13d20-61ad-4370-8cbd-200d4988b909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:21.464735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-52d13d20-61ad-4370-8cbd-200d4988b909 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:21.465875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-52d13d20-61ad-4370-8cbd-200d4988b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:21.562175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:21.713076 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b9388-ba01-42fb-b1be-807353cb5018 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:21.714594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fc4b9388-ba01-42fb-b1be-807353cb5018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:21.798564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:21.862465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b9388-ba01-42fb-b1be-807353cb5018 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:21.975089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c579d-c621-4e8f-b8b0-0672b4eecf6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:21.975706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c579d-c621-4e8f-b8b0-0672b4eecf6c service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:21.976061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c579d-c621-4e8f-b8b0-0672b4eecf6c service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:21.976337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c579d-c621-4e8f-b8b0-0672b4eecf6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:21.977926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-135c579d-c621-4e8f-b8b0-0672b4eecf6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:22.025987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:22.068215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c579d-c621-4e8f-b8b0-0672b4eecf6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:22.069729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c579d-c621-4e8f-b8b0-0672b4eecf6c service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:22.088194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 705/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:23.144004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbf937-26c0-4ee0-92b9-cb22916a3421 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:23.144520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbf937-26c0-4ee0-92b9-cb22916a3421 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:23.144520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbf937-26c0-4ee0-92b9-cb22916a3421 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:23.145814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 06:18:23.151981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba4c7d-c4af-4c08-98d0-391d228d11cf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:23.152444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba4c7d-c4af-4c08-98d0-391d228d11cf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:23.152563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba4c7d-c4af-4c08-98d0-391d228d11cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:23.228954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-99ba4c7d-c4af-4c08-98d0-391d228d11cf None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:23.230168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-99ba4c7d-c4af-4c08-98d0-391d228d11cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:23.327762 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:23.477583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbf937-26c0-4ee0-92b9-cb22916a3421 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:23.479117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-19bbf937-26c0-4ee0-92b9-cb22916a3421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:23.527788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:23.627686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbf937-26c0-4ee0-92b9-cb22916a3421 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:23.743510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa99317-13af-4b15-b71e-bd091a1b5016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:23.744064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99317-13af-4b15-b71e-bd091a1b5016 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:23.744343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99317-13af-4b15-b71e-bd091a1b5016 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:23.744611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa99317-13af-4b15-b71e-bd091a1b5016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:23.746222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8fa99317-13af-4b15-b71e-bd091a1b5016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:23.753182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:23.835251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa99317-13af-4b15-b71e-bd091a1b5016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:23.836903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa99317-13af-4b15-b71e-bd091a1b5016 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:23.855028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 725/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:24.906430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123b94-8140-4bcb-bcd5-e554bb5c6cb0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:24.906954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123b94-8140-4bcb-bcd5-e554bb5c6cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:24.906954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123b94-8140-4bcb-bcd5-e554bb5c6cb0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:24.909010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:24.915143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca270b-5350-4d2e-865f-7017a95c92ab None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:24.915586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca270b-5350-4d2e-865f-7017a95c92ab None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:24.915682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca270b-5350-4d2e-865f-7017a95c92ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:24.990807 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a9ca270b-5350-4d2e-865f-7017a95c92ab None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:24.992050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a9ca270b-5350-4d2e-865f-7017a95c92ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:25.059272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:25.088979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:25.238960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08123b94-8140-4bcb-bcd5-e554bb5c6cb0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:25.240554 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-08123b94-8140-4bcb-bcd5-e554bb5c6cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:25.258845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:25.387623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08123b94-8140-4bcb-bcd5-e554bb5c6cb0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:25.473251 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:25.499029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93257b5b-be17-46c4-8cf6-091b1c865e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:25.499630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93257b5b-be17-46c4-8cf6-091b1c865e38 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:25.499934 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93257b5b-be17-46c4-8cf6-091b1c865e38 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:25.500207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93257b5b-be17-46c4-8cf6-091b1c865e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:25.501796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-93257b5b-be17-46c4-8cf6-091b1c865e38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:25.592293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93257b5b-be17-46c4-8cf6-091b1c865e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:25.593876 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93257b5b-be17-46c4-8cf6-091b1c865e38 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:25.612433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 708/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:26.669714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd346322-ab02-48a3-97dd-714e59ac2813 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:26.670250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd346322-ab02-48a3-97dd-714e59ac2813 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:26.670250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd346322-ab02-48a3-97dd-714e59ac2813 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:26.671591 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:26.678371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e4489-5b8b-426e-8319-38e04bae9505 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:26.678824 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e4489-5b8b-426e-8319-38e04bae9505 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:26.678930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e4489-5b8b-426e-8319-38e04bae9505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:26.754368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-977e4489-5b8b-426e-8319-38e04bae9505 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:26.755508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-977e4489-5b8b-426e-8319-38e04bae9505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:26.796958 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:26.853726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:27.006380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd346322-ab02-48a3-97dd-714e59ac2813 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:27.007827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fd346322-ab02-48a3-97dd-714e59ac2813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:27.153603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd346322-ab02-48a3-97dd-714e59ac2813 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:27.208182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:27.267206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd5fd7-fc83-415e-b351-5a3ab23d1e28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:27.267768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd5fd7-fc83-415e-b351-5a3ab23d1e28 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:27.268080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd5fd7-fc83-415e-b351-5a3ab23d1e28 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:27.268351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd5fd7-fc83-415e-b351-5a3ab23d1e28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:27.269960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-95fd5fd7-fc83-415e-b351-5a3ab23d1e28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:27.357429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd5fd7-fc83-415e-b351-5a3ab23d1e28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:27.359023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd5fd7-fc83-415e-b351-5a3ab23d1e28 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:27.377847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 728/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:28.428220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ccec-81b9-4f20-ba50-4cb521310dba None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:28.428799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ccec-81b9-4f20-ba50-4cb521310dba None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:28.428799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3ccec-81b9-4f20-ba50-4cb521310dba None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:28.430120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:28.436506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19391c2e-7618-4f94-8f4e-84f6e5372261 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:28.436902 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19391c2e-7618-4f94-8f4e-84f6e5372261 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:28.437055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19391c2e-7618-4f94-8f4e-84f6e5372261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:28.512055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-19391c2e-7618-4f94-8f4e-84f6e5372261 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:28.513257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-19391c2e-7618-4f94-8f4e-84f6e5372261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:28.515231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:28.609867 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:28.761067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3ccec-81b9-4f20-ba50-4cb521310dba None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:28.762530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6ee3ccec-81b9-4f20-ba50-4cb521310dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:28.908770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3ccec-81b9-4f20-ba50-4cb521310dba None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:28.934902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:29.022256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fb8e3-3571-4f85-8565-59735149e5c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:29.022777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fb8e3-3571-4f85-8565-59735149e5c2 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:29.023052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fb8e3-3571-4f85-8565-59735149e5c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:29.023322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fb8e3-3571-4f85-8565-59735149e5c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:29.024954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ae7fb8e3-3571-4f85-8565-59735149e5c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:29.113657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fb8e3-3571-4f85-8565-59735149e5c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:29.115232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fb8e3-3571-4f85-8565-59735149e5c2 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:29.133908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 711/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:18:31.191618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd175b59-d43e-4020-b5f5-30ed469d7a2c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:31.192185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd175b59-d43e-4020-b5f5-30ed469d7a2c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:31.192185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd175b59-d43e-4020-b5f5-30ed469d7a2c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:31.193518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:31.198800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b1419-67d9-4c02-9143-74a293229925 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:31.199187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b1419-67d9-4c02-9143-74a293229925 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:31.199354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b1419-67d9-4c02-9143-74a293229925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:31.240359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:31.265796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d51b1419-67d9-4c02-9143-74a293229925 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:31.267002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d51b1419-67d9-4c02-9143-74a293229925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:31.362470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:18:31.650430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd175b59-d43e-4020-b5f5-30ed469d7a2c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:31.652003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fd175b59-d43e-4020-b5f5-30ed469d7a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:31.754248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd175b59-d43e-4020-b5f5-30ed469d7a2c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:31.785852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:31.827124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249d6f9-a38a-484a-8431-c38c4ecef639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:31.827729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249d6f9-a38a-484a-8431-c38c4ecef639 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:31.828037 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249d6f9-a38a-484a-8431-c38c4ecef639 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:31.828306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249d6f9-a38a-484a-8431-c38c4ecef639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:31.830062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6249d6f9-a38a-484a-8431-c38c4ecef639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:31.937401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249d6f9-a38a-484a-8431-c38c4ecef639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:31.938834 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249d6f9-a38a-484a-8431-c38c4ecef639 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:31.956429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 731/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:34.257171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22a092-01f7-43e0-bbac-12ef6bccca3c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:34.257715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22a092-01f7-43e0-bbac-12ef6bccca3c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:34.257715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22a092-01f7-43e0-bbac-12ef6bccca3c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:34.259057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:34.264388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477feda5-f96a-4ef3-9e9d-0d6eabbc3f66 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:34.264843 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477feda5-f96a-4ef3-9e9d-0d6eabbc3f66 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:34.264968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477feda5-f96a-4ef3-9e9d-0d6eabbc3f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:34.335666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-477feda5-f96a-4ef3-9e9d-0d6eabbc3f66 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:34.336921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-477feda5-f96a-4ef3-9e9d-0d6eabbc3f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:34.349571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:34.434023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:34.720757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22a092-01f7-43e0-bbac-12ef6bccca3c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:34.722388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cd22a092-01f7-43e0-bbac-12ef6bccca3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:34.825122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22a092-01f7-43e0-bbac-12ef6bccca3c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:34.838819 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:34.900203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323a645-a59b-4527-8fa6-510e42afcbb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:34.900795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323a645-a59b-4527-8fa6-510e42afcbb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:34.901072 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323a645-a59b-4527-8fa6-510e42afcbb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:34.901346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323a645-a59b-4527-8fa6-510e42afcbb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:34.902930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9323a645-a59b-4527-8fa6-510e42afcbb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:35.010245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323a645-a59b-4527-8fa6-510e42afcbb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:35.011588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323a645-a59b-4527-8fa6-510e42afcbb4 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:35.029568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 714/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:37.488775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5aef8-7600-40dd-9b29-98778ea5d65f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:37.489417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5aef8-7600-40dd-9b29-98778ea5d65f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:37.489417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5aef8-7600-40dd-9b29-98778ea5d65f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:37.490726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:37.496240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6eb1b-3de4-4f54-8c07-6ad079c71f95 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:37.496633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6eb1b-3de4-4f54-8c07-6ad079c71f95 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:37.496793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6eb1b-3de4-4f54-8c07-6ad079c71f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:37.544531 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:37.562741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-15a6eb1b-3de4-4f54-8c07-6ad079c71f95 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:37.563998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-15a6eb1b-3de4-4f54-8c07-6ad079c71f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:37.659006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:37.946932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5aef8-7600-40dd-9b29-98778ea5d65f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:37.948512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-00f5aef8-7600-40dd-9b29-98778ea5d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:38.049597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5aef8-7600-40dd-9b29-98778ea5d65f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:38.091253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:38.125704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be810d9-04ac-4558-b4c9-f4d9773605f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:38.126940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be810d9-04ac-4558-b4c9-f4d9773605f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:38.127210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be810d9-04ac-4558-b4c9-f4d9773605f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:38.127476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be810d9-04ac-4558-b4c9-f4d9773605f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:38.129090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8be810d9-04ac-4558-b4c9-f4d9773605f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:38.243305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be810d9-04ac-4558-b4c9-f4d9773605f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:38.244771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be810d9-04ac-4558-b4c9-f4d9773605f1 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:38.263464 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 734/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:40.541419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aab73-3b38-41a7-953f-a3ad0d00a139 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:40.541961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aab73-3b38-41a7-953f-a3ad0d00a139 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:40.541961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aab73-3b38-41a7-953f-a3ad0d00a139 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:40.543343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:40.549493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323b431-4200-4e0f-afb5-44a2fa4e759d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:40.549922 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323b431-4200-4e0f-afb5-44a2fa4e759d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:40.550037 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323b431-4200-4e0f-afb5-44a2fa4e759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:40.615643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b323b431-4200-4e0f-afb5-44a2fa4e759d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:40.616883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b323b431-4200-4e0f-afb5-44a2fa4e759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:40.637952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:40.714097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:41.003041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aab73-3b38-41a7-953f-a3ad0d00a139 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:41.004804 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-553aab73-3b38-41a7-953f-a3ad0d00a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:41.106533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aab73-3b38-41a7-953f-a3ad0d00a139 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:41.128087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:41.180780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31381715-62c7-410a-95b7-c16b6f95f982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:41.181380 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381715-62c7-410a-95b7-c16b6f95f982 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:41.181656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381715-62c7-410a-95b7-c16b6f95f982 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:41.181926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381715-62c7-410a-95b7-c16b6f95f982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:41.183514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-31381715-62c7-410a-95b7-c16b6f95f982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:41.296533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31381715-62c7-410a-95b7-c16b6f95f982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:41.298562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31381715-62c7-410a-95b7-c16b6f95f982 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:41.317676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 717/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:43.667053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de75e-a0f8-40ec-900c-b4a60cf80907 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:43.667632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de75e-a0f8-40ec-900c-b4a60cf80907 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:43.667632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de75e-a0f8-40ec-900c-b4a60cf80907 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:43.668954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:43.674837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88f5b-b761-4c71-89e0-68ba96fb5804 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:43.675283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88f5b-b761-4c71-89e0-68ba96fb5804 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:43.675416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88f5b-b761-4c71-89e0-68ba96fb5804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:43.738784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:43.741793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-abd88f5b-b761-4c71-89e0-68ba96fb5804 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:43.743853 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-abd88f5b-b761-4c71-89e0-68ba96fb5804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:43.840551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:44.130923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892de75e-a0f8-40ec-900c-b4a60cf80907 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:44.132481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-892de75e-a0f8-40ec-900c-b4a60cf80907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:44.233997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892de75e-a0f8-40ec-900c-b4a60cf80907 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:44.286853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:44.311674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f51f47-f5fb-4efa-b26c-ef99e2be6199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:44.312306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51f47-f5fb-4efa-b26c-ef99e2be6199 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:44.312585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51f47-f5fb-4efa-b26c-ef99e2be6199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:44.312855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51f47-f5fb-4efa-b26c-ef99e2be6199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:44.315087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e9f51f47-f5fb-4efa-b26c-ef99e2be6199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:44.422311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f51f47-f5fb-4efa-b26c-ef99e2be6199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:44.424633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f51f47-f5fb-4efa-b26c-ef99e2be6199 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:44.443067 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 737/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:46.641431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59041f44-c195-48c9-9692-03d7b3c52f66 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:46.641960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59041f44-c195-48c9-9692-03d7b3c52f66 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:46.642155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59041f44-c195-48c9-9692-03d7b3c52f66 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:46.643520 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:46.648832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cebed0-fa02-4199-aa3f-1febc49ed8ef None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:46.649249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cebed0-fa02-4199-aa3f-1febc49ed8ef None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:46.649368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cebed0-fa02-4199-aa3f-1febc49ed8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:46.715050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-75cebed0-fa02-4199-aa3f-1febc49ed8ef None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:46.716272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-75cebed0-fa02-4199-aa3f-1febc49ed8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:46.745538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:46.811780 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:18:47.102032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59041f44-c195-48c9-9692-03d7b3c52f66 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:47.103575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-59041f44-c195-48c9-9692-03d7b3c52f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:47.206941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59041f44-c195-48c9-9692-03d7b3c52f66 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:47.235966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:47.281316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeffb8b-63e1-440a-9c93-0abba4fc8470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:47.281950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeffb8b-63e1-440a-9c93-0abba4fc8470 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:47.282225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeffb8b-63e1-440a-9c93-0abba4fc8470 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:47.282501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeffb8b-63e1-440a-9c93-0abba4fc8470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:47.284142 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6aeffb8b-63e1-440a-9c93-0abba4fc8470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:47.393476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeffb8b-63e1-440a-9c93-0abba4fc8470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:47.394820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeffb8b-63e1-440a-9c93-0abba4fc8470 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:47.412651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 720/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:49.622621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174c94-1793-4ea6-b8f5-964ce12feb4c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:49.623252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174c94-1793-4ea6-b8f5-964ce12feb4c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:49.623252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174c94-1793-4ea6-b8f5-964ce12feb4c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:49.624544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:49.630164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31d554-6e5c-4ab7-9db1-bc892058929c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:49.630703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31d554-6e5c-4ab7-9db1-bc892058929c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:49.630703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31d554-6e5c-4ab7-9db1-bc892058929c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:49.696875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7a31d554-6e5c-4ab7-9db1-bc892058929c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:49.698085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7a31d554-6e5c-4ab7-9db1-bc892058929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:49.706773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:49.793304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:50.080482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22174c94-1793-4ea6-b8f5-964ce12feb4c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:50.082052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-22174c94-1793-4ea6-b8f5-964ce12feb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:50.183488 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22174c94-1793-4ea6-b8f5-964ce12feb4c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:50.241084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:50.259446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82970588-aa4e-4662-b741-7c6261aff593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:50.260077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970588-aa4e-4662-b741-7c6261aff593 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:50.260352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970588-aa4e-4662-b741-7c6261aff593 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:50.260618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970588-aa4e-4662-b741-7c6261aff593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:50.262193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-82970588-aa4e-4662-b741-7c6261aff593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:50.374533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82970588-aa4e-4662-b741-7c6261aff593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:50.376144 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82970588-aa4e-4662-b741-7c6261aff593 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:50.394575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 740/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:52.622005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399ae6a-4fac-457e-8425-9945ddcb0e0c None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:52.622620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399ae6a-4fac-457e-8425-9945ddcb0e0c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:52.622620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399ae6a-4fac-457e-8425-9945ddcb0e0c None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:52.623962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:52.630165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044787f-e605-4646-af5a-6569d14f29b2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:52.630628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044787f-e605-4646-af5a-6569d14f29b2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:52.630746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044787f-e605-4646-af5a-6569d14f29b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:52.695858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2044787f-e605-4646-af5a-6569d14f29b2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:52.697091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2044787f-e605-4646-af5a-6569d14f29b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:52.735492 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:52.795441 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:53.078981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399ae6a-4fac-457e-8425-9945ddcb0e0c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:53.080600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d399ae6a-4fac-457e-8425-9945ddcb0e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:53.183845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399ae6a-4fac-457e-8425-9945ddcb0e0c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:53.223349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:53.259335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67021f08-026e-4574-a3e2-e13fefa1e86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:53.259952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67021f08-026e-4574-a3e2-e13fefa1e86b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:53.260225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67021f08-026e-4574-a3e2-e13fefa1e86b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:53.260495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67021f08-026e-4574-a3e2-e13fefa1e86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:53.262077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-67021f08-026e-4574-a3e2-e13fefa1e86b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:53.371101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67021f08-026e-4574-a3e2-e13fefa1e86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:53.372477 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67021f08-026e-4574-a3e2-e13fefa1e86b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:53.390342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 723/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:55.570252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076324ef-6f7d-4d1d-8b47-ccba69358f72 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:55.570822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076324ef-6f7d-4d1d-8b47-ccba69358f72 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:55.570822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076324ef-6f7d-4d1d-8b47-ccba69358f72 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:55.572201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:55.577803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b30a-13fd-481d-8775-02431f1436c9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:55.578226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b30a-13fd-481d-8775-02431f1436c9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:55.578365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46b30a-13fd-481d-8775-02431f1436c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:55.645578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fa46b30a-13fd-481d-8775-02431f1436c9 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:55.646837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fa46b30a-13fd-481d-8775-02431f1436c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:55.665641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:55.744660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:56.037293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076324ef-6f7d-4d1d-8b47-ccba69358f72 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:56.038898 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-076324ef-6f7d-4d1d-8b47-ccba69358f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:56.145150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076324ef-6f7d-4d1d-8b47-ccba69358f72 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:56.212716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:56.220081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9734fe-5128-4efd-8895-3fa8b8667569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:56.220677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9734fe-5128-4efd-8895-3fa8b8667569 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:56.220951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9734fe-5128-4efd-8895-3fa8b8667569 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:56.221217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9734fe-5128-4efd-8895-3fa8b8667569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:56.222798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6f9734fe-5128-4efd-8895-3fa8b8667569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:56.331283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9734fe-5128-4efd-8895-3fa8b8667569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:56.332739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9734fe-5128-4efd-8895-3fa8b8667569 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:56.351731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 743/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:18:58.520146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb616d53-1937-4972-8e59-3f0a18b953d5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:58.520685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb616d53-1937-4972-8e59-3f0a18b953d5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:58.520685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb616d53-1937-4972-8e59-3f0a18b953d5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:58.522020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:18:58.527510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75021ca4-e51c-4636-9e79-56240d47d36d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:58.527971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75021ca4-e51c-4636-9e79-56240d47d36d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:58.528082 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75021ca4-e51c-4636-9e79-56240d47d36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:58.593197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-75021ca4-e51c-4636-9e79-56240d47d36d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:18:58.594503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-75021ca4-e51c-4636-9e79-56240d47d36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:58.643575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:58.690680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:18:58.975360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb616d53-1937-4972-8e59-3f0a18b953d5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:18:58.976941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cb616d53-1937-4972-8e59-3f0a18b953d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:59.080148 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb616d53-1937-4972-8e59-3f0a18b953d5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:18:59.127818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:18:59.153871 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a16a7-e1db-4fb4-ab28-0c6d8304a1f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:18:59.154469 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a16a7-e1db-4fb4-ab28-0c6d8304a1f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:18:59.154733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a16a7-e1db-4fb4-ab28-0c6d8304a1f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:18:59.154998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a16a7-e1db-4fb4-ab28-0c6d8304a1f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:18:59.157267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e11a16a7-e1db-4fb4-ab28-0c6d8304a1f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:18:59.266456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a16a7-e1db-4fb4-ab28-0c6d8304a1f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:18:59.267865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a16a7-e1db-4fb4-ab28-0c6d8304a1f7 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:18:59.285860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 726/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:19:08.689236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=22 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:09.283710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=66 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:19.320455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbc4bd-418c-4375-add8-f1ba7ce7aee7 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:19.321035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbc4bd-418c-4375-add8-f1ba7ce7aee7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:19.321035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbc4bd-418c-4375-add8-f1ba7ce7aee7 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:19.322346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 745/1471] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:19:19.328523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f761-a581-4226-8235-3e758d559578 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:19.328929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f761-a581-4226-8235-3e758d559578 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:19.329066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f761-a581-4226-8235-3e758d559578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:19.395536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c0f7f761-a581-4226-8235-3e758d559578 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:19:19.396768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c0f7f761-a581-4226-8235-3e758d559578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:19.610626 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 727/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:19:19.909667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff835f0-3e2c-4f3e-b676-b149b3e2a439 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:19.909942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff835f0-3e2c-4f3e-b676-b149b3e2a439 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:19.910220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff835f0-3e2c-4f3e-b676-b149b3e2a439 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:19.911538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 746/1473] 10.222.0.16 () {54 vars in 962 bytes} [Sun Sep 18 06:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:19:19.916360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdc567-372a-4f07-a0ae-e4b491ad0699 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:19.916645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdc567-372a-4f07-a0ae-e4b491ad0699 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:19.916949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdc567-372a-4f07-a0ae-e4b491ad0699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:19.991316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cebdc567-372a-4f07-a0ae-e4b491ad0699 None None] MFA Rules not processed for user `03c498b5857f42f2ab84423f8f4ea11a`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:19:19.992532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cebdc567-372a-4f07-a0ae-e4b491ad0699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:20.013001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:20.069317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 728/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Sun Sep 18 06:19:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:19:20.076926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff835f0-3e2c-4f3e-b676-b149b3e2a439 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:19:20.078463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9ff835f0-3e2c-4f3e-b676-b149b3e2a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:20.180165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff835f0-3e2c-4f3e-b676-b149b3e2a439 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:19:20.256909 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c4481-0ec2-40f2-83bc-4cccb9eb8d67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c498b5857f42f2ab84423f8f4ea11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:19:20.257512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c4481-0ec2-40f2-83bc-4cccb9eb8d67 service glance] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:20.257786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c4481-0ec2-40f2-83bc-4cccb9eb8d67 service glance] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:20.258056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c4481-0ec2-40f2-83bc-4cccb9eb8d67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:20.259640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c08c4481-0ec2-40f2-83bc-4cccb9eb8d67 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:20.313283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:20.368847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c4481-0ec2-40f2-83bc-4cccb9eb8d67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:19:20.370279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c4481-0ec2-40f2-83bc-4cccb9eb8d67 service glance] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:19:20.389092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 747/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:19:22.628783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc2bc-dd87-4872-b61f-48b1c4d3a723 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:22.629330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc2bc-dd87-4872-b61f-48b1c4d3a723 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:22.629330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc2bc-dd87-4872-b61f-48b1c4d3a723 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:22.630690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 729/1476] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:19:22.635859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b923-3e74-4b34-9414-d164fd9ac4d3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:22.636302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b923-3e74-4b34-9414-d164fd9ac4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:22.636437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b923-3e74-4b34-9414-d164fd9ac4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:22.701993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9d34b923-3e74-4b34-9414-d164fd9ac4d3 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:19:22.703186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9d34b923-3e74-4b34-9414-d164fd9ac4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:22.806041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 748/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:19:23.077744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadc2bc-dd87-4872-b61f-48b1c4d3a723 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:19:23.079212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bcadc2bc-dd87-4872-b61f-48b1c4d3a723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:23.202860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadc2bc-dd87-4872-b61f-48b1c4d3a723 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:19:23.252615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:23.297779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7cfa0-e5ff-46ad-9f1c-bb2cf450c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:19:23.298382 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7cfa0-e5ff-46ad-9f1c-bb2cf450c234 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:23.298684 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7cfa0-e5ff-46ad-9f1c-bb2cf450c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:23.298953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7cfa0-e5ff-46ad-9f1c-bb2cf450c234 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:23.299584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7cfa0-e5ff-46ad-9f1c-bb2cf450c234 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:19:23.301345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-03c7cfa0-e5ff-46ad-9f1c-bb2cf450c234 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:19:23.301345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 18 06:19:23.301345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: Sep 18 06:19:23.302472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7cfa0-e5ff-46ad-9f1c-bb2cf450c234 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:19:23.321344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 730/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Sun Sep 18 06:19:23 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:19:25.499995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efa689-1665-4e22-ab47-5587460de375 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:25.500576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efa689-1665-4e22-ab47-5587460de375 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:25.500576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efa689-1665-4e22-ab47-5587460de375 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:25.501917 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 749/1479] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:19:25.507257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6187-7d1d-4643-bfc8-cd2cf7a44323 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:25.507672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6187-7d1d-4643-bfc8-cd2cf7a44323 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:25.507808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6187-7d1d-4643-bfc8-cd2cf7a44323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:25.574624 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6dba6187-7d1d-4643-bfc8-cd2cf7a44323 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:19:25.575833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6dba6187-7d1d-4643-bfc8-cd2cf7a44323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:25.672678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 731/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:19:25.974433 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efa689-1665-4e22-ab47-5587460de375 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:19:25.976095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-59efa689-1665-4e22-ab47-5587460de375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:25.986266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:26.121631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efa689-1665-4e22-ab47-5587460de375 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:19:26.201561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:26.234391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4063a2-e7de-495c-a4d7-e72d735acf0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:19:26.234987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4063a2-e7de-495c-a4d7-e72d735acf0a service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:26.235260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4063a2-e7de-495c-a4d7-e72d735acf0a service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:26.235525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4063a2-e7de-495c-a4d7-e72d735acf0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:26.237131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8c4063a2-e7de-495c-a4d7-e72d735acf0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:26.326077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4063a2-e7de-495c-a4d7-e72d735acf0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:19:26.327721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4063a2-e7de-495c-a4d7-e72d735acf0a service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:19:26.345115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 750/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:19:28.676642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612870-5a66-429a-a4e5-fe85191ab8a6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:28.677208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612870-5a66-429a-a4e5-fe85191ab8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:28.677208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612870-5a66-429a-a4e5-fe85191ab8a6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:28.678511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 732/1482] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:19:28.683664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c7628-29a7-459a-8f18-c1a978a15cf6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:28.684075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c7628-29a7-459a-8f18-c1a978a15cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:28.684252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c7628-29a7-459a-8f18-c1a978a15cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:28.749607 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-305c7628-29a7-459a-8f18-c1a978a15cf6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:19:28.750727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-305c7628-29a7-459a-8f18-c1a978a15cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:28.796659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:28.848729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 751/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:19:29.136226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36612870-5a66-429a-a4e5-fe85191ab8a6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:19:29.137759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-36612870-5a66-429a-a4e5-fe85191ab8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:29.161957 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:29.243603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36612870-5a66-429a-a4e5-fe85191ab8a6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:19:29.316298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149270e3-c653-4c0d-af8b-797814e8b1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:19:29.316898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149270e3-c653-4c0d-af8b-797814e8b1cd service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:29.317177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149270e3-c653-4c0d-af8b-797814e8b1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:29.317447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149270e3-c653-4c0d-af8b-797814e8b1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:29.319056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-149270e3-c653-4c0d-af8b-797814e8b1cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:29.393564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:29.428496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149270e3-c653-4c0d-af8b-797814e8b1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:19:29.429919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149270e3-c653-4c0d-af8b-797814e8b1cd service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:19:29.448648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 733/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:19:31.669721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e2c3c-6f37-49f2-a745-d13d220e9fbd None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:31.670286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e2c3c-6f37-49f2-a745-d13d220e9fbd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:31.670396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e2c3c-6f37-49f2-a745-d13d220e9fbd None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:31.671724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 752/1485] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:19:31.677043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707af49-7ad2-4110-9daa-471358b1863e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:31.677477 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707af49-7ad2-4110-9daa-471358b1863e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:31.677580 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707af49-7ad2-4110-9daa-471358b1863e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:31.742862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6707af49-7ad2-4110-9daa-471358b1863e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:19:31.744095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6707af49-7ad2-4110-9daa-471358b1863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:31.838663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 734/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:19:32.130854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e2c3c-6f37-49f2-a745-d13d220e9fbd None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:19:32.132487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2e6e2c3c-6f37-49f2-a745-d13d220e9fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:32.235213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e2c3c-6f37-49f2-a745-d13d220e9fbd None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:19:32.307091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:32.308577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a71990-0d0b-47f1-a9bf-e245c907c969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:19:32.309570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a71990-0d0b-47f1-a9bf-e245c907c969 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:32.310060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a71990-0d0b-47f1-a9bf-e245c907c969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:32.310396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a71990-0d0b-47f1-a9bf-e245c907c969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:32.313289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-78a71990-0d0b-47f1-a9bf-e245c907c969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:32.420889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a71990-0d0b-47f1-a9bf-e245c907c969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:19:32.422310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a71990-0d0b-47f1-a9bf-e245c907c969 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:19:32.440898 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 753/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:19:34.704698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b74cd4-a769-46c9-8afb-7dbe14a12c33 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:34.705346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b74cd4-a769-46c9-8afb-7dbe14a12c33 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:34.705346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b74cd4-a769-46c9-8afb-7dbe14a12c33 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:34.706629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 735/1488] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:19:34.711758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b7f02-9c28-4f69-9797-ca8f2498cbc1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:34.712237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b7f02-9c28-4f69-9797-ca8f2498cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:34.712335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b7f02-9c28-4f69-9797-ca8f2498cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:34.777715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-126b7f02-9c28-4f69-9797-ca8f2498cbc1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:19:34.778843 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-126b7f02-9c28-4f69-9797-ca8f2498cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:34.831966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:34.877461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 754/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:19:35.167785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b74cd4-a769-46c9-8afb-7dbe14a12c33 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:19:35.169357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f1b74cd4-a769-46c9-8afb-7dbe14a12c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:35.205388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:35.274775 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b74cd4-a769-46c9-8afb-7dbe14a12c33 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:19:35.347652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e71a7-2727-4fa4-965a-f0a67e03691c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:19:35.348290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e71a7-2727-4fa4-965a-f0a67e03691c service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:35.348568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e71a7-2727-4fa4-965a-f0a67e03691c service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:35.348839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e71a7-2727-4fa4-965a-f0a67e03691c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:35.350420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1f5e71a7-2727-4fa4-965a-f0a67e03691c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:35.429264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:35.458335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e71a7-2727-4fa4-965a-f0a67e03691c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:19:35.459750 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e71a7-2727-4fa4-965a-f0a67e03691c service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:19:35.477676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 736/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:19:37.823237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcbce1-dfe7-4fb4-8f6b-f79589558787 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:37.823830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcbce1-dfe7-4fb4-8f6b-f79589558787 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:37.823830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcbce1-dfe7-4fb4-8f6b-f79589558787 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:37.825167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 755/1491] 10.222.0.16 () {54 vars in 927 bytes} [Sun Sep 18 06:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:19:37.831040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e7620-4295-45db-8bbf-14eceac1b1b6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:37.831487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e7620-4295-45db-8bbf-14eceac1b1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:37.831594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e7620-4295-45db-8bbf-14eceac1b1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:37.897599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-235e7620-4295-45db-8bbf-14eceac1b1b6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:19:37.898786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-235e7620-4295-45db-8bbf-14eceac1b1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:37.993885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 737/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Sun Sep 18 06:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:19:38.286179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcbce1-dfe7-4fb4-8f6b-f79589558787 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:19:38.287708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-70dcbce1-dfe7-4fb4-8f6b-f79589558787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:38.388215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcbce1-dfe7-4fb4-8f6b-f79589558787 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:19:38.459889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddaa69-766f-4a15-9744-d52a4ce347ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:19:38.460515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddaa69-766f-4a15-9744-d52a4ce347ad service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:19:38.460794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddaa69-766f-4a15-9744-d52a4ce347ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:19:38.461065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddaa69-766f-4a15-9744-d52a4ce347ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:19:38.462652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-58ddaa69-766f-4a15-9744-d52a4ce347ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:19:38.471552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:38.574821 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddaa69-766f-4a15-9744-d52a4ce347ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:19:38.576283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddaa69-766f-4a15-9744-d52a4ce347ad service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:19:38.711199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 756/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:19:47.992460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=82 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:19:48.708814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=50 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:20:52.833407 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652664a-8043-4edc-931c-727f5fa1cc74 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:52.833855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652664a-8043-4edc-931c-727f5fa1cc74 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:52.833967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652664a-8043-4edc-931c-727f5fa1cc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:52.908771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8652664a-8043-4edc-931c-727f5fa1cc74 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:20:52.909981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8652664a-8043-4edc-931c-727f5fa1cc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:53.011897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 738/1494] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:20:53.019807 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432352f-dbbb-499a-b67e-9aabcf70f505 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:53.020314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432352f-dbbb-499a-b67e-9aabcf70f505 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:53.020419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432352f-dbbb-499a-b67e-9aabcf70f505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:53.094559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a432352f-dbbb-499a-b67e-9aabcf70f505 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:20:53.095667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a432352f-dbbb-499a-b67e-9aabcf70f505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:53.197988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 757/1495] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:20:53.202695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652664a-8043-4edc-931c-727f5fa1cc74 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:20:53.203985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8652664a-8043-4edc-931c-727f5fa1cc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:53.215274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652664a-8043-4edc-931c-727f5fa1cc74 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:20:53.276971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:20:53.312408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8a840-69f5-4890-80cc-bd55dd1583eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:20:53.313007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8a840-69f5-4890-80cc-bd55dd1583eb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:53.313283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8a840-69f5-4890-80cc-bd55dd1583eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:53.313553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8a840-69f5-4890-80cc-bd55dd1583eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:53.314191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8a840-69f5-4890-80cc-bd55dd1583eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:20:53.314491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8a840-69f5-4890-80cc-bd55dd1583eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:20:53.315492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-42e8a840-69f5-4890-80cc-bd55dd1583eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:20:53.315492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 18 06:20:53.315492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: Sep 18 06:20:53.316399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8a840-69f5-4890-80cc-bd55dd1583eb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:20:53.327521 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 739/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:20:53.335752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432352f-dbbb-499a-b67e-9aabcf70f505 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:20:53.345095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432352f-dbbb-499a-b67e-9aabcf70f505 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:20:53.406242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:20:53.439463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fc33b-0a07-414d-911b-9bbdb72f5d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:20:53.440084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc33b-0a07-414d-911b-9bbdb72f5d46 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:53.440359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc33b-0a07-414d-911b-9bbdb72f5d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:53.440626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc33b-0a07-414d-911b-9bbdb72f5d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:53.441247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fc33b-0a07-414d-911b-9bbdb72f5d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:20:53.442989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-5d3fc33b-0a07-414d-911b-9bbdb72f5d46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:20:53.442989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 18 06:20:53.442989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: Sep 18 06:20:53.444190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fc33b-0a07-414d-911b-9bbdb72f5d46 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:20:53.498822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 758/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:20:53 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:20:53.503043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8a840-69f5-4890-80cc-bd55dd1583eb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:20:53.504600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-42e8a840-69f5-4890-80cc-bd55dd1583eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:53.537648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8a840-69f5-4890-80cc-bd55dd1583eb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:20:53.630371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73dc9c-d71c-4a80-a564-0413d019d328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:20:53.630884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73dc9c-d71c-4a80-a564-0413d019d328 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:53.631155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73dc9c-d71c-4a80-a564-0413d019d328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:53.631426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73dc9c-d71c-4a80-a564-0413d019d328 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:53.632071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73dc9c-d71c-4a80-a564-0413d019d328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:20:53.633088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-1a73dc9c-d71c-4a80-a564-0413d019d328 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:20:53.633088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 18 06:20:53.633088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: Sep 18 06:20:53.634310 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73dc9c-d71c-4a80-a564-0413d019d328 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:20:53.674846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 740/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:20:53 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:20:53.679033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fc33b-0a07-414d-911b-9bbdb72f5d46 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:20:53.680615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5d3fc33b-0a07-414d-911b-9bbdb72f5d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:53.742214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fc33b-0a07-414d-911b-9bbdb72f5d46 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:20:53.824830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:20:53.837015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef92ca-9d6c-438e-90c0-0a5c3d91a462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:20:53.837611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef92ca-9d6c-438e-90c0-0a5c3d91a462 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:53.837883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef92ca-9d6c-438e-90c0-0a5c3d91a462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:53.838150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef92ca-9d6c-438e-90c0-0a5c3d91a462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:53.838780 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef92ca-9d6c-438e-90c0-0a5c3d91a462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:20:53.839791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-05ef92ca-9d6c-438e-90c0-0a5c3d91a462 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:20:53.839791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 18 06:20:53.839791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: Sep 18 06:20:53.840684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef92ca-9d6c-438e-90c0-0a5c3d91a462 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:20:53.853617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 759/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:20:53.857645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73dc9c-d71c-4a80-a564-0413d019d328 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:20:53.859170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1a73dc9c-d71c-4a80-a564-0413d019d328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:53.870822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73dc9c-d71c-4a80-a564-0413d019d328 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:20:53.895496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:20:53.965419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ca220-89ea-45e1-89d7-21ab8fe2889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:20:53.966009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca220-89ea-45e1-89d7-21ab8fe2889d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:53.966284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca220-89ea-45e1-89d7-21ab8fe2889d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:53.966554 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca220-89ea-45e1-89d7-21ab8fe2889d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:53.967181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ca220-89ea-45e1-89d7-21ab8fe2889d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:20:53.968215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-695ca220-89ea-45e1-89d7-21ab8fe2889d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:20:53.968215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 18 06:20:53.968215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: Sep 18 06:20:53.969096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ca220-89ea-45e1-89d7-21ab8fe2889d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:20:53.981313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 741/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:20:53.985463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef92ca-9d6c-438e-90c0-0a5c3d91a462 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:20:53.986968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-05ef92ca-9d6c-438e-90c0-0a5c3d91a462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:54.019693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef92ca-9d6c-438e-90c0-0a5c3d91a462 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:20:54.111201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bcb48-4058-4df6-88e9-55f8c6edadd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:20:54.111879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bcb48-4058-4df6-88e9-55f8c6edadd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:54.112137 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bcb48-4058-4df6-88e9-55f8c6edadd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:54.112409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bcb48-4058-4df6-88e9-55f8c6edadd5 admin admin] PATH_INFO: `/v3/projects/be27f9dc6c8249fcab68b4fa874951fa/users/27f238b7d6ab4733a9637a44800254bb/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:54.134823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bcb48-4058-4df6-88e9-55f8c6edadd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be27f9dc6c8249fcab68b4fa874951fa, user_id=27f238b7d6ab4733a9637a44800254bb, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:20:54.135852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-346bcb48-4058-4df6-88e9-55f8c6edadd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:20:54.135852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 18 06:20:54.135852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: Sep 18 06:20:54.137793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bcb48-4058-4df6-88e9-55f8c6edadd5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:20:54.161432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 760/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:20:53 2022] PUT /identity/v3/projects/be27f9dc6c8249fcab68b4fa874951fa/users/27f238b7d6ab4733a9637a44800254bb/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:20:54.173688 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e863b-0eda-4f3e-b8f4-b93740b28a6c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:54.173975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e863b-0eda-4f3e-b8f4-b93740b28a6c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:54.174250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e863b-0eda-4f3e-b8f4-b93740b28a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:54.231224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-664e863b-0eda-4f3e-b8f4-b93740b28a6c None None] MFA Rules not processed for user `27f238b7d6ab4733a9637a44800254bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:20:54.232578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-664e863b-0eda-4f3e-b8f4-b93740b28a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:54.309602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 742/1502] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:20:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:20:54.323803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e7a3f-445d-4804-94b4-e5e582fd46c9 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:54.324113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e7a3f-445d-4804-94b4-e5e582fd46c9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:54.324383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e7a3f-445d-4804-94b4-e5e582fd46c9 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:54.325684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 761/1503] 10.222.0.16 () {54 vars in 964 bytes} [Sun Sep 18 06:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:20:54.330495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013869c-3721-4ce0-9939-b752c04291cf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:54.330779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013869c-3721-4ce0-9939-b752c04291cf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:54.331051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013869c-3721-4ce0-9939-b752c04291cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:54.363326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:20:54.407772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4013869c-3721-4ce0-9939-b752c04291cf None None] MFA Rules not processed for user `1bb483203d3b4210a53a317443206d35`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:20:54.409005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4013869c-3721-4ce0-9939-b752c04291cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:54.483703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 743/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Sun Sep 18 06:20:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:20:54.494142 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e7a3f-445d-4804-94b4-e5e582fd46c9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:20:54.495701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-066e7a3f-445d-4804-94b4-e5e582fd46c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:54.545579 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:20:54.600530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e7a3f-445d-4804-94b4-e5e582fd46c9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:20:54.672898 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd3c3-f865-4c59-8fd8-d49df89cab32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:20:54.673492 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd3c3-f865-4c59-8fd8-d49df89cab32 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:54.673782 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd3c3-f865-4c59-8fd8-d49df89cab32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:54.674031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd3c3-f865-4c59-8fd8-d49df89cab32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:54.675597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9c2bd3c3-f865-4c59-8fd8-d49df89cab32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:54.777463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd3c3-f865-4c59-8fd8-d49df89cab32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:20:54.778809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bd3c3-f865-4c59-8fd8-d49df89cab32 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:20:54.782218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:20:54.796856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 762/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:20:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:20:54.843106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecffa2-a2da-4c84-bfdf-087af96fa683 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:54.843386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecffa2-a2da-4c84-bfdf-087af96fa683 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:54.843656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecffa2-a2da-4c84-bfdf-087af96fa683 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:54.844972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 744/1506] 10.222.0.16 () {52 vars in 830 bytes} [Sun Sep 18 06:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:20:54.848575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd3c3-f865-4c59-8fd8-d49df89cab32 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:20:54.849775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9c2bd3c3-f865-4c59-8fd8-d49df89cab32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:54.947662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd3c3-f865-4c59-8fd8-d49df89cab32 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:20:55.039260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:20:55.040080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:55.040360 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:55.040627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] PATH_INFO: `/v3/users/27f238b7d6ab4733a9637a44800254bb` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:55.053351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f238b7d6ab4733a9637a44800254bb)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:20:55.054365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:20:55.054365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 18 06:20:55.054365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: Sep 18 06:20:55.056415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:20:55.065757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:20:55.122138 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f238b7d6ab4733a9637a44800254bb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:20:55.130874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f238b7d6ab4733a9637a44800254bb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:20:55.131413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f238b7d6ab4733a9637a44800254bb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:20:55.131836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f238b7d6ab4733a9637a44800254bb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:20:55.155122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f238b7d6ab4733a9637a44800254bb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:20:55.173807 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 763/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:20:54 2022] DELETE /identity/v3/users/27f238b7d6ab4733a9637a44800254bb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:20:55.178198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d22cee-2514-4f1f-a888-b765192ef0b8 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:55.178698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d22cee-2514-4f1f-a888-b765192ef0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:55.178808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d22cee-2514-4f1f-a888-b765192ef0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:55.236248 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-66d22cee-2514-4f1f-a888-b765192ef0b8 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:20:55.237473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-66d22cee-2514-4f1f-a888-b765192ef0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:55.313164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:20:55.326207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 745/1508] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:20:55.335806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:20:55.337113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:55.437093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38cb32-f2ed-4b46-b53c-a604eda23ee9 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:20:55.489250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:20:55.509236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a404009-2b3f-4c36-a061-7bff324088c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:20:55.509841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a404009-2b3f-4c36-a061-7bff324088c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:55.510114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a404009-2b3f-4c36-a061-7bff324088c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:55.510382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a404009-2b3f-4c36-a061-7bff324088c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:55.511967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7a404009-2b3f-4c36-a061-7bff324088c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:55.618309 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a404009-2b3f-4c36-a061-7bff324088c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:20:55.619704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a404009-2b3f-4c36-a061-7bff324088c8 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:20:55.637804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 764/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:20:56.144512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d22cee-2514-4f1f-a888-b765192ef0b8 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:20:56.145765 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-66d22cee-2514-4f1f-a888-b765192ef0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:20:56.158414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d22cee-2514-4f1f-a888-b765192ef0b8 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:20:56.258591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:20:56.259291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:20:56.259569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:20:56.259840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] PATH_INFO: `/v3/projects/be27f9dc6c8249fcab68b4fa874951fa` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:20:56.269635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be27f9dc6c8249fcab68b4fa874951fa)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:20:56.270652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:20:56.270652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 18 06:20:56.270652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: Sep 18 06:20:56.271849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:20:56.330926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be27f9dc6c8249fcab68b4fa874951fa', 'request_id': 'req-2788199c-2b50-48e9-90f7-50ebd7470ac3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:20:56.346295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be27f9dc6c8249fcab68b4fa874951fa', 'request_id': 'req-2788199c-2b50-48e9-90f7-50ebd7470ac3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:20:56.356051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be27f9dc6c8249fcab68b4fa874951fa', 'request_id': 'req-2788199c-2b50-48e9-90f7-50ebd7470ac3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:20:56.378758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] The token cache is being invalidate because project be27f9dc6c8249fcab68b4fa874951fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:20:56.379044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:20:56.379560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2788199c-2b50-48e9-90f7-50ebd7470ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:20:56.380885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 746/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:20:56 2022] DELETE /identity/v3/projects/be27f9dc6c8249fcab68b4fa874951fa => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:21:05.635568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=62 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:21:06.376751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:22:27.226888 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3172f-ac2a-4d4b-b81a-5696a9f0b863 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:27.227487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3172f-ac2a-4d4b-b81a-5696a9f0b863 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:27.227487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3172f-ac2a-4d4b-b81a-5696a9f0b863 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:27.228808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:22:27.233712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643f60f-6c60-478f-b8c7-a5730a4478ea None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:27.234155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643f60f-6c60-478f-b8c7-a5730a4478ea None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:27.234262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643f60f-6c60-478f-b8c7-a5730a4478ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:27.315020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1643f60f-6c60-478f-b8c7-a5730a4478ea None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:22:27.316956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1643f60f-6c60-478f-b8c7-a5730a4478ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:27.420795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:22:27.575247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3172f-ac2a-4d4b-b81a-5696a9f0b863 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:22:27.577372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-44f3172f-ac2a-4d4b-b81a-5696a9f0b863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:27.694931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3172f-ac2a-4d4b-b81a-5696a9f0b863 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:22:27.700416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bab314-ff19-4c9e-8826-586e39c0828c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:22:27.701022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab314-ff19-4c9e-8826-586e39c0828c service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:27.701303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab314-ff19-4c9e-8826-586e39c0828c service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:27.701578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab314-ff19-4c9e-8826-586e39c0828c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:27.709745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bab314-ff19-4c9e-8826-586e39c0828c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:22:27.711332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bab314-ff19-4c9e-8826-586e39c0828c service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:22:27.720623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 766/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:22:28.804699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da675b21-6763-48cd-93c4-28967de863e7 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:28.805283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da675b21-6763-48cd-93c4-28967de863e7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:28.805283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da675b21-6763-48cd-93c4-28967de863e7 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:28.806591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:22:28.812648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69055f3-9b73-41fc-89dd-f66309530940 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:28.813074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69055f3-9b73-41fc-89dd-f66309530940 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:28.813181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69055f3-9b73-41fc-89dd-f66309530940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:28.833096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b69055f3-9b73-41fc-89dd-f66309530940 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:22:28.834299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b69055f3-9b73-41fc-89dd-f66309530940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:28.842167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:22:28.994054 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da675b21-6763-48cd-93c4-28967de863e7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:22:29.008846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da675b21-6763-48cd-93c4-28967de863e7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:22:29.014170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ff45d-1a85-44b6-927e-4ac2ee61468c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:22:29.014755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff45d-1a85-44b6-927e-4ac2ee61468c service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:29.015028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff45d-1a85-44b6-927e-4ac2ee61468c service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:29.015297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff45d-1a85-44b6-927e-4ac2ee61468c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:29.024133 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ff45d-1a85-44b6-927e-4ac2ee61468c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:22:29.025702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ff45d-1a85-44b6-927e-4ac2ee61468c service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:22:29.035511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 749/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:22:29.259715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda406c-f823-4034-ae74-5c82627d3d33 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:29.260048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda406c-f823-4034-ae74-5c82627d3d33 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:29.260437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda406c-f823-4034-ae74-5c82627d3d33 None None] PATH_INFO: `/v3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:29.261727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 768/1517] 10.222.0.33 () {54 vars in 925 bytes} [Sun Sep 18 06:22:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:22:29.269539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396eab-e00f-4e45-84b2-7c38e3e33669 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:29.269821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396eab-e00f-4e45-84b2-7c38e3e33669 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:29.270100 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396eab-e00f-4e45-84b2-7c38e3e33669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:29.329092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c1396eab-e00f-4e45-84b2-7c38e3e33669 None None] MFA Rules not processed for user `320a1c60b5b6461c8e2e2b6ec74ce78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:22:29.330296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c1396eab-e00f-4e45-84b2-7c38e3e33669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:29.347816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:22:29.402447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 750/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Sun Sep 18 06:22:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:22:38.310548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239837f6-f16d-4b25-a806-475c3a62860d None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:38.311021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239837f6-f16d-4b25-a806-475c3a62860d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:38.311136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239837f6-f16d-4b25-a806-475c3a62860d None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:38.312484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 769/1519] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 18 06:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:22:38.317443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399537e-6c9c-4785-a019-3e351f36e3a3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:38.317896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399537e-6c9c-4785-a019-3e351f36e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:38.318008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399537e-6c9c-4785-a019-3e351f36e3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:38.337390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6399537e-6c9c-4785-a019-3e351f36e3a3 None None] MFA Rules not processed for user `320a1c60b5b6461c8e2e2b6ec74ce78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:22:38.338576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6399537e-6c9c-4785-a019-3e351f36e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:38.347768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 751/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 18 06:22:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:22:38.355338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239837f6-f16d-4b25-a806-475c3a62860d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:22:38.369271 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239837f6-f16d-4b25-a806-475c3a62860d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:22:38.374157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ebf85-fc45-4c31-ba3b-95ed88b68f37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:22:38.374737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ebf85-fc45-4c31-ba3b-95ed88b68f37 service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:38.375016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ebf85-fc45-4c31-ba3b-95ed88b68f37 service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:38.375288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ebf85-fc45-4c31-ba3b-95ed88b68f37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:38.383362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ebf85-fc45-4c31-ba3b-95ed88b68f37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:22:38.384969 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ebf85-fc45-4c31-ba3b-95ed88b68f37 service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:22:38.394849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 770/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:22:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:22:40.504872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8648-a5f5-4250-b0ef-70c1c048560e None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:40.505447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8648-a5f5-4250-b0ef-70c1c048560e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:40.505447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8648-a5f5-4250-b0ef-70c1c048560e None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:40.506751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:22:40.512827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639049dd-256f-47bf-8432-abbd2ac2c12a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:40.513240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639049dd-256f-47bf-8432-abbd2ac2c12a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:40.513364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639049dd-256f-47bf-8432-abbd2ac2c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:40.533621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-639049dd-256f-47bf-8432-abbd2ac2c12a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:22:40.534837 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-639049dd-256f-47bf-8432-abbd2ac2c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:40.542949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:22:40.696833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba8648-a5f5-4250-b0ef-70c1c048560e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:22:40.711167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba8648-a5f5-4250-b0ef-70c1c048560e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:22:40.716611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeb940-e73e-4852-9a80-e7c13df38fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:22:40.717201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeb940-e73e-4852-9a80-e7c13df38fc4 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:40.717478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeb940-e73e-4852-9a80-e7c13df38fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:40.717749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeb940-e73e-4852-9a80-e7c13df38fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:40.725703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeb940-e73e-4852-9a80-e7c13df38fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:22:40.727267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeb940-e73e-4852-9a80-e7c13df38fc4 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:22:40.737326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 753/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:22:41.817746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55705236-4b8c-4658-b92f-3ea0c2c7059d None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:41.818326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55705236-4b8c-4658-b92f-3ea0c2c7059d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:41.818326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55705236-4b8c-4658-b92f-3ea0c2c7059d None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:41.819631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 06:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:22:41.825837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaa8e7-5127-47db-a481-d123728f9923 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:41.826327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaa8e7-5127-47db-a481-d123728f9923 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:41.826431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaa8e7-5127-47db-a481-d123728f9923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:41.846353 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-03eaa8e7-5127-47db-a481-d123728f9923 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:22:41.847564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-03eaa8e7-5127-47db-a481-d123728f9923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:41.855484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 06:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:22:42.006999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55705236-4b8c-4658-b92f-3ea0c2c7059d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:22:42.021400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55705236-4b8c-4658-b92f-3ea0c2c7059d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:22:42.026798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8a833-20fa-45a2-bd7e-f945b10d95d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:22:42.027386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a833-20fa-45a2-bd7e-f945b10d95d2 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:42.027666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a833-20fa-45a2-bd7e-f945b10d95d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:42.027972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a833-20fa-45a2-bd7e-f945b10d95d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:42.036453 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8a833-20fa-45a2-bd7e-f945b10d95d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:22:42.038030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8a833-20fa-45a2-bd7e-f945b10d95d2 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:22:42.047308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 773/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:22:46.227550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3fdd2-1c02-448a-a90c-7fd7194c18c5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:46.228141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3fdd2-1c02-448a-a90c-7fd7194c18c5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:46.228141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3fdd2-1c02-448a-a90c-7fd7194c18c5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:46.229470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:22:46.235129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d28c4e-b81f-432d-98fd-bf2836e376b0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:46.235629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d28c4e-b81f-432d-98fd-bf2836e376b0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:46.235735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d28c4e-b81f-432d-98fd-bf2836e376b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:46.255768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e5d28c4e-b81f-432d-98fd-bf2836e376b0 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:22:46.256997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e5d28c4e-b81f-432d-98fd-bf2836e376b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:46.264835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:22:46.558070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3fdd2-1c02-448a-a90c-7fd7194c18c5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:22:46.559790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-92c3fdd2-1c02-448a-a90c-7fd7194c18c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:46.646692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3fdd2-1c02-448a-a90c-7fd7194c18c5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:22:46.650371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c1f5a-ecb6-469a-be88-aa36da25e368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:22:46.651003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1f5a-ecb6-469a-be88-aa36da25e368 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:46.651277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1f5a-ecb6-469a-be88-aa36da25e368 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:46.651545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c1f5a-ecb6-469a-be88-aa36da25e368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:46.660639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c1f5a-ecb6-469a-be88-aa36da25e368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:22:46.662043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c1f5a-ecb6-469a-be88-aa36da25e368 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:22:46.671162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 756/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:22:48.855116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aed68-0124-4f9e-b2f4-139f3e4da30c None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:48.855577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aed68-0124-4f9e-b2f4-139f3e4da30c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:48.855687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aed68-0124-4f9e-b2f4-139f3e4da30c None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:48.857035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:22:48.863106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4aaa4-cff1-4e11-b8a4-f8d3db971f71 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:48.863533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4aaa4-cff1-4e11-b8a4-f8d3db971f71 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:48.863659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4aaa4-cff1-4e11-b8a4-f8d3db971f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:48.883083 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7bd4aaa4-cff1-4e11-b8a4-f8d3db971f71 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:22:48.884309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7bd4aaa4-cff1-4e11-b8a4-f8d3db971f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:48.892775 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:22:49.181796 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aed68-0124-4f9e-b2f4-139f3e4da30c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:22:49.192447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aed68-0124-4f9e-b2f4-139f3e4da30c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:22:49.195990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808cde6-78ae-4af7-982e-87bec4e599df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:22:49.196582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cde6-78ae-4af7-982e-87bec4e599df service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:49.196860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cde6-78ae-4af7-982e-87bec4e599df service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:49.197133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cde6-78ae-4af7-982e-87bec4e599df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:49.206519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808cde6-78ae-4af7-982e-87bec4e599df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:22:49.207963 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808cde6-78ae-4af7-982e-87bec4e599df service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:22:49.217243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 776/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:22:52.821704 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5ade1-1536-4da3-8316-7ee98f0ae462 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:52.822211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5ade1-1536-4da3-8316-7ee98f0ae462 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:52.822211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5ade1-1536-4da3-8316-7ee98f0ae462 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:52.823527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:22:52.828859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067876-ffab-4eaa-8150-a3b90dd98557 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:52.829928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067876-ffab-4eaa-8150-a3b90dd98557 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:52.830029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067876-ffab-4eaa-8150-a3b90dd98557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:52.850367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9a067876-ffab-4eaa-8150-a3b90dd98557 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:22:52.851567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9a067876-ffab-4eaa-8150-a3b90dd98557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:52.859655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:22:53.166817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5ade1-1536-4da3-8316-7ee98f0ae462 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:22:53.168518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0ce5ade1-1536-4da3-8316-7ee98f0ae462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:53.232347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:22:53.246217 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5ade1-1536-4da3-8316-7ee98f0ae462 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:22:53.249816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884cd60-bb22-480f-a55c-72c11da8f36a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:22:53.250417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884cd60-bb22-480f-a55c-72c11da8f36a service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:53.250697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884cd60-bb22-480f-a55c-72c11da8f36a service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:53.251492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884cd60-bb22-480f-a55c-72c11da8f36a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:53.260663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884cd60-bb22-480f-a55c-72c11da8f36a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:22:53.262108 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884cd60-bb22-480f-a55c-72c11da8f36a service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:22:53.272472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 759/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:22:55.429992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bb2a7-8cf1-4c41-a5d7-4cb056089fa1 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:55.430598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bb2a7-8cf1-4c41-a5d7-4cb056089fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:55.430598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bb2a7-8cf1-4c41-a5d7-4cb056089fa1 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:55.431868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 06:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:22:55.437059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee58fd2-67b2-4558-9364-862cb99b2fed None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:55.437494 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee58fd2-67b2-4558-9364-862cb99b2fed None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:55.437594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee58fd2-67b2-4558-9364-862cb99b2fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:55.458595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-aee58fd2-67b2-4558-9364-862cb99b2fed None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:22:55.459784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aee58fd2-67b2-4558-9364-862cb99b2fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:55.467425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 06:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:22:55.772050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bb2a7-8cf1-4c41-a5d7-4cb056089fa1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:22:55.773738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e17bb2a7-8cf1-4c41-a5d7-4cb056089fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:22:55.781203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=84 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:22:55.787461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bb2a7-8cf1-4c41-a5d7-4cb056089fa1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:22:55.790934 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b812509-5a9e-4e64-8a8b-96d5104b4149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:22:55.791519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b812509-5a9e-4e64-8a8b-96d5104b4149 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:22:55.791791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b812509-5a9e-4e64-8a8b-96d5104b4149 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:22:55.792087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b812509-5a9e-4e64-8a8b-96d5104b4149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:22:55.801588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b812509-5a9e-4e64-8a8b-96d5104b4149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:22:55.803006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b812509-5a9e-4e64-8a8b-96d5104b4149 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:22:55.812144 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 779/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:23:05.453064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=11 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:23:05.808159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:29.795373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab9b4-924a-432a-b979-6e3afa4df055 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:29.796637 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab9b4-924a-432a-b979-6e3afa4df055 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:29.797717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab9b4-924a-432a-b979-6e3afa4df055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:29.825909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-efeab9b4-924a-432a-b979-6e3afa4df055 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:29.827590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-efeab9b4-924a-432a-b979-6e3afa4df055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:29.850372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 761/1540] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:29.861389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42dfa0c-5b21-4faa-a019-8f8d5ab6f62b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:29.862001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42dfa0c-5b21-4faa-a019-8f8d5ab6f62b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:29.862001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42dfa0c-5b21-4faa-a019-8f8d5ab6f62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:29.898799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c42dfa0c-5b21-4faa-a019-8f8d5ab6f62b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:29.898799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c42dfa0c-5b21-4faa-a019-8f8d5ab6f62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:29.918444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 780/1541] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:29.924228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeab9b4-924a-432a-b979-6e3afa4df055 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:29.941597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeab9b4-924a-432a-b979-6e3afa4df055 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:29.952801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9553a82-632f-475d-a8e3-74b276267c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:29.954584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9553a82-632f-475d-a8e3-74b276267c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:29.955089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9553a82-632f-475d-a8e3-74b276267c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:29.955581 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9553a82-632f-475d-a8e3-74b276267c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:29.956491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9553a82-632f-475d-a8e3-74b276267c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:29.957026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9553a82-632f-475d-a8e3-74b276267c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:29.958880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9553a82-632f-475d-a8e3-74b276267c69 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:29.975995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 762/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:29.984731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42dfa0c-5b21-4faa-a019-8f8d5ab6f62b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:29.997382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42dfa0c-5b21-4faa-a019-8f8d5ab6f62b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.006473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153215-d9fc-4d14-8410-92e3c335cf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.007093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153215-d9fc-4d14-8410-92e3c335cf4c admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.007369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153215-d9fc-4d14-8410-92e3c335cf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.007642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153215-d9fc-4d14-8410-92e3c335cf4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.008316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a153215-d9fc-4d14-8410-92e3c335cf4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.010319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a153215-d9fc-4d14-8410-92e3c335cf4c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.056979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790517f9-5f28-450d-80a0-1d9d1b377409 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.056979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790517f9-5f28-450d-80a0-1d9d1b377409 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.056979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790517f9-5f28-450d-80a0-1d9d1b377409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.076444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 781/1543] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:29 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:30.077733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bac3ff-d63c-46bc-992d-277de122406b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.078019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bac3ff-d63c-46bc-992d-277de122406b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.078299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bac3ff-d63c-46bc-992d-277de122406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.101659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-790517f9-5f28-450d-80a0-1d9d1b377409 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.103532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-790517f9-5f28-450d-80a0-1d9d1b377409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.132982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-39bac3ff-d63c-46bc-992d-277de122406b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.134289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-39bac3ff-d63c-46bc-992d-277de122406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.264527 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 782/1544] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.266806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 763/1545] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:24:30.267472 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bac3ff-d63c-46bc-992d-277de122406b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.268135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882df9-6872-4eeb-8c8b-a45b3b567be3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.268423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882df9-6872-4eeb-8c8b-a45b3b567be3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.268765 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882df9-6872-4eeb-8c8b-a45b3b567be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.280296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bac3ff-d63c-46bc-992d-277de122406b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.287812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e090f-4065-4c71-8e67-90eefdec5e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.287812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e090f-4065-4c71-8e67-90eefdec5e40 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.287812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e090f-4065-4c71-8e67-90eefdec5e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.287812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e090f-4065-4c71-8e67-90eefdec5e40 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.288567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e090f-4065-4c71-8e67-90eefdec5e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.289420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-719e090f-4065-4c71-8e67-90eefdec5e40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:24:30.289420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 18 06:24:30.289420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: Sep 18 06:24:30.290628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e090f-4065-4c71-8e67-90eefdec5e40 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.291412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6d882df9-6872-4eeb-8c8b-a45b3b567be3 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.292801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6d882df9-6872-4eeb-8c8b-a45b3b567be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.301570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 764/1546] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.302857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522364f-a21e-479b-b00c-ff3d940453f4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.303155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522364f-a21e-479b-b00c-ff3d940453f4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.303508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522364f-a21e-479b-b00c-ff3d940453f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.314960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 783/1547] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:30.316187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c6701-d916-4ce4-9980-8f00643a0c1c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.316482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c6701-d916-4ce4-9980-8f00643a0c1c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.316755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c6701-d916-4ce4-9980-8f00643a0c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.323653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5522364f-a21e-479b-b00c-ff3d940453f4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.324897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5522364f-a21e-479b-b00c-ff3d940453f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.333951 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 765/1548] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.335174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa39ab-2d0f-4169-8e25-7b6a4595f06e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.335461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa39ab-2d0f-4169-8e25-7b6a4595f06e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.335737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa39ab-2d0f-4169-8e25-7b6a4595f06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.337424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0f0c6701-d916-4ce4-9980-8f00643a0c1c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.338651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0f0c6701-d916-4ce4-9980-8f00643a0c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.347023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 784/1549] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.348320 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5c3ef-f95b-4049-84e2-18ce4c2d974f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.348601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5c3ef-f95b-4049-84e2-18ce4c2d974f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.348871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5c3ef-f95b-4049-84e2-18ce4c2d974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.355588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5daa39ab-2d0f-4169-8e25-7b6a4595f06e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.356828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5daa39ab-2d0f-4169-8e25-7b6a4595f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.365269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 766/1550] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.366465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b1c7-5562-446d-963e-65cc7c6d52f2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.366748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b1c7-5562-446d-963e-65cc7c6d52f2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.367021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b1c7-5562-446d-963e-65cc7c6d52f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.369643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-bcb5c3ef-f95b-4049-84e2-18ce4c2d974f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.370935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bcb5c3ef-f95b-4049-84e2-18ce4c2d974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.380135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 785/1551] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.381391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a629-33b9-46ae-9282-2f3c055217d2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.381691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a629-33b9-46ae-9282-2f3c055217d2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.382009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a629-33b9-46ae-9282-2f3c055217d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.391243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2516b1c7-5562-446d-963e-65cc7c6d52f2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.392456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2516b1c7-5562-446d-963e-65cc7c6d52f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.401537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 767/1552] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.402117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a884a629-33b9-46ae-9282-2f3c055217d2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.402740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570da37-d988-4f88-8678-89c46bfe30ac None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.403051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570da37-d988-4f88-8678-89c46bfe30ac None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.403299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570da37-d988-4f88-8678-89c46bfe30ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.403411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a884a629-33b9-46ae-9282-2f3c055217d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.412787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 786/1553] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.413349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884a629-33b9-46ae-9282-2f3c055217d2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.424334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8570da37-d988-4f88-8678-89c46bfe30ac None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.424538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884a629-33b9-46ae-9282-2f3c055217d2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.425598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8570da37-d988-4f88-8678-89c46bfe30ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.429254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ff402-8463-4845-85de-6e4f9d4c2565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.429983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff402-8463-4845-85de-6e4f9d4c2565 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.430257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff402-8463-4845-85de-6e4f9d4c2565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.430522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ff402-8463-4845-85de-6e4f9d4c2565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.431145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ff402-8463-4845-85de-6e4f9d4c2565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.432771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ff402-8463-4845-85de-6e4f9d4c2565 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.433668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 768/1554] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.434901 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57e81f-d2c0-4f3c-b18a-5ed9bfae1619 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.435228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57e81f-d2c0-4f3c-b18a-5ed9bfae1619 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.435555 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57e81f-d2c0-4f3c-b18a-5ed9bfae1619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.448253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 787/1555] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:30.449741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce389a-e002-4f9d-899d-ed61eadc5f8f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.450538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce389a-e002-4f9d-899d-ed61eadc5f8f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.450839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce389a-e002-4f9d-899d-ed61eadc5f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.457004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ff57e81f-d2c0-4f3c-b18a-5ed9bfae1619 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.458241 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ff57e81f-d2c0-4f3c-b18a-5ed9bfae1619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.466455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 769/1556] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.467409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57e81f-d2c0-4f3c-b18a-5ed9bfae1619 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.472646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-60ce389a-e002-4f9d-899d-ed61eadc5f8f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.474417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-60ce389a-e002-4f9d-899d-ed61eadc5f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.477338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57e81f-d2c0-4f3c-b18a-5ed9bfae1619 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.482560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a60ec1-55c9-4826-8200-3119ccb363f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.483224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a60ec1-55c9-4826-8200-3119ccb363f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.483505 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a60ec1-55c9-4826-8200-3119ccb363f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.483820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a60ec1-55c9-4826-8200-3119ccb363f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.485182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a60ec1-55c9-4826-8200-3119ccb363f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:30.485565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 788/1557] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.487044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae1678-e542-4a7e-aec6-ab01e7839b7a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.487489 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae1678-e542-4a7e-aec6-ab01e7839b7a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.487972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae1678-e542-4a7e-aec6-ab01e7839b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.488992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a60ec1-55c9-4826-8200-3119ccb363f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.490667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a60ec1-55c9-4826-8200-3119ccb363f3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.503536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 770/1558] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:30.511301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a60ec1-55c9-4826-8200-3119ccb363f3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.517344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-34ae1678-e542-4a7e-aec6-ab01e7839b7a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.518603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-34ae1678-e542-4a7e-aec6-ab01e7839b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.522332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a60ec1-55c9-4826-8200-3119ccb363f3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.526665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 789/1559] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.526905 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d554b-555f-41ec-965a-7981085733bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.527549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d554b-555f-41ec-965a-7981085733bf admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.527828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d554b-555f-41ec-965a-7981085733bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.527973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d24dc-e8d6-4afb-82d6-f45c2aa60aaf None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.528147 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d554b-555f-41ec-965a-7981085733bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.528265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d24dc-e8d6-4afb-82d6-f45c2aa60aaf None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.528429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d24dc-e8d6-4afb-82d6-f45c2aa60aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.528759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d554b-555f-41ec-965a-7981085733bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:30.529055 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d554b-555f-41ec-965a-7981085733bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.530860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d554b-555f-41ec-965a-7981085733bf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.544734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 771/1560] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:30.545519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d554b-555f-41ec-965a-7981085733bf admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.548636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cc3d24dc-e8d6-4afb-82d6-f45c2aa60aaf None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:30.550309 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cc3d24dc-e8d6-4afb-82d6-f45c2aa60aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:30.557689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d554b-555f-41ec-965a-7981085733bf admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.559386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 790/1561] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:30.560110 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d24dc-e8d6-4afb-82d6-f45c2aa60aaf None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.567964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c236780-66f4-4a55-9020-569ee83866b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.568667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c236780-66f4-4a55-9020-569ee83866b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.569087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c236780-66f4-4a55-9020-569ee83866b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.569439 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c236780-66f4-4a55-9020-569ee83866b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.570077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c236780-66f4-4a55-9020-569ee83866b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:30.570383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c236780-66f4-4a55-9020-569ee83866b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.571239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d24dc-e8d6-4afb-82d6-f45c2aa60aaf None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.572265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c236780-66f4-4a55-9020-569ee83866b9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.578830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b120a-7638-428c-8a8e-82db6fbd59e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.579450 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b120a-7638-428c-8a8e-82db6fbd59e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.579747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b120a-7638-428c-8a8e-82db6fbd59e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.580172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b120a-7638-428c-8a8e-82db6fbd59e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.580750 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b120a-7638-428c-8a8e-82db6fbd59e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.582461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b120a-7638-428c-8a8e-82db6fbd59e4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.593885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 772/1562] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:30.593885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c236780-66f4-4a55-9020-569ee83866b9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.600571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 791/1563] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:30.601706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b120a-7638-428c-8a8e-82db6fbd59e4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.606279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c236780-66f4-4a55-9020-569ee83866b9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.611243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d91585-5496-48a1-b64c-1dd93118514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.611866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d91585-5496-48a1-b64c-1dd93118514d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.612177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d91585-5496-48a1-b64c-1dd93118514d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.612308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b120a-7638-428c-8a8e-82db6fbd59e4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.612454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d91585-5496-48a1-b64c-1dd93118514d admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.613121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d91585-5496-48a1-b64c-1dd93118514d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:30.613427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d91585-5496-48a1-b64c-1dd93118514d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.615056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d91585-5496-48a1-b64c-1dd93118514d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.617595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae11ae-9200-471f-b6e6-1ca315b4341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.618183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae11ae-9200-471f-b6e6-1ca315b4341b admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.618465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae11ae-9200-471f-b6e6-1ca315b4341b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.618764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae11ae-9200-471f-b6e6-1ca315b4341b admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.619426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae11ae-9200-471f-b6e6-1ca315b4341b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:30.619731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae11ae-9200-471f-b6e6-1ca315b4341b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.620833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-82ae11ae-9200-471f-b6e6-1ca315b4341b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:24:30.620833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 18 06:24:30.620833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: Sep 18 06:24:30.621745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae11ae-9200-471f-b6e6-1ca315b4341b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.628098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 773/1564] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:30.629183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d91585-5496-48a1-b64c-1dd93118514d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.634582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 792/1565] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:30.635746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae11ae-9200-471f-b6e6-1ca315b4341b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.640736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d91585-5496-48a1-b64c-1dd93118514d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.646400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cb411-d444-4f8c-83a1-87c4a7757d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.646998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cb411-d444-4f8c-83a1-87c4a7757d59 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.647757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cb411-d444-4f8c-83a1-87c4a7757d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.647757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cb411-d444-4f8c-83a1-87c4a7757d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.648600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cb411-d444-4f8c-83a1-87c4a7757d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.649307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-af3cb411-d444-4f8c-83a1-87c4a7757d59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:24:30.649307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 18 06:24:30.649307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: Sep 18 06:24:30.650513 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cb411-d444-4f8c-83a1-87c4a7757d59 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.652582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae11ae-9200-471f-b6e6-1ca315b4341b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.658248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f871a-6e4c-4c7c-87f3-f376def18d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.658868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f871a-6e4c-4c7c-87f3-f376def18d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.659146 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f871a-6e4c-4c7c-87f3-f376def18d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.659414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f871a-6e4c-4c7c-87f3-f376def18d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.660081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f871a-6e4c-4c7c-87f3-f376def18d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:30.660379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f871a-6e4c-4c7c-87f3-f376def18d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.661965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f871a-6e4c-4c7c-87f3-f376def18d47 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.674515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 793/1566] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:30.675540 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f871a-6e4c-4c7c-87f3-f376def18d47 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.680258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 774/1567] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:30.681376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cb411-d444-4f8c-83a1-87c4a7757d59 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.686429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f871a-6e4c-4c7c-87f3-f376def18d47 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.699735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:30.713370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:30.747581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca19c-4ae3-4c34-af63-ab0f4d52ac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.748358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cb411-d444-4f8c-83a1-87c4a7757d59 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.748586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca19c-4ae3-4c34-af63-ab0f4d52ac42 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.748947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca19c-4ae3-4c34-af63-ab0f4d52ac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.749367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca19c-4ae3-4c34-af63-ab0f4d52ac42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.749993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ca19c-4ae3-4c34-af63-ab0f4d52ac42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.752697 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ca19c-4ae3-4c34-af63-ab0f4d52ac42 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.753767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbe2a1-05c8-4877-9a40-be60550d1272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.754395 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbe2a1-05c8-4877-9a40-be60550d1272 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.754699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbe2a1-05c8-4877-9a40-be60550d1272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.754996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbe2a1-05c8-4877-9a40-be60550d1272 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.755640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbe2a1-05c8-4877-9a40-be60550d1272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:30.756011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbe2a1-05c8-4877-9a40-be60550d1272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.757610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbe2a1-05c8-4877-9a40-be60550d1272 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.777013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 775/1568] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:30.777013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbe2a1-05c8-4877-9a40-be60550d1272 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.783821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbe2a1-05c8-4877-9a40-be60550d1272 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.786302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 794/1569] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:30.787334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca19c-4ae3-4c34-af63-ab0f4d52ac42 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.788903 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa598fa-b112-4f76-9ce3-f5dedf7ef3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.789778 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa598fa-b112-4f76-9ce3-f5dedf7ef3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.790064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa598fa-b112-4f76-9ce3-f5dedf7ef3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.790347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa598fa-b112-4f76-9ce3-f5dedf7ef3e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.790999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa598fa-b112-4f76-9ce3-f5dedf7ef3e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.793079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa598fa-b112-4f76-9ce3-f5dedf7ef3e9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.825350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 776/1570] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:30.826350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa598fa-b112-4f76-9ce3-f5dedf7ef3e9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.853577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca19c-4ae3-4c34-af63-ab0f4d52ac42 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.895562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa598fa-b112-4f76-9ce3-f5dedf7ef3e9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:30.900388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2798-de2f-4b07-afd8-4c879c1eae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.901012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2798-de2f-4b07-afd8-4c879c1eae1d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.901303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2798-de2f-4b07-afd8-4c879c1eae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.901577 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2798-de2f-4b07-afd8-4c879c1eae1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.902209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede2798-de2f-4b07-afd8-4c879c1eae1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.904209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede2798-de2f-4b07-afd8-4c879c1eae1d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.918570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60084b-7645-4007-b991-755c95a6ab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:30.919390 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60084b-7645-4007-b991-755c95a6ab43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:30.919893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60084b-7645-4007-b991-755c95a6ab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:30.920541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60084b-7645-4007-b991-755c95a6ab43 admin admin] PATH_INFO: `/v3/projects/1124a72ba9a64b26a4bb32589d78c35d/users/24c44fa6d1d146109d8520346780510b/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:30.936510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60084b-7645-4007-b991-755c95a6ab43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1124a72ba9a64b26a4bb32589d78c35d, user_id=24c44fa6d1d146109d8520346780510b, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:30.937328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 777/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:30.939150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2798-de2f-4b07-afd8-4c879c1eae1d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.940227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60084b-7645-4007-b991-755c95a6ab43 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:30.954748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 795/1572] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:30 2022] PUT /identity/v3/projects/1124a72ba9a64b26a4bb32589d78c35d/users/24c44fa6d1d146109d8520346780510b/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:30.966829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60084b-7645-4007-b991-755c95a6ab43 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:30.991732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:31.018046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2798-de2f-4b07-afd8-4c879c1eae1d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.022673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60084b-7645-4007-b991-755c95a6ab43 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.022999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f5d83-bce4-4cd2-849a-a553669b619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.023604 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5d83-bce4-4cd2-849a-a553669b619b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.023882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5d83-bce4-4cd2-849a-a553669b619b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.024224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5d83-bce4-4cd2-849a-a553669b619b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.024848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f5d83-bce4-4cd2-849a-a553669b619b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.026751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f5d83-bce4-4cd2-849a-a553669b619b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.027444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407a117-a704-45a5-b4db-343b1d2618a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.028122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407a117-a704-45a5-b4db-343b1d2618a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.028397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407a117-a704-45a5-b4db-343b1d2618a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.028687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407a117-a704-45a5-b4db-343b1d2618a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.029321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407a117-a704-45a5-b4db-343b1d2618a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.031314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407a117-a704-45a5-b4db-343b1d2618a0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.058655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 778/1573] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:31.058890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 796/1574] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:30 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:31.058890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407a117-a704-45a5-b4db-343b1d2618a0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.059458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f5d83-bce4-4cd2-849a-a553669b619b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.068503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407a117-a704-45a5-b4db-343b1d2618a0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.070292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:31.124405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f5d83-bce4-4cd2-849a-a553669b619b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.129740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0764344-1756-4192-81ee-1bde91188c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.130335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0764344-1756-4192-81ee-1bde91188c0c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.130611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0764344-1756-4192-81ee-1bde91188c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.130880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0764344-1756-4192-81ee-1bde91188c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.131536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0764344-1756-4192-81ee-1bde91188c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.131915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508043f-5951-46e3-981f-e38e8eb25dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.132599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508043f-5951-46e3-981f-e38e8eb25dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.132951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508043f-5951-46e3-981f-e38e8eb25dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.133288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508043f-5951-46e3-981f-e38e8eb25dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.133516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0764344-1756-4192-81ee-1bde91188c0c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.134044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508043f-5951-46e3-981f-e38e8eb25dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.136016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508043f-5951-46e3-981f-e38e8eb25dc6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.163318 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 779/1575] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:31 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:31.164156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0764344-1756-4192-81ee-1bde91188c0c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.165638 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 797/1576] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:31 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:31.166688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508043f-5951-46e3-981f-e38e8eb25dc6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.229956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0764344-1756-4192-81ee-1bde91188c0c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.232276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508043f-5951-46e3-981f-e38e8eb25dc6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.235455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39aebb-c18b-4187-80d9-92ca56706145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.236237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39aebb-c18b-4187-80d9-92ca56706145 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.236542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39aebb-c18b-4187-80d9-92ca56706145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.236845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39aebb-c18b-4187-80d9-92ca56706145 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.237334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad9973-c4a3-4283-9817-483b8d671ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.237536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39aebb-c18b-4187-80d9-92ca56706145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.237938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad9973-c4a3-4283-9817-483b8d671ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.238252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad9973-c4a3-4283-9817-483b8d671ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.238530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad9973-c4a3-4283-9817-483b8d671ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.239157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad9973-c4a3-4283-9817-483b8d671ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.239484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39aebb-c18b-4187-80d9-92ca56706145 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.241192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad9973-c4a3-4283-9817-483b8d671ef9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.263153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 798/1577] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:31 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:31.263573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 780/1578] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:31 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:31.264409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad9973-c4a3-4283-9817-483b8d671ef9 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.264977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadebf9e-76b1-40de-9cbf-e9577b673009 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.265278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadebf9e-76b1-40de-9cbf-e9577b673009 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.265572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadebf9e-76b1-40de-9cbf-e9577b673009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.277107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad9973-c4a3-4283-9817-483b8d671ef9 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.282210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5675b7-3aa8-4c14-a2d2-a54688700f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.282811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5675b7-3aa8-4c14-a2d2-a54688700f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.283090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5675b7-3aa8-4c14-a2d2-a54688700f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.283364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5675b7-3aa8-4c14-a2d2-a54688700f45 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.284014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5675b7-3aa8-4c14-a2d2-a54688700f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.285941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5675b7-3aa8-4c14-a2d2-a54688700f45 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.294457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-eadebf9e-76b1-40de-9cbf-e9577b673009 None None] MFA Rules not processed for user `24c44fa6d1d146109d8520346780510b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:31.295686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-eadebf9e-76b1-40de-9cbf-e9577b673009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:31.309692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 799/1579] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:31 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:31.313049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5675b7-3aa8-4c14-a2d2-a54688700f45 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.323167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5675b7-3aa8-4c14-a2d2-a54688700f45 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.327879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052c6c6-e560-41f2-9c22-5bd1bd188446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.329085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c6c6-e560-41f2-9c22-5bd1bd188446 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.329362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c6c6-e560-41f2-9c22-5bd1bd188446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.329754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052c6c6-e560-41f2-9c22-5bd1bd188446 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.330425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052c6c6-e560-41f2-9c22-5bd1bd188446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.332437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052c6c6-e560-41f2-9c22-5bd1bd188446 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.355639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 800/1580] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:31 2022] POST /identity/v3/users => generated 296 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:31.356868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052c6c6-e560-41f2-9c22-5bd1bd188446 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.363489 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:31.370331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052c6c6-e560-41f2-9c22-5bd1bd188446 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.372208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 781/1581] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:31.373088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadebf9e-76b1-40de-9cbf-e9577b673009 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.375934 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da418ed-2675-4c75-80ef-56ae526fac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.376721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da418ed-2675-4c75-80ef-56ae526fac73 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.377336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da418ed-2675-4c75-80ef-56ae526fac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.377662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da418ed-2675-4c75-80ef-56ae526fac73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.378311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da418ed-2675-4c75-80ef-56ae526fac73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.380197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da418ed-2675-4c75-80ef-56ae526fac73 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.387281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadebf9e-76b1-40de-9cbf-e9577b673009 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.391854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 801/1582] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.395000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da418ed-2675-4c75-80ef-56ae526fac73 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.395120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e004f5-0ae1-428c-900c-05109888cbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.395120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e004f5-0ae1-428c-900c-05109888cbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.395120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e004f5-0ae1-428c-900c-05109888cbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.395120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e004f5-0ae1-428c-900c-05109888cbd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.395509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e004f5-0ae1-428c-900c-05109888cbd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.396641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e004f5-0ae1-428c-900c-05109888cbd8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.406124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da418ed-2675-4c75-80ef-56ae526fac73 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.409776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:31.412919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267897ab-5ae4-43db-9d3d-03566b3193f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.413773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267897ab-5ae4-43db-9d3d-03566b3193f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.414562 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267897ab-5ae4-43db-9d3d-03566b3193f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.415019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267897ab-5ae4-43db-9d3d-03566b3193f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.415857 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267897ab-5ae4-43db-9d3d-03566b3193f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.418244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267897ab-5ae4-43db-9d3d-03566b3193f9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.430833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 782/1583] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:31 2022] POST /identity/v3/users => generated 290 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:31.430833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e004f5-0ae1-428c-900c-05109888cbd8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.440590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e004f5-0ae1-428c-900c-05109888cbd8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.445436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 802/1584] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:31 2022] POST /identity/v3/users => generated 302 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:31.445592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c029fa-d700-42d4-a38b-09af3ae51f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.446137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c029fa-d700-42d4-a38b-09af3ae51f8b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.446324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267897ab-5ae4-43db-9d3d-03566b3193f9 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.446443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c029fa-d700-42d4-a38b-09af3ae51f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.446672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c029fa-d700-42d4-a38b-09af3ae51f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.447309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c029fa-d700-42d4-a38b-09af3ae51f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.448931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c029fa-d700-42d4-a38b-09af3ae51f8b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.457388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267897ab-5ae4-43db-9d3d-03566b3193f9 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.462594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 783/1585] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.462594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c029fa-d700-42d4-a38b-09af3ae51f8b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.464621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2076676-0198-4253-a5da-4f6643bc363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.465246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2076676-0198-4253-a5da-4f6643bc363e admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.465523 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2076676-0198-4253-a5da-4f6643bc363e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.465795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2076676-0198-4253-a5da-4f6643bc363e admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.466929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2076676-0198-4253-a5da-4f6643bc363e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.468222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2076676-0198-4253-a5da-4f6643bc363e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.470641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c029fa-d700-42d4-a38b-09af3ae51f8b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.476146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6998d4f-e918-412d-9141-4a7a102e7c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.476758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6998d4f-e918-412d-9141-4a7a102e7c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.477060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6998d4f-e918-412d-9141-4a7a102e7c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.477355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6998d4f-e918-412d-9141-4a7a102e7c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.478010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6998d4f-e918-412d-9141-4a7a102e7c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.479594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6998d4f-e918-412d-9141-4a7a102e7c04 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.479709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 803/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.480678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2076676-0198-4253-a5da-4f6643bc363e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.490033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2076676-0198-4253-a5da-4f6643bc363e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.493430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 784/1587] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.494463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6998d4f-e918-412d-9141-4a7a102e7c04 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.497505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d81446-99f7-4172-b829-bc90ecb35cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.498099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d81446-99f7-4172-b829-bc90ecb35cbd admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.498380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d81446-99f7-4172-b829-bc90ecb35cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.498653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d81446-99f7-4172-b829-bc90ecb35cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.499285 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d81446-99f7-4172-b829-bc90ecb35cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.501443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d81446-99f7-4172-b829-bc90ecb35cbd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.505161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6998d4f-e918-412d-9141-4a7a102e7c04 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.509780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af556ce-1d71-4dba-92e7-45f5345df458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.510356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af556ce-1d71-4dba-92e7-45f5345df458 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.510633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af556ce-1d71-4dba-92e7-45f5345df458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.510907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af556ce-1d71-4dba-92e7-45f5345df458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.511584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af556ce-1d71-4dba-92e7-45f5345df458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.512260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 804/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.513367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af556ce-1d71-4dba-92e7-45f5345df458 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.513555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a418b3a-50a3-4b67-b293-931bbe151304 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.513932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a418b3a-50a3-4b67-b293-931bbe151304 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.514352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a418b3a-50a3-4b67-b293-931bbe151304 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.516996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 805/1589] 10.222.0.16 () {54 vars in 965 bytes} [Sun Sep 18 06:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:24:31.517817 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a418b3a-50a3-4b67-b293-931bbe151304 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.531968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 785/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.531968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af556ce-1d71-4dba-92e7-45f5345df458 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.532258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a418b3a-50a3-4b67-b293-931bbe151304 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.536353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e27ff4-85e3-4e8a-ad2b-839b64178a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.536946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27ff4-85e3-4e8a-ad2b-839b64178a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.537248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27ff4-85e3-4e8a-ad2b-839b64178a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.537521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27ff4-85e3-4e8a-ad2b-839b64178a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.538156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e27ff4-85e3-4e8a-ad2b-839b64178a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.539677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af556ce-1d71-4dba-92e7-45f5345df458 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.539794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e27ff4-85e3-4e8a-ad2b-839b64178a4d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.544414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667858ea-911a-4647-bedd-4f7f3ebde1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.544993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667858ea-911a-4647-bedd-4f7f3ebde1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.545295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667858ea-911a-4647-bedd-4f7f3ebde1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.545589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667858ea-911a-4647-bedd-4f7f3ebde1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.546237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667858ea-911a-4647-bedd-4f7f3ebde1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.548073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667858ea-911a-4647-bedd-4f7f3ebde1c3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.553177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 806/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.553177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e27ff4-85e3-4e8a-ad2b-839b64178a4d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.561168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 786/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.561168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667858ea-911a-4647-bedd-4f7f3ebde1c3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.563166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e27ff4-85e3-4e8a-ad2b-839b64178a4d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.567872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a302f-6051-400b-a04a-0b885c48f322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.568485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a302f-6051-400b-a04a-0b885c48f322 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.568768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a302f-6051-400b-a04a-0b885c48f322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.569039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a302f-6051-400b-a04a-0b885c48f322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.569660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a302f-6051-400b-a04a-0b885c48f322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.571243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a302f-6051-400b-a04a-0b885c48f322 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.572325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667858ea-911a-4647-bedd-4f7f3ebde1c3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.577154 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550c20d-f18b-43cc-9648-b445c5075919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.577834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550c20d-f18b-43cc-9648-b445c5075919 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.578284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550c20d-f18b-43cc-9648-b445c5075919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.579278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550c20d-f18b-43cc-9648-b445c5075919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.580050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550c20d-f18b-43cc-9648-b445c5075919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.582264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550c20d-f18b-43cc-9648-b445c5075919 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.582389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 807/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.583242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a302f-6051-400b-a04a-0b885c48f322 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.595687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a302f-6051-400b-a04a-0b885c48f322 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.596775 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 787/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.600967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55035c-8e70-40ca-8f1c-7ec6666cc9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.601110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550c20d-f18b-43cc-9648-b445c5075919 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.601562 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55035c-8e70-40ca-8f1c-7ec6666cc9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.601841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55035c-8e70-40ca-8f1c-7ec6666cc9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.602114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55035c-8e70-40ca-8f1c-7ec6666cc9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.602744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55035c-8e70-40ca-8f1c-7ec6666cc9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.604376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55035c-8e70-40ca-8f1c-7ec6666cc9c8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.613106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550c20d-f18b-43cc-9648-b445c5075919 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.621027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 808/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.621198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0551a-be15-448e-af21-b9c944de8217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.621325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f4c77-6852-4458-b980-83084448455c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.621427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0551a-be15-448e-af21-b9c944de8217 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.621524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f4c77-6852-4458-b980-83084448455c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.621524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f4c77-6852-4458-b980-83084448455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.621697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0551a-be15-448e-af21-b9c944de8217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.621697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0551a-be15-448e-af21-b9c944de8217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.621697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0551a-be15-448e-af21-b9c944de8217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.623745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0551a-be15-448e-af21-b9c944de8217 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.634648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 788/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.635370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0551a-be15-448e-af21-b9c944de8217 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.645653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0551a-be15-448e-af21-b9c944de8217 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.650244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a48a3-2616-4485-8570-09fe1b6ba726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.650836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a48a3-2616-4485-8570-09fe1b6ba726 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.651299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a48a3-2616-4485-8570-09fe1b6ba726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.651414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a48a3-2616-4485-8570-09fe1b6ba726 admin admin] PATH_INFO: `/v3/projects/1f85a3273b794df88b71558754163278/users/b805252c0e714dbcb305ad156ed58113/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.664736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-eb2f4c77-6852-4458-b980-83084448455c None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:31.665973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-eb2f4c77-6852-4458-b980-83084448455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:31.666747 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a48a3-2616-4485-8570-09fe1b6ba726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f85a3273b794df88b71558754163278, user_id=b805252c0e714dbcb305ad156ed58113, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.667840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-0f3a48a3-2616-4485-8570-09fe1b6ba726 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:24:31.667840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 18 06:24:31.667840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: Sep 18 06:24:31.670190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a48a3-2616-4485-8570-09fe1b6ba726 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.685204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 789/1597] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:31 2022] PUT /identity/v3/projects/1f85a3273b794df88b71558754163278/users/b805252c0e714dbcb305ad156ed58113/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:31.689730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a48a3-2616-4485-8570-09fe1b6ba726 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.736829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 809/1598] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 18 06:24:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:31.737676 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f4c77-6852-4458-b980-83084448455c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.747776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f4c77-6852-4458-b980-83084448455c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.753339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a48a3-2616-4485-8570-09fe1b6ba726 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.753845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7e18-ad41-4fa1-a46f-0947569eb921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.754548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7e18-ad41-4fa1-a46f-0947569eb921 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.754927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7e18-ad41-4fa1-a46f-0947569eb921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.755321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7e18-ad41-4fa1-a46f-0947569eb921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.756088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7e18-ad41-4fa1-a46f-0947569eb921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.757767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7e18-ad41-4fa1-a46f-0947569eb921 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.758138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec0464-a281-47f9-bcb0-675cff80a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.758740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0464-a281-47f9-bcb0-675cff80a982 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.759019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0464-a281-47f9-bcb0-675cff80a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.759297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0464-a281-47f9-bcb0-675cff80a982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.759959 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec0464-a281-47f9-bcb0-675cff80a982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.761551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec0464-a281-47f9-bcb0-675cff80a982 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.769233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 810/1599] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.770006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7e18-ad41-4fa1-a46f-0947569eb921 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.774918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 790/1600] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:31.775838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec0464-a281-47f9-bcb0-675cff80a982 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.780269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7e18-ad41-4fa1-a46f-0947569eb921 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.785254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed5b37-ddab-4997-b6b4-4ab2b0350301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.785898 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed5b37-ddab-4997-b6b4-4ab2b0350301 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.786023 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec0464-a281-47f9-bcb0-675cff80a982 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.786173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed5b37-ddab-4997-b6b4-4ab2b0350301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.786448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed5b37-ddab-4997-b6b4-4ab2b0350301 admin admin] PATH_INFO: `/v3/projects/7d835c06aff44cf188682a40bf513323/users/ce88507ca3944b1ead3da66482046d22/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.790698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a814e1-ba3d-47ce-9459-0737abce23b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.791337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a814e1-ba3d-47ce-9459-0737abce23b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.791686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a814e1-ba3d-47ce-9459-0737abce23b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.791929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a814e1-ba3d-47ce-9459-0737abce23b6 admin admin] PATH_INFO: `/v3/projects/17308b8e868549ad99dd2f65e801baf7/users/11898a78089f407aa67cae2c48f99d7e/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.802230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed5b37-ddab-4997-b6b4-4ab2b0350301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d835c06aff44cf188682a40bf513323, user_id=ce88507ca3944b1ead3da66482046d22, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.804955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed5b37-ddab-4997-b6b4-4ab2b0350301 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.806861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a814e1-ba3d-47ce-9459-0737abce23b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17308b8e868549ad99dd2f65e801baf7, user_id=11898a78089f407aa67cae2c48f99d7e, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.809882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a814e1-ba3d-47ce-9459-0737abce23b6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.819517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 811/1601] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:31 2022] PUT /identity/v3/projects/7d835c06aff44cf188682a40bf513323/users/ce88507ca3944b1ead3da66482046d22/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:31.820332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed5b37-ddab-4997-b6b4-4ab2b0350301 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.836400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 791/1602] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:31 2022] PUT /identity/v3/projects/17308b8e868549ad99dd2f65e801baf7/users/11898a78089f407aa67cae2c48f99d7e/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:31.837258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a814e1-ba3d-47ce-9459-0737abce23b6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:31.851419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:31.880212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:31.892673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed5b37-ddab-4997-b6b4-4ab2b0350301 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.904919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a814e1-ba3d-47ce-9459-0737abce23b6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:31.910504 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80198d-5c11-40c1-85d9-0d719ce26e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.911153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80198d-5c11-40c1-85d9-0d719ce26e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.911431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80198d-5c11-40c1-85d9-0d719ce26e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.911736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80198d-5c11-40c1-85d9-0d719ce26e54 admin admin] PATH_INFO: `/v3/projects/a7d84e3d93934b3b97229eb9b584753b/users/2846f016f36f4c61a6ec959478f2dcd8/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.926530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80198d-5c11-40c1-85d9-0d719ce26e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d84e3d93934b3b97229eb9b584753b, user_id=2846f016f36f4c61a6ec959478f2dcd8, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.929262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80198d-5c11-40c1-85d9-0d719ce26e54 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.943861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 792/1603] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:31 2022] PUT /identity/v3/projects/a7d84e3d93934b3b97229eb9b584753b/users/2846f016f36f4c61a6ec959478f2dcd8/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:31.945335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938db09d-7921-494a-8cb0-64653d60753b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.945766 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938db09d-7921-494a-8cb0-64653d60753b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.946122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938db09d-7921-494a-8cb0-64653d60753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.956730 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc4b2b-1d6f-4703-b782-71fb68919a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:31.957971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc4b2b-1d6f-4703-b782-71fb68919a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:31.958254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc4b2b-1d6f-4703-b782-71fb68919a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:31.958529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc4b2b-1d6f-4703-b782-71fb68919a2b admin admin] PATH_INFO: `/v3/projects/fdee6f7ceb3b48329714874f6dfabea7/users/ce39e1d9fe5e4dfeb74982efbee52001/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:31.966405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-938db09d-7921-494a-8cb0-64653d60753b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:31.967795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-938db09d-7921-494a-8cb0-64653d60753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:31.973573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc4b2b-1d6f-4703-b782-71fb68919a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdee6f7ceb3b48329714874f6dfabea7, user_id=ce39e1d9fe5e4dfeb74982efbee52001, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:31.976277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc4b2b-1d6f-4703-b782-71fb68919a2b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:31.989697 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 812/1604] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:31 2022] PUT /identity/v3/projects/fdee6f7ceb3b48329714874f6dfabea7/users/ce39e1d9fe5e4dfeb74982efbee52001/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:32.000172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc4b2b-1d6f-4703-b782-71fb68919a2b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:32.035999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 793/1605] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:32.037160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938db09d-7921-494a-8cb0-64653d60753b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:32.050077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938db09d-7921-494a-8cb0-64653d60753b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:32.066540 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc4b2b-1d6f-4703-b782-71fb68919a2b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:32.073152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0e9ac-d026-484c-9312-099adde5c38a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:32.074157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e9ac-d026-484c-9312-099adde5c38a service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.074952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e9ac-d026-484c-9312-099adde5c38a service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.075148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0e9ac-d026-484c-9312-099adde5c38a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.109769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badddec-68f2-477a-9c2c-f7bcca3e58d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:32.110696 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badddec-68f2-477a-9c2c-f7bcca3e58d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.110974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badddec-68f2-477a-9c2c-f7bcca3e58d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.111248 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badddec-68f2-477a-9c2c-f7bcca3e58d0 admin admin] PATH_INFO: `/v3/projects/d60adef6e29047b4859efe56883798b7/users/de9777f9cfd440c0a436890ee0fcb919/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.126712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badddec-68f2-477a-9c2c-f7bcca3e58d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60adef6e29047b4859efe56883798b7, user_id=de9777f9cfd440c0a436890ee0fcb919, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:32.126885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:32.129924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badddec-68f2-477a-9c2c-f7bcca3e58d0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:32.137054 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0e9ac-d026-484c-9312-099adde5c38a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:32.138644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0e9ac-d026-484c-9312-099adde5c38a service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:32.144543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 794/1606] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:32 2022] PUT /identity/v3/projects/d60adef6e29047b4859efe56883798b7/users/de9777f9cfd440c0a436890ee0fcb919/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:32.145280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badddec-68f2-477a-9c2c-f7bcca3e58d0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:32.149107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 813/1607] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:32.150563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291edc47-ab43-4898-97ae-1ff5d7175bc7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.150896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291edc47-ab43-4898-97ae-1ff5d7175bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.151168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291edc47-ab43-4898-97ae-1ff5d7175bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.182519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-291edc47-ab43-4898-97ae-1ff5d7175bc7 None None] MFA Rules not processed for user `ce88507ca3944b1ead3da66482046d22`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:32.183876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-291edc47-ab43-4898-97ae-1ff5d7175bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:32.204858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:32.225285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badddec-68f2-477a-9c2c-f7bcca3e58d0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:32.230636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecba95e-a54d-4a78-a7d6-922b9321a7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:32.231400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba95e-a54d-4a78-a7d6-922b9321a7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.231795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba95e-a54d-4a78-a7d6-922b9321a7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.232190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba95e-a54d-4a78-a7d6-922b9321a7c0 admin admin] PATH_INFO: `/v3/projects/4a1f1d29a7384dd59cbd042c52b7d5db/users/da02b9579a5640ed9c4c8aed9807052c/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.248174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecba95e-a54d-4a78-a7d6-922b9321a7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1f1d29a7384dd59cbd042c52b7d5db, user_id=da02b9579a5640ed9c4c8aed9807052c, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:32.252394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecba95e-a54d-4a78-a7d6-922b9321a7c0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:32.259351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 814/1608] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:32.260643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a49db-77f5-4a23-a5b2-6dbc9b4f0bc7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.261043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a49db-77f5-4a23-a5b2-6dbc9b4f0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.261177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a49db-77f5-4a23-a5b2-6dbc9b4f0bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.282394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 795/1609] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:32 2022] PUT /identity/v3/projects/4a1f1d29a7384dd59cbd042c52b7d5db/users/da02b9579a5640ed9c4c8aed9807052c/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:32.283978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb3adc-e45a-4229-bce5-c3642d19b14e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.284492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb3adc-e45a-4229-bce5-c3642d19b14e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.284900 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb3adc-e45a-4229-bce5-c3642d19b14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.289384 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-3d3a49db-77f5-4a23-a5b2-6dbc9b4f0bc7 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:32.290907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3d3a49db-77f5-4a23-a5b2-6dbc9b4f0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:32.317374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9aeb3adc-e45a-4229-bce5-c3642d19b14e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:32.321312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9aeb3adc-e45a-4229-bce5-c3642d19b14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:32.364498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 815/1610] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:32.367262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072cb5-cfd8-4452-be49-0f5b162fa806 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.368186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072cb5-cfd8-4452-be49-0f5b162fa806 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.368642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072cb5-cfd8-4452-be49-0f5b162fa806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.394722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 796/1611] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:32.398811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb3adc-e45a-4229-bce5-c3642d19b14e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:32.400275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9aeb3adc-e45a-4229-bce5-c3642d19b14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:32.404333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2c072cb5-cfd8-4452-be49-0f5b162fa806 None None] MFA Rules not processed for user `ce39e1d9fe5e4dfeb74982efbee52001`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:32.405602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2c072cb5-cfd8-4452-be49-0f5b162fa806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:32.459078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb3adc-e45a-4229-bce5-c3642d19b14e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:32.462835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28929d-62df-47e5-8d35-fcef219184f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:32.463424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28929d-62df-47e5-8d35-fcef219184f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.463695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28929d-62df-47e5-8d35-fcef219184f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.463997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28929d-62df-47e5-8d35-fcef219184f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.472400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 816/1612] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:32.476916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746648ef-bcb0-4af5-924e-9f641517fc72 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.476916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746648ef-bcb0-4af5-924e-9f641517fc72 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.476916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746648ef-bcb0-4af5-924e-9f641517fc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.478095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28929d-62df-47e5-8d35-fcef219184f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:32.479613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28929d-62df-47e5-8d35-fcef219184f8 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:32.489979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 797/1613] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:32.491276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1528e12-7473-4a95-ad1f-3502d2462d9c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.491630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1528e12-7473-4a95-ad1f-3502d2462d9c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.492035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1528e12-7473-4a95-ad1f-3502d2462d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.494707 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:32.505918 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-746648ef-bcb0-4af5-924e-9f641517fc72 None None] MFA Rules not processed for user `de9777f9cfd440c0a436890ee0fcb919`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:32.507282 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-746648ef-bcb0-4af5-924e-9f641517fc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:32.512609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a1528e12-7473-4a95-ad1f-3502d2462d9c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:32.513880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a1528e12-7473-4a95-ad1f-3502d2462d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:32.525185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 798/1614] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:32.526453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13ab2-6c9e-4aa4-8a0d-d8e37240e8e6 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.527032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13ab2-6c9e-4aa4-8a0d-d8e37240e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.527255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f13ab2-6c9e-4aa4-8a0d-d8e37240e8e6 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.532161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 799/1615] 10.222.0.16 () {54 vars in 965 bytes} [Sun Sep 18 06:24:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:24:32.533452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13ab2-6c9e-4aa4-8a0d-d8e37240e8e6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:32.546780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f13ab2-6c9e-4aa4-8a0d-d8e37240e8e6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:32.551926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b10b12-76df-42c8-aa9b-07633474ef8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:32.552615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b10b12-76df-42c8-aa9b-07633474ef8b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.552933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b10b12-76df-42c8-aa9b-07633474ef8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.553251 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b10b12-76df-42c8-aa9b-07633474ef8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.565725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b10b12-76df-42c8-aa9b-07633474ef8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:32.567201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b10b12-76df-42c8-aa9b-07633474ef8b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:32.582906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 800/1616] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:32.584346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b10b12-76df-42c8-aa9b-07633474ef8b service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:32.592640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 817/1617] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:32.595836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bcd7b-b92e-43de-9086-b319c0e933b1 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.596148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bcd7b-b92e-43de-9086-b319c0e933b1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.596419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bcd7b-b92e-43de-9086-b319c0e933b1 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.597030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b10b12-76df-42c8-aa9b-07633474ef8b service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:32.597881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 818/1618] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 18 06:24:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:24:32.598793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e35de-2c3a-4e0d-acad-8cbadfc72068 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.599069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e35de-2c3a-4e0d-acad-8cbadfc72068 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.599353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e35de-2c3a-4e0d-acad-8cbadfc72068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.601453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd9be4-ec15-4353-82d4-d73536c824be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:32.602141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd9be4-ec15-4353-82d4-d73536c824be service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.602536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd9be4-ec15-4353-82d4-d73536c824be service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.603050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd9be4-ec15-4353-82d4-d73536c824be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.617888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd9be4-ec15-4353-82d4-d73536c824be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:32.619740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd9be4-ec15-4353-82d4-d73536c824be service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:32.622752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4c1e35de-2c3a-4e0d-acad-8cbadfc72068 None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:32.623576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4c1e35de-2c3a-4e0d-acad-8cbadfc72068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:32.631715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 801/1619] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:32.632660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd9be4-ec15-4353-82d4-d73536c824be service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:32.641822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd9be4-ec15-4353-82d4-d73536c824be service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:32.646788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fcc7a-2011-4706-bd44-de922bb2bfe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:32.647487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fcc7a-2011-4706-bd44-de922bb2bfe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.647759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fcc7a-2011-4706-bd44-de922bb2bfe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.648089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fcc7a-2011-4706-bd44-de922bb2bfe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.660394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fcc7a-2011-4706-bd44-de922bb2bfe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:32.661824 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fcc7a-2011-4706-bd44-de922bb2bfe1 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:32.675240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 802/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:32.676190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fcc7a-2011-4706-bd44-de922bb2bfe1 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:32.688691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fcc7a-2011-4706-bd44-de922bb2bfe1 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:32.695299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5f96e-b64c-4030-90a1-7c3a9dd7d845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:32.696880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5f96e-b64c-4030-90a1-7c3a9dd7d845 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.697465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5f96e-b64c-4030-90a1-7c3a9dd7d845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.698463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5f96e-b64c-4030-90a1-7c3a9dd7d845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.698887 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5f96e-b64c-4030-90a1-7c3a9dd7d845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:32.701366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5f96e-b64c-4030-90a1-7c3a9dd7d845 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:32.709804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 819/1621] 10.222.0.16 () {58 vars in 1062 bytes} [Sun Sep 18 06:24:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:32.720087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc9cee-2fe9-49f5-8698-fddd792edb7e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.720881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc9cee-2fe9-49f5-8698-fddd792edb7e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.720881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc9cee-2fe9-49f5-8698-fddd792edb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.746462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f6dc9cee-2fe9-49f5-8698-fddd792edb7e None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:32.748045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f6dc9cee-2fe9-49f5-8698-fddd792edb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:32.749048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 803/1622] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:32 2022] POST /identity/v3/projects => generated 403 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:32.751307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5f96e-b64c-4030-90a1-7c3a9dd7d845 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:32.757103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:32.856170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 820/1623] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:24:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:32.857664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc9cee-2fe9-49f5-8698-fddd792edb7e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:32.883584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5f96e-b64c-4030-90a1-7c3a9dd7d845 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:32.893958 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283fcc0-7043-4bc3-ab59-ca166642bad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:32.894780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283fcc0-7043-4bc3-ab59-ca166642bad9 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.895137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283fcc0-7043-4bc3-ab59-ca166642bad9 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.895863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283fcc0-7043-4bc3-ab59-ca166642bad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.913758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:32.984153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc9cee-2fe9-49f5-8698-fddd792edb7e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:32.994090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13e3f-b746-472d-a333-7c59afce1161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:32.995595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13e3f-b746-472d-a333-7c59afce1161 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:32.995897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283fcc0-7043-4bc3-ab59-ca166642bad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:32.996661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13e3f-b746-472d-a333-7c59afce1161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:32.997288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13e3f-b746-472d-a333-7c59afce1161 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:32.998320 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da13e3f-b746-472d-a333-7c59afce1161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:32.998455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283fcc0-7043-4bc3-ab59-ca166642bad9 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:33.002404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da13e3f-b746-472d-a333-7c59afce1161 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:33.012381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 804/1624] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:33.013834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283fcc0-7043-4bc3-ab59-ca166642bad9 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:33.040413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 821/1625] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:32 2022] POST /identity/v3/users => generated 308 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:33.044653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13e3f-b746-472d-a333-7c59afce1161 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:33.059444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13e3f-b746-472d-a333-7c59afce1161 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:33.070154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b697e2c-df2c-42a7-a09d-d2f5c36e908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:33.070942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b697e2c-df2c-42a7-a09d-d2f5c36e908c admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:33.072803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b697e2c-df2c-42a7-a09d-d2f5c36e908c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:33.073690 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b697e2c-df2c-42a7-a09d-d2f5c36e908c admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:33.074457 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b697e2c-df2c-42a7-a09d-d2f5c36e908c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:33.076338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b697e2c-df2c-42a7-a09d-d2f5c36e908c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:33.105578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 822/1626] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:33.105995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b697e2c-df2c-42a7-a09d-d2f5c36e908c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:33.115562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283fcc0-7043-4bc3-ab59-ca166642bad9 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:33.121312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d23db-5e75-40e2-ba71-87f4ff044a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:33.122639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b697e2c-df2c-42a7-a09d-d2f5c36e908c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:33.123637 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d23db-5e75-40e2-ba71-87f4ff044a8e service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:33.124187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d23db-5e75-40e2-ba71-87f4ff044a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:33.124684 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d23db-5e75-40e2-ba71-87f4ff044a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:33.128674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dd06d-3953-42c3-b436-fd727923505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:33.129562 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dd06d-3953-42c3-b436-fd727923505c admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:33.129847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dd06d-3953-42c3-b436-fd727923505c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:33.130123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dd06d-3953-42c3-b436-fd727923505c admin admin] PATH_INFO: `/v3/projects/24031e3df1064a2485d1dbce09e8c835/users/f33927035fd6453f8787f4a0d88fa18f/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:33.142125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d23db-5e75-40e2-ba71-87f4ff044a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:33.145061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d23db-5e75-40e2-ba71-87f4ff044a8e service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:33.157352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dd06d-3953-42c3-b436-fd727923505c admin admin] RBAC: Authorizing `identity:create_grant(project_id=24031e3df1064a2485d1dbce09e8c835, user_id=f33927035fd6453f8787f4a0d88fa18f, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:33.161904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dd06d-3953-42c3-b436-fd727923505c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:33.162656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 805/1627] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:33.189282 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 823/1628] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:33 2022] PUT /identity/v3/projects/24031e3df1064a2485d1dbce09e8c835/users/f33927035fd6453f8787f4a0d88fa18f/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:33.196299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d23db-5e75-40e2-ba71-87f4ff044a8e service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:33.213219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d23db-5e75-40e2-ba71-87f4ff044a8e service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:33.367207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:33.371200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db57ee-a9ca-4f28-b0da-d84edea175ee None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:33.371486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db57ee-a9ca-4f28-b0da-d84edea175ee None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:33.371803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db57ee-a9ca-4f28-b0da-d84edea175ee None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:33.373394 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 824/1629] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 18 06:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:24:33.379454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d209-3d04-45a4-a10f-a1b4979e977f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:33.379768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d209-3d04-45a4-a10f-a1b4979e977f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:33.380032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d209-3d04-45a4-a10f-a1b4979e977f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:33.408903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a6c8d209-3d04-45a4-a10f-a1b4979e977f None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:33.410238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a6c8d209-3d04-45a4-a10f-a1b4979e977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:33.427080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de879ec-04bc-4c0a-8985-979a588278f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:33.428956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de879ec-04bc-4c0a-8985-979a588278f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:33.429206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de879ec-04bc-4c0a-8985-979a588278f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:33.429481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de879ec-04bc-4c0a-8985-979a588278f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:33.430139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de879ec-04bc-4c0a-8985-979a588278f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:33.441305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de879ec-04bc-4c0a-8985-979a588278f5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:33.471432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 806/1630] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:33.477119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de879ec-04bc-4c0a-8985-979a588278f5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:33.491350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de879ec-04bc-4c0a-8985-979a588278f5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:33.497449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2994552-efe1-4b82-b374-823643877790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:33.498417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994552-efe1-4b82-b374-823643877790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:33.498699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994552-efe1-4b82-b374-823643877790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:33.498989 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994552-efe1-4b82-b374-823643877790 admin admin] PATH_INFO: `/v3/projects/24031e3df1064a2485d1dbce09e8c835/users/f33927035fd6453f8787f4a0d88fa18f/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:33.502070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2994552-efe1-4b82-b374-823643877790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24031e3df1064a2485d1dbce09e8c835, user_id=f33927035fd6453f8787f4a0d88fa18f, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:33.505488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2994552-efe1-4b82-b374-823643877790 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:33.524225 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 807/1631] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:33 2022] PUT /identity/v3/projects/24031e3df1064a2485d1dbce09e8c835/users/f33927035fd6453f8787f4a0d88fa18f/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:33.535131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863011d7-23b4-42e6-a6b8-5ce5258bc800 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:33.535421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863011d7-23b4-42e6-a6b8-5ce5258bc800 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:33.535703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863011d7-23b4-42e6-a6b8-5ce5258bc800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:33.569616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 825/1632] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:24:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:24:33.583675 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-863011d7-23b4-42e6-a6b8-5ce5258bc800 None None] MFA Rules not processed for user `f33927035fd6453f8787f4a0d88fa18f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:33.585186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-863011d7-23b4-42e6-a6b8-5ce5258bc800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:33.587316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d209-3d04-45a4-a10f-a1b4979e977f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:33.694389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d209-3d04-45a4-a10f-a1b4979e977f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:33.749080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:33.787706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 808/1633] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:33 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:33.804991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15655d79-1532-4178-9176-de122580fe34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:33.805747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655d79-1532-4178-9176-de122580fe34 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:33.806006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655d79-1532-4178-9176-de122580fe34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:33.806236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655d79-1532-4178-9176-de122580fe34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:33.926064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15655d79-1532-4178-9176-de122580fe34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:33.927759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15655d79-1532-4178-9176-de122580fe34 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:33.955668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 826/1634] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:34.176900 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863011d7-23b4-42e6-a6b8-5ce5258bc800 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:34.191880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863011d7-23b4-42e6-a6b8-5ce5258bc800 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:34.202871 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67175f-8ebe-4b76-94e8-e2bfa6f8d0dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:34.207066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67175f-8ebe-4b76-94e8-e2bfa6f8d0dd service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:34.207373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67175f-8ebe-4b76-94e8-e2bfa6f8d0dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:34.207642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67175f-8ebe-4b76-94e8-e2bfa6f8d0dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:34.235890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67175f-8ebe-4b76-94e8-e2bfa6f8d0dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:34.240165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67175f-8ebe-4b76-94e8-e2bfa6f8d0dd service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:34.297385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 809/1635] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:34 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:34.614909 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15655d79-1532-4178-9176-de122580fe34 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:34.635631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15655d79-1532-4178-9176-de122580fe34 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:34.653721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f7793-0717-4376-8a59-19ba0de1262a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:34.654348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f7793-0717-4376-8a59-19ba0de1262a service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:34.654624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f7793-0717-4376-8a59-19ba0de1262a service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:34.654920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f7793-0717-4376-8a59-19ba0de1262a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:34.857206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f7793-0717-4376-8a59-19ba0de1262a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:34.860623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f7793-0717-4376-8a59-19ba0de1262a service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:34.872921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 827/1636] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:34.895701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67175f-8ebe-4b76-94e8-e2bfa6f8d0dd service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:35.131231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67175f-8ebe-4b76-94e8-e2bfa6f8d0dd service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:35.150562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:35.167244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:35.167244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:35.167244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] PATH_INFO: `/v3/users/de9777f9cfd440c0a436890ee0fcb919` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:35.169655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9777f9cfd440c0a436890ee0fcb919)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:35.170892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: WARNING py.warnings [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:24:35.170892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: warnings.warn(msg) Sep 18 06:24:35.170892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: Sep 18 06:24:35.172992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:35.277391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:35.317879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f7793-0717-4376-8a59-19ba0de1262a service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:35.326019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9777f9cfd440c0a436890ee0fcb919'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:35.347860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9777f9cfd440c0a436890ee0fcb919'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:35.347860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9777f9cfd440c0a436890ee0fcb919'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:35.349589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9777f9cfd440c0a436890ee0fcb919'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:35.350109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f7793-0717-4376-8a59-19ba0de1262a service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:35.364463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c5bf2e78-643c-46fc-b50b-93e1db56f55f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9777f9cfd440c0a436890ee0fcb919'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:35.368054 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674faa8-eb03-4dd0-ac99-1c957b41c49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:35.368717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674faa8-eb03-4dd0-ac99-1c957b41c49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:35.368998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674faa8-eb03-4dd0-ac99-1c957b41c49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:35.369269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674faa8-eb03-4dd0-ac99-1c957b41c49e admin admin] PATH_INFO: `/v3/users/ce39e1d9fe5e4dfeb74982efbee52001` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:35.370943 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674faa8-eb03-4dd0-ac99-1c957b41c49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce39e1d9fe5e4dfeb74982efbee52001)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:35.373142 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674faa8-eb03-4dd0-ac99-1c957b41c49e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:35.418422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 810/1637] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:24:34 2022] DELETE /identity/v3/users/de9777f9cfd440c0a436890ee0fcb919 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:35.426658 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9729453-adb0-46ff-aea6-d6e5bbb254bd None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:35.427099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9729453-adb0-46ff-aea6-d6e5bbb254bd None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:35.427758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9729453-adb0-46ff-aea6-d6e5bbb254bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:35.460368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7674faa8-eb03-4dd0-ac99-1c957b41c49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce39e1d9fe5e4dfeb74982efbee52001'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:35.474979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7674faa8-eb03-4dd0-ac99-1c957b41c49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce39e1d9fe5e4dfeb74982efbee52001'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:35.476205 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7674faa8-eb03-4dd0-ac99-1c957b41c49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce39e1d9fe5e4dfeb74982efbee52001'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:35.477815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7674faa8-eb03-4dd0-ac99-1c957b41c49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce39e1d9fe5e4dfeb74982efbee52001'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:35.485644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e9729453-adb0-46ff-aea6-d6e5bbb254bd None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:35.490148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:35.493637 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e9729453-adb0-46ff-aea6-d6e5bbb254bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:35.510993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7674faa8-eb03-4dd0-ac99-1c957b41c49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce39e1d9fe5e4dfeb74982efbee52001'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:35.548423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 828/1638] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:24:35 2022] DELETE /identity/v3/users/ce39e1d9fe5e4dfeb74982efbee52001 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:35.552147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f9764-2e43-44f5-b604-8f0a9414c127 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:35.553765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f9764-2e43-44f5-b604-8f0a9414c127 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:35.554582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f9764-2e43-44f5-b604-8f0a9414c127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:35.607420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e99f9764-2e43-44f5-b604-8f0a9414c127 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:35.610495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e99f9764-2e43-44f5-b604-8f0a9414c127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:35.654265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 811/1639] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:35.680757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9729453-adb0-46ff-aea6-d6e5bbb254bd None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:35.683852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e9729453-adb0-46ff-aea6-d6e5bbb254bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:35.819602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 829/1640] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:35.845365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9729453-adb0-46ff-aea6-d6e5bbb254bd None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:35.847246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f9764-2e43-44f5-b604-8f0a9414c127 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:35.848997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e99f9764-2e43-44f5-b604-8f0a9414c127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:35.961389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a0f61-b15a-442f-8bd3-3e61065b873a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:35.962009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0f61-b15a-442f-8bd3-3e61065b873a service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:35.962288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0f61-b15a-442f-8bd3-3e61065b873a service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:35.962714 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a0f61-b15a-442f-8bd3-3e61065b873a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:35.985028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f9764-2e43-44f5-b604-8f0a9414c127 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:35.985355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a0f61-b15a-442f-8bd3-3e61065b873a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:35.986826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a0f61-b15a-442f-8bd3-3e61065b873a service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:35.991832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3d3dd-593c-4998-8733-2038c597e34d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:35.992624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d3dd-593c-4998-8733-2038c597e34d service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:35.993063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d3dd-593c-4998-8733-2038c597e34d service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:35.993616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d3dd-593c-4998-8733-2038c597e34d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:36.012272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 812/1641] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:36.013647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3d3dd-593c-4998-8733-2038c597e34d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:36.017293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3d3dd-593c-4998-8733-2038c597e34d service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:36.037694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 830/1642] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:37.599869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a0f61-b15a-442f-8bd3-3e61065b873a service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:37.601591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1a5a0f61-b15a-442f-8bd3-3e61065b873a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:37.625383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a0f61-b15a-442f-8bd3-3e61065b873a service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:37.637454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:37.638181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:37.638461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:37.638738 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] PATH_INFO: `/v3/projects/fdee6f7ceb3b48329714874f6dfabea7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:37.646250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdee6f7ceb3b48329714874f6dfabea7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:37.648279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:37.680039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:37.747153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3d3dd-593c-4998-8733-2038c597e34d service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:37.751648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f3a3d3dd-593c-4998-8733-2038c597e34d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:37.777819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3d3dd-593c-4998-8733-2038c597e34d service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:37.794891 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdee6f7ceb3b48329714874f6dfabea7', 'request_id': 'req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:37.811373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdee6f7ceb3b48329714874f6dfabea7', 'request_id': 'req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:37.836546 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdee6f7ceb3b48329714874f6dfabea7', 'request_id': 'req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:37.861469 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] The token cache is being invalidate because project fdee6f7ceb3b48329714874f6dfabea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:24:37.862007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:37.862950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:37.870283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 813/1643] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:24:37 2022] DELETE /identity/v3/projects/fdee6f7ceb3b48329714874f6dfabea7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:37.871292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:37.873575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:37.968482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f331b-48f0-47ff-bc23-67e97db8a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:37.969661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f331b-48f0-47ff-bc23-67e97db8a15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:37.969661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f331b-48f0-47ff-bc23-67e97db8a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:37.969661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f331b-48f0-47ff-bc23-67e97db8a15f admin admin] PATH_INFO: `/v3/users/ce88507ca3944b1ead3da66482046d22` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:37.974405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f331b-48f0-47ff-bc23-67e97db8a15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce88507ca3944b1ead3da66482046d22)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:37.980507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f331b-48f0-47ff-bc23-67e97db8a15f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:38.082551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:38.117189 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6ce5f-f606-451f-bbc9-a5ff60ca44df admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:38.148536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:38.151011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:38.151588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:38.152129 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] PATH_INFO: `/v3/projects/d60adef6e29047b4859efe56883798b7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:38.156654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60adef6e29047b4859efe56883798b7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:38.159381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:38.175275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-dd4f331b-48f0-47ff-bc23-67e97db8a15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce88507ca3944b1ead3da66482046d22'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.198397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-dd4f331b-48f0-47ff-bc23-67e97db8a15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce88507ca3944b1ead3da66482046d22'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.200503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-dd4f331b-48f0-47ff-bc23-67e97db8a15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce88507ca3944b1ead3da66482046d22'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.201768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-dd4f331b-48f0-47ff-bc23-67e97db8a15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce88507ca3944b1ead3da66482046d22'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.261462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-dd4f331b-48f0-47ff-bc23-67e97db8a15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce88507ca3944b1ead3da66482046d22'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.300665 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60adef6e29047b4859efe56883798b7', 'request_id': 'req-a68fdac7-75c5-4253-832c-3bbeb2e2d619'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.318060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 831/1644] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:24:37 2022] DELETE /identity/v3/users/ce88507ca3944b1ead3da66482046d22 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:24:38.318060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73713e8-d4b1-4895-9c77-82169f1ae9db None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:38.318060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73713e8-d4b1-4895-9c77-82169f1ae9db None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:38.319424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60adef6e29047b4859efe56883798b7', 'request_id': 'req-a68fdac7-75c5-4253-832c-3bbeb2e2d619'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.320142 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73713e8-d4b1-4895-9c77-82169f1ae9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:38.351765 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60adef6e29047b4859efe56883798b7', 'request_id': 'req-a68fdac7-75c5-4253-832c-3bbeb2e2d619'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.398394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] The token cache is being invalidate because project d60adef6e29047b4859efe56883798b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:24:38.400274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.400561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e73713e8-d4b1-4895-9c77-82169f1ae9db None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:38.401728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a68fdac7-75c5-4253-832c-3bbeb2e2d619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.405106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 814/1645] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:24:37 2022] DELETE /identity/v3/projects/d60adef6e29047b4859efe56883798b7 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:38.410497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e73713e8-d4b1-4895-9c77-82169f1ae9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:38.414956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1d4db-c544-42df-8930-6120be8a6897 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:38.415393 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1d4db-c544-42df-8930-6120be8a6897 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:38.415820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1d4db-c544-42df-8930-6120be8a6897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:38.470483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a5a1d4db-c544-42df-8930-6120be8a6897 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:38.471739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a5a1d4db-c544-42df-8930-6120be8a6897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:38.542710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:38.627597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 832/1646] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:38.627597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73713e8-d4b1-4895-9c77-82169f1ae9db None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:38.627891 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 815/1647] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:38.632456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e73713e8-d4b1-4895-9c77-82169f1ae9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:38.632931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58d97-e245-456b-8a6d-a307e40af865 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:38.633736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58d97-e245-456b-8a6d-a307e40af865 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:38.634410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58d97-e245-456b-8a6d-a307e40af865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:38.665805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73713e8-d4b1-4895-9c77-82169f1ae9db None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:38.681988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:38.682764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:38.683111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:38.683449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] PATH_INFO: `/v3/users/f33927035fd6453f8787f4a0d88fa18f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:38.685837 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33927035fd6453f8787f4a0d88fa18f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:38.690242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:38.721327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-afd58d97-e245-456b-8a6d-a307e40af865 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:38.730863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-afd58d97-e245-456b-8a6d-a307e40af865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:38.759164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 816/1648] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:38.759164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd58d97-e245-456b-8a6d-a307e40af865 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:38.764595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-afd58d97-e245-456b-8a6d-a307e40af865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:38.888095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33927035fd6453f8787f4a0d88fa18f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.906136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33927035fd6453f8787f4a0d88fa18f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.908175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33927035fd6453f8787f4a0d88fa18f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.909302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33927035fd6453f8787f4a0d88fa18f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.948231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33927035fd6453f8787f4a0d88fa18f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:38.988022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 833/1649] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:24:38 2022] DELETE /identity/v3/users/f33927035fd6453f8787f4a0d88fa18f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:38.991142 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:38.993421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:39.003264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd58d97-e245-456b-8a6d-a307e40af865 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:39.039098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:39.208625 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224439f1-812b-4043-ba4e-1e98dc2980e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:39.209248 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224439f1-812b-4043-ba4e-1e98dc2980e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:39.209536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224439f1-812b-4043-ba4e-1e98dc2980e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:39.209798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224439f1-812b-4043-ba4e-1e98dc2980e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:39.216971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-224439f1-812b-4043-ba4e-1e98dc2980e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:39.283238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1804a9-3da3-47a8-be3e-070d98430dfa admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:39.306385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00b38b-dafc-4c02-abdf-f0ec82e4121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:39.307015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00b38b-dafc-4c02-abdf-f0ec82e4121a admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:39.307289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00b38b-dafc-4c02-abdf-f0ec82e4121a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:39.307561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00b38b-dafc-4c02-abdf-f0ec82e4121a admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:39.308302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00b38b-dafc-4c02-abdf-f0ec82e4121a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:39.308560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00b38b-dafc-4c02-abdf-f0ec82e4121a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:39.310196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00b38b-dafc-4c02-abdf-f0ec82e4121a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:39.364990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 834/1650] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:39.369313 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00b38b-dafc-4c02-abdf-f0ec82e4121a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:39.388262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00b38b-dafc-4c02-abdf-f0ec82e4121a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:39.409276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224439f1-812b-4043-ba4e-1e98dc2980e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:39.409667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20a024-bda5-4587-bea8-492fca1b6c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:39.410296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a024-bda5-4587-bea8-492fca1b6c88 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:39.410575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a024-bda5-4587-bea8-492fca1b6c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:39.410846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20a024-bda5-4587-bea8-492fca1b6c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:39.411240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224439f1-812b-4043-ba4e-1e98dc2980e9 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:39.411480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20a024-bda5-4587-bea8-492fca1b6c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:39.413410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20a024-bda5-4587-bea8-492fca1b6c88 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:39.446405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 817/1651] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:39.478563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 835/1652] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:39 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:39.483400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224439f1-812b-4043-ba4e-1e98dc2980e9 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:39.504532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224439f1-812b-4043-ba4e-1e98dc2980e9 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:39.580307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:39.716810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa0d8f-aac8-444f-9f2d-950865bd0c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:39.717440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa0d8f-aac8-444f-9f2d-950865bd0c5a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:39.717660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa0d8f-aac8-444f-9f2d-950865bd0c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:39.717913 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa0d8f-aac8-444f-9f2d-950865bd0c5a admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:39.718650 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa0d8f-aac8-444f-9f2d-950865bd0c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:39.721459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa0d8f-aac8-444f-9f2d-950865bd0c5a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:39.783631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 818/1653] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:39 2022] POST /identity/v3/users => generated 290 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:39.785139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20a024-bda5-4587-bea8-492fca1b6c88 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:39.808484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20a024-bda5-4587-bea8-492fca1b6c88 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:39.848078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04e6e9-f9f3-4663-a32a-f419eab1f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:39.858257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04e6e9-f9f3-4663-a32a-f419eab1f384 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:39.858615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04e6e9-f9f3-4663-a32a-f419eab1f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:39.858937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04e6e9-f9f3-4663-a32a-f419eab1f384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:39.860628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04e6e9-f9f3-4663-a32a-f419eab1f384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:39.861620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04e6e9-f9f3-4663-a32a-f419eab1f384 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:39.902144 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 836/1654] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:39.905988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa0d8f-aac8-444f-9f2d-950865bd0c5a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:39.919446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa0d8f-aac8-444f-9f2d-950865bd0c5a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:39.942593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca17483-13b2-4fb6-bc0a-3e8d779e7ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:39.943281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17483-13b2-4fb6-bc0a-3e8d779e7ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:39.943560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17483-13b2-4fb6-bc0a-3e8d779e7ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:39.943837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17483-13b2-4fb6-bc0a-3e8d779e7ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:39.944599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17483-13b2-4fb6-bc0a-3e8d779e7ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:39.946272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca17483-13b2-4fb6-bc0a-3e8d779e7ef5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:39.974531 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 819/1655] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:39.978572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04e6e9-f9f3-4663-a32a-f419eab1f384 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:39.998689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04e6e9-f9f3-4663-a32a-f419eab1f384 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:40.031373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec43a1-62a1-4274-bc83-301afa64f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:40.032481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec43a1-62a1-4274-bc83-301afa64f1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:40.036951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec43a1-62a1-4274-bc83-301afa64f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:40.037460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec43a1-62a1-4274-bc83-301afa64f1bc admin admin] PATH_INFO: `/v3/projects/39f02e892fdf4d44ab14b5706382dec6/users/44dc01591b9b49a4a035c1bc29c1eccb/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:40.085048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec43a1-62a1-4274-bc83-301afa64f1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f02e892fdf4d44ab14b5706382dec6, user_id=44dc01591b9b49a4a035c1bc29c1eccb, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:40.094573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec43a1-62a1-4274-bc83-301afa64f1bc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:40.126509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 837/1656] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:39 2022] PUT /identity/v3/projects/39f02e892fdf4d44ab14b5706382dec6/users/44dc01591b9b49a4a035c1bc29c1eccb/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:40.138635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e4868-5dc2-4a84-bed7-f74c2597eca5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:40.138918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e4868-5dc2-4a84-bed7-f74c2597eca5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:40.139199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e4868-5dc2-4a84-bed7-f74c2597eca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:40.233227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-728e4868-5dc2-4a84-bed7-f74c2597eca5 None None] MFA Rules not processed for user `44dc01591b9b49a4a035c1bc29c1eccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:40.236876 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-728e4868-5dc2-4a84-bed7-f74c2597eca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:40.475450 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 820/1657] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:40.477883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec43a1-62a1-4274-bc83-301afa64f1bc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:40.621868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec43a1-62a1-4274-bc83-301afa64f1bc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:40.645603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7cde-1c12-4181-99d9-0caa046fefec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:40.646600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7cde-1c12-4181-99d9-0caa046fefec admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:40.647078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7cde-1c12-4181-99d9-0caa046fefec admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:40.647555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7cde-1c12-4181-99d9-0caa046fefec admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:40.652273 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af7cde-1c12-4181-99d9-0caa046fefec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:40.654304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af7cde-1c12-4181-99d9-0caa046fefec admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:40.730166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 838/1658] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:40 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:40.734802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e4868-5dc2-4a84-bed7-f74c2597eca5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:40.746028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e4868-5dc2-4a84-bed7-f74c2597eca5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:40.915047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c3df5-fa57-4c1e-8abd-a07306a76cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:40.915702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3df5-fa57-4c1e-8abd-a07306a76cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:40.916008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3df5-fa57-4c1e-8abd-a07306a76cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:40.916282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3df5-fa57-4c1e-8abd-a07306a76cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:40.916924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c3df5-fa57-4c1e-8abd-a07306a76cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:40.918875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c3df5-fa57-4c1e-8abd-a07306a76cc6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:40.979436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 821/1659] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:40 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:40.983457 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7cde-1c12-4181-99d9-0caa046fefec admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:41.004820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7cde-1c12-4181-99d9-0caa046fefec admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:41.022679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aace5-a9c7-4bfd-b993-1c9c64dd5515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:41.023750 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aace5-a9c7-4bfd-b993-1c9c64dd5515 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:41.043090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aace5-a9c7-4bfd-b993-1c9c64dd5515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:41.043806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aace5-a9c7-4bfd-b993-1c9c64dd5515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:41.048609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aace5-a9c7-4bfd-b993-1c9c64dd5515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:41.051154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aace5-a9c7-4bfd-b993-1c9c64dd5515 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:41.085547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 839/1660] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:41.089907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c3df5-fa57-4c1e-8abd-a07306a76cc6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:41.105858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c3df5-fa57-4c1e-8abd-a07306a76cc6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:41.121128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc749-22ac-4a97-a08c-bdb888335a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:41.121362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc749-22ac-4a97-a08c-bdb888335a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:41.121648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc749-22ac-4a97-a08c-bdb888335a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:41.121919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc749-22ac-4a97-a08c-bdb888335a64 admin admin] PATH_INFO: `/v3/projects/a984d7a3bd644775b00a56bccde30f52/users/bfa1388061d948e8b868abbddda600f2/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:41.162999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cc749-22ac-4a97-a08c-bdb888335a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a984d7a3bd644775b00a56bccde30f52, user_id=bfa1388061d948e8b868abbddda600f2, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:41.165980 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cc749-22ac-4a97-a08c-bdb888335a64 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:41.206983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 822/1661] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:41 2022] PUT /identity/v3/projects/a984d7a3bd644775b00a56bccde30f52/users/bfa1388061d948e8b868abbddda600f2/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:41.208944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aace5-a9c7-4bfd-b993-1c9c64dd5515 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:41.224181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aace5-a9c7-4bfd-b993-1c9c64dd5515 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:41.250055 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc749-22ac-4a97-a08c-bdb888335a64 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:41.253254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-db6cc749-22ac-4a97-a08c-bdb888335a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:41.260098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:41.297326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:41.355924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc749-22ac-4a97-a08c-bdb888335a64 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:41.363075 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:41.363917 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:41.364340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:41.364715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] PATH_INFO: `/v3/users/24c44fa6d1d146109d8520346780510b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:41.365987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c44fa6d1d146109d8520346780510b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:41.368120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:41.440164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefbc56-e19f-476c-8660-2fbbea4a894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:41.453048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c44fa6d1d146109d8520346780510b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:41.458462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefbc56-e19f-476c-8660-2fbbea4a894e admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:41.458984 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefbc56-e19f-476c-8660-2fbbea4a894e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:41.459954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefbc56-e19f-476c-8660-2fbbea4a894e admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:41.464167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefbc56-e19f-476c-8660-2fbbea4a894e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:41.467039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefbc56-e19f-476c-8660-2fbbea4a894e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:41.473558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c44fa6d1d146109d8520346780510b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:41.475297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c44fa6d1d146109d8520346780510b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:41.478058 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c44fa6d1d146109d8520346780510b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:41.487097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 840/1662] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:41.488703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefbc56-e19f-476c-8660-2fbbea4a894e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:41.491768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bcefbc56-e19f-476c-8660-2fbbea4a894e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:41.494133 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c44fa6d1d146109d8520346780510b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:41.509828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefbc56-e19f-476c-8660-2fbbea4a894e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:41.518358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:41.519330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:41.519674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:41.520039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] PATH_INFO: `/v3/projects/24031e3df1064a2485d1dbce09e8c835` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:41.523277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24031e3df1064a2485d1dbce09e8c835)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:41.524862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: WARNING py.warnings [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 06:24:41.524862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: warnings.warn(msg) Sep 18 06:24:41.524862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: Sep 18 06:24:41.534799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:41.542887 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 823/1663] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:24:41 2022] DELETE /identity/v3/users/24c44fa6d1d146109d8520346780510b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:41.544428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:41.548745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:41.776972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24031e3df1064a2485d1dbce09e8c835', 'request_id': 'req-1dedb21c-d1cf-45e4-8e05-ddce043e2476'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:41.851450 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126418a-4ea0-41b1-8b60-90c324f4fb4b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:41.852868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24031e3df1064a2485d1dbce09e8c835', 'request_id': 'req-1dedb21c-d1cf-45e4-8e05-ddce043e2476'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:41.877094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24031e3df1064a2485d1dbce09e8c835', 'request_id': 'req-1dedb21c-d1cf-45e4-8e05-ddce043e2476'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:41.929966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] The token cache is being invalidate because project 24031e3df1064a2485d1dbce09e8c835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:24:41.945065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:41.947955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1dedb21c-d1cf-45e4-8e05-ddce043e2476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:41.961157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 841/1664] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:24:41 2022] DELETE /identity/v3/projects/24031e3df1064a2485d1dbce09e8c835 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:41.961567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a1ff3-c8b1-4052-be80-5551ed379964 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:41.961755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a1ff3-c8b1-4052-be80-5551ed379964 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:41.962167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a1ff3-c8b1-4052-be80-5551ed379964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:41.997558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:42.065437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b88a1ff3-c8b1-4052-be80-5551ed379964 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:42.072359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b88a1ff3-c8b1-4052-be80-5551ed379964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:42.145321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0acae-448d-48a1-b441-6e768051aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:42.147007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0acae-448d-48a1-b441-6e768051aba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:42.148767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0acae-448d-48a1-b441-6e768051aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:42.149409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0acae-448d-48a1-b441-6e768051aba7 admin admin] PATH_INFO: `/v3/projects/a984d7a3bd644775b00a56bccde30f52/users/bfa1388061d948e8b868abbddda600f2/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:42.154350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0acae-448d-48a1-b441-6e768051aba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a984d7a3bd644775b00a56bccde30f52, user_id=bfa1388061d948e8b868abbddda600f2, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:42.167290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0acae-448d-48a1-b441-6e768051aba7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:42.217723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 824/1665] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:41 2022] PUT /identity/v3/projects/a984d7a3bd644775b00a56bccde30f52/users/bfa1388061d948e8b868abbddda600f2/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:42.219616 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d87cbf-3149-4581-8735-9840be108943 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:42.221868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d87cbf-3149-4581-8735-9840be108943 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:42.222304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d87cbf-3149-4581-8735-9840be108943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:42.306677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e6d87cbf-3149-4581-8735-9840be108943 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:42.309005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e6d87cbf-3149-4581-8735-9840be108943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:42.370007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 842/1666] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:42.371471 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e950bd-4471-4b98-9f9a-b3a51a166b18 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:42.371882 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e950bd-4471-4b98-9f9a-b3a51a166b18 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:42.372256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e950bd-4471-4b98-9f9a-b3a51a166b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:42.432216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-39e950bd-4471-4b98-9f9a-b3a51a166b18 None None] MFA Rules not processed for user `bfa1388061d948e8b868abbddda600f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:42.433849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-39e950bd-4471-4b98-9f9a-b3a51a166b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:42.481752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:42.493354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 825/1667] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:42.495827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d87cbf-3149-4581-8735-9840be108943 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:42.500176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e6d87cbf-3149-4581-8735-9840be108943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:42.555884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 843/1668] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:42.556913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e950bd-4471-4b98-9f9a-b3a51a166b18 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:42.558636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-39e950bd-4471-4b98-9f9a-b3a51a166b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:42.585550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d87cbf-3149-4581-8735-9840be108943 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:42.585839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e950bd-4471-4b98-9f9a-b3a51a166b18 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:42.590493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee6801-ef5e-4694-a378-c140c6f7f72b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:42.591348 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee6801-ef5e-4694-a378-c140c6f7f72b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:42.591830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee6801-ef5e-4694-a378-c140c6f7f72b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:42.592183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee6801-ef5e-4694-a378-c140c6f7f72b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:42.598646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:42.598991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:42.599253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:42.599525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] PATH_INFO: `/v3/projects/7d835c06aff44cf188682a40bf513323` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:42.602864 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d835c06aff44cf188682a40bf513323)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:42.605092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:42.605394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee6801-ef5e-4694-a378-c140c6f7f72b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:42.607431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee6801-ef5e-4694-a378-c140c6f7f72b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:42.622620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 826/1669] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:42.624552 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c989b1-e404-493b-b3f5-12753ad2d67c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:42.625112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c989b1-e404-493b-b3f5-12753ad2d67c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:42.625508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c989b1-e404-493b-b3f5-12753ad2d67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:42.650982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-59c989b1-e404-493b-b3f5-12753ad2d67c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:42.652522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-59c989b1-e404-493b-b3f5-12753ad2d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:42.679573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 827/1670] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:42.683034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c989b1-e404-493b-b3f5-12753ad2d67c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:42.686706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-59c989b1-e404-493b-b3f5-12753ad2d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:42.699183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d835c06aff44cf188682a40bf513323', 'request_id': 'req-b2236a7d-c21d-4835-8895-52acb40ba462'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:42.706667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d835c06aff44cf188682a40bf513323', 'request_id': 'req-b2236a7d-c21d-4835-8895-52acb40ba462'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:42.719096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d835c06aff44cf188682a40bf513323', 'request_id': 'req-b2236a7d-c21d-4835-8895-52acb40ba462'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:42.733551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] The token cache is being invalidate because project 7d835c06aff44cf188682a40bf513323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:24:42.734261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:42.735324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:42.737172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 844/1671] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:24:42 2022] DELETE /identity/v3/projects/7d835c06aff44cf188682a40bf513323 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:42.742193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:42.744270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:42.782931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c989b1-e404-493b-b3f5-12753ad2d67c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:42.801356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:42.840675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2236a7d-c21d-4835-8895-52acb40ba462 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:42.849056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f06c7d-27d7-448e-9346-f9fc35b95467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:42.849961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f06c7d-27d7-448e-9346-f9fc35b95467 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:42.850453 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f06c7d-27d7-448e-9346-f9fc35b95467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:42.850935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f06c7d-27d7-448e-9346-f9fc35b95467 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:42.851820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f06c7d-27d7-448e-9346-f9fc35b95467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:42.852360 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f06c7d-27d7-448e-9346-f9fc35b95467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:42.854308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f06c7d-27d7-448e-9346-f9fc35b95467 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:42.870292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 845/1672] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:42.872102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7d5d8-72e3-4427-8b2a-8bd36b6b7026 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:42.872652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7d5d8-72e3-4427-8b2a-8bd36b6b7026 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:42.873083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7d5d8-72e3-4427-8b2a-8bd36b6b7026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:42.883120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6610d7f-1748-4428-a0d0-34880e87667c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:42.884694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6610d7f-1748-4428-a0d0-34880e87667c service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:42.884694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6610d7f-1748-4428-a0d0-34880e87667c service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:42.884694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6610d7f-1748-4428-a0d0-34880e87667c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:42.886724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a6610d7f-1748-4428-a0d0-34880e87667c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:42.896933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-17c7d5d8-72e3-4427-8b2a-8bd36b6b7026 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:42.899280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-17c7d5d8-72e3-4427-8b2a-8bd36b6b7026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:42.916655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 846/1673] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:42.918351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7d5d8-72e3-4427-8b2a-8bd36b6b7026 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:42.930468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7d5d8-72e3-4427-8b2a-8bd36b6b7026 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:42.938763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f098e3-d58a-429d-86df-f5921fbd895e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:42.939512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f098e3-d58a-429d-86df-f5921fbd895e admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:42.939838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f098e3-d58a-429d-86df-f5921fbd895e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:42.940169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f098e3-d58a-429d-86df-f5921fbd895e admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:42.940905 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f098e3-d58a-429d-86df-f5921fbd895e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:42.943053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f098e3-d58a-429d-86df-f5921fbd895e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:42.978434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 847/1674] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:42 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:42.980978 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeb2ca-c789-46df-926b-1438116218b0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:42.981121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6610d7f-1748-4428-a0d0-34880e87667c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:42.981260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeb2ca-c789-46df-926b-1438116218b0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:42.981580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeb2ca-c789-46df-926b-1438116218b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:42.982582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6610d7f-1748-4428-a0d0-34880e87667c service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:43.000999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 828/1675] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:43.003600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6610d7f-1748-4428-a0d0-34880e87667c service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:43.006688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7aaeb2ca-c789-46df-926b-1438116218b0 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:43.008092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7aaeb2ca-c789-46df-926b-1438116218b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:43.022987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:43.052203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6610d7f-1748-4428-a0d0-34880e87667c service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:43.123140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 848/1676] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:43.124155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaeb2ca-c789-46df-926b-1438116218b0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:43.136169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaeb2ca-c789-46df-926b-1438116218b0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:43.143863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea41b3a-fea9-4fc7-836f-d01139cf246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:43.144591 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea41b3a-fea9-4fc7-836f-d01139cf246e admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.145441 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea41b3a-fea9-4fc7-836f-d01139cf246e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.145719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea41b3a-fea9-4fc7-836f-d01139cf246e admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.146616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea41b3a-fea9-4fc7-836f-d01139cf246e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:43.146997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea41b3a-fea9-4fc7-836f-d01139cf246e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:43.148904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea41b3a-fea9-4fc7-836f-d01139cf246e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:43.165428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 849/1677] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:43.171840 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea41b3a-fea9-4fc7-836f-d01139cf246e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:43.190022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea41b3a-fea9-4fc7-836f-d01139cf246e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:43.196021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e57ab7-51a7-46fa-aa20-b4e5a3dbdd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:43.196691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e57ab7-51a7-46fa-aa20-b4e5a3dbdd0d admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.196973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e57ab7-51a7-46fa-aa20-b4e5a3dbdd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.197293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e57ab7-51a7-46fa-aa20-b4e5a3dbdd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.197935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e57ab7-51a7-46fa-aa20-b4e5a3dbdd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:43.200576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e57ab7-51a7-46fa-aa20-b4e5a3dbdd0d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:43.250571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 850/1678] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:43 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:43.264569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e57ab7-51a7-46fa-aa20-b4e5a3dbdd0d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:43.278691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be7cd-5adb-41f0-871b-9bfcd52896d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:43.293132 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be7cd-5adb-41f0-871b-9bfcd52896d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.293428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be7cd-5adb-41f0-871b-9bfcd52896d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.293707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be7cd-5adb-41f0-871b-9bfcd52896d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.294366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55be7cd-5adb-41f0-871b-9bfcd52896d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:43.306746 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55be7cd-5adb-41f0-871b-9bfcd52896d0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:43.393206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 829/1679] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:43 2022] POST /identity/v3/users => generated 287 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:43.399386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be7cd-5adb-41f0-871b-9bfcd52896d0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:43.413522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e57ab7-51a7-46fa-aa20-b4e5a3dbdd0d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:43.429174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a792c-956c-46a0-a61f-872616b0b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:43.430817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be7cd-5adb-41f0-871b-9bfcd52896d0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:43.431578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a792c-956c-46a0-a61f-872616b0b3fc admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.431988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a792c-956c-46a0-a61f-872616b0b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.432344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a792c-956c-46a0-a61f-872616b0b3fc admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.434467 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a792c-956c-46a0-a61f-872616b0b3fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:43.439164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a792c-956c-46a0-a61f-872616b0b3fc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:43.448442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbac61f-48be-4819-a63f-8b1cf4269550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:43.451944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbac61f-48be-4819-a63f-8b1cf4269550 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.453334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbac61f-48be-4819-a63f-8b1cf4269550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.453619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbac61f-48be-4819-a63f-8b1cf4269550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.455691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbac61f-48be-4819-a63f-8b1cf4269550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:43.458008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbac61f-48be-4819-a63f-8b1cf4269550 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:43.495864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 830/1680] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:43.502715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbac61f-48be-4819-a63f-8b1cf4269550 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:43.514318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 851/1681] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:43 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:43.515593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a792c-956c-46a0-a61f-872616b0b3fc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:43.551233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbac61f-48be-4819-a63f-8b1cf4269550 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:43.555214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a792c-956c-46a0-a61f-872616b0b3fc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:43.564891 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055247f-01d4-4353-ba59-a5898a83e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:43.567446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055247f-01d4-4353-ba59-a5898a83e15e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.567937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfa670-421a-4f0e-b68e-3de807e738d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:43.568153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055247f-01d4-4353-ba59-a5898a83e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.568602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055247f-01d4-4353-ba59-a5898a83e15e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.569289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfa670-421a-4f0e-b68e-3de807e738d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.570321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055247f-01d4-4353-ba59-a5898a83e15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:43.570447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfa670-421a-4f0e-b68e-3de807e738d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.570794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfa670-421a-4f0e-b68e-3de807e738d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.572235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfa670-421a-4f0e-b68e-3de807e738d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:43.574573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055247f-01d4-4353-ba59-a5898a83e15e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:43.576847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfa670-421a-4f0e-b68e-3de807e738d6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:43.612464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 831/1682] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:43.614776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055247f-01d4-4353-ba59-a5898a83e15e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:43.619686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 852/1683] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:43.621284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfa670-421a-4f0e-b68e-3de807e738d6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:43.637346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfa670-421a-4f0e-b68e-3de807e738d6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:43.642224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055247f-01d4-4353-ba59-a5898a83e15e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:43.646213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c09b8-0819-4b14-b0e6-eb59e6b71fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:43.647093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c09b8-0819-4b14-b0e6-eb59e6b71fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.647438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c09b8-0819-4b14-b0e6-eb59e6b71fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.647873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c09b8-0819-4b14-b0e6-eb59e6b71fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.651180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c09b8-0819-4b14-b0e6-eb59e6b71fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:43.652729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d64d89-bc5b-4ee7-8425-4255d4ee6461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:43.653187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c09b8-0819-4b14-b0e6-eb59e6b71fb8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:43.654377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64d89-bc5b-4ee7-8425-4255d4ee6461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.654740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64d89-bc5b-4ee7-8425-4255d4ee6461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.655842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64d89-bc5b-4ee7-8425-4255d4ee6461 admin admin] PATH_INFO: `/v3/projects/cb393d4bafcc45c790ccb2951b1299e4/users/e9ee7d217bc845b399915ae0043a9da5/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.673695 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 853/1684] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:43.674951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c09b8-0819-4b14-b0e6-eb59e6b71fb8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:43.691772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c09b8-0819-4b14-b0e6-eb59e6b71fb8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:43.693727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d64d89-bc5b-4ee7-8425-4255d4ee6461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb393d4bafcc45c790ccb2951b1299e4, user_id=e9ee7d217bc845b399915ae0043a9da5, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:43.698136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fd8c8-e947-41b6-826d-b74b62b38928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:43.698962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fd8c8-e947-41b6-826d-b74b62b38928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.699321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fd8c8-e947-41b6-826d-b74b62b38928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.699699 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fd8c8-e947-41b6-826d-b74b62b38928 admin admin] PATH_INFO: `/v3/projects/502f9b76995e4ddf8347907359ac61ad/users/878b41bb5fb548f69f6427cdecd29447/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.700767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d64d89-bc5b-4ee7-8425-4255d4ee6461 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:43.723741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fd8c8-e947-41b6-826d-b74b62b38928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502f9b76995e4ddf8347907359ac61ad, user_id=878b41bb5fb548f69f6427cdecd29447, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:43.727881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fd8c8-e947-41b6-826d-b74b62b38928 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:43.738138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 832/1685] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:43 2022] PUT /identity/v3/projects/cb393d4bafcc45c790ccb2951b1299e4/users/e9ee7d217bc845b399915ae0043a9da5/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:43.740071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254f4ba-56e9-4cc4-be97-f96901673b15 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.740597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254f4ba-56e9-4cc4-be97-f96901673b15 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.740973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254f4ba-56e9-4cc4-be97-f96901673b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.751196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 854/1686] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:43 2022] PUT /identity/v3/projects/502f9b76995e4ddf8347907359ac61ad/users/878b41bb5fb548f69f6427cdecd29447/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:43.763780 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d892b0a-31f0-49e1-84fc-8b9c1043c685 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:43.764195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d892b0a-31f0-49e1-84fc-8b9c1043c685 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:43.764484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d892b0a-31f0-49e1-84fc-8b9c1043c685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:43.808268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:43.825904 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1254f4ba-56e9-4cc4-be97-f96901673b15 None None] MFA Rules not processed for user `e9ee7d217bc845b399915ae0043a9da5`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:43.827158 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1254f4ba-56e9-4cc4-be97-f96901673b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:43.848796 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7d892b0a-31f0-49e1-84fc-8b9c1043c685 None None] MFA Rules not processed for user `878b41bb5fb548f69f6427cdecd29447`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:43.850033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7d892b0a-31f0-49e1-84fc-8b9c1043c685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:43.876182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:44.017643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 855/1687] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:24:44.030498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d892b0a-31f0-49e1-84fc-8b9c1043c685 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:44.032288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7d892b0a-31f0-49e1-84fc-8b9c1043c685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:44.086397 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 833/1688] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:44.091077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254f4ba-56e9-4cc4-be97-f96901673b15 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:44.167575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d892b0a-31f0-49e1-84fc-8b9c1043c685 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:44.172169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c46c93-4f27-46dd-825f-dac2f6f3af83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:44.173019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c46c93-4f27-46dd-825f-dac2f6f3af83 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:44.173294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c46c93-4f27-46dd-825f-dac2f6f3af83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:44.173561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c46c93-4f27-46dd-825f-dac2f6f3af83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:44.195776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c46c93-4f27-46dd-825f-dac2f6f3af83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:44.197406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c46c93-4f27-46dd-825f-dac2f6f3af83 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:44.219982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 856/1689] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:44.278544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254f4ba-56e9-4cc4-be97-f96901673b15 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:44.287879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786abcc7-7af3-470d-bbe1-cfb204e69cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:44.288534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786abcc7-7af3-470d-bbe1-cfb204e69cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:44.288815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786abcc7-7af3-470d-bbe1-cfb204e69cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:44.289089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786abcc7-7af3-470d-bbe1-cfb204e69cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:44.292121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786abcc7-7af3-470d-bbe1-cfb204e69cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:44.298546 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786abcc7-7af3-470d-bbe1-cfb204e69cf9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:44.354923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 834/1690] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:44 2022] POST /identity/v3/projects => generated 373 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:44.360806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c46c93-4f27-46dd-825f-dac2f6f3af83 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:44.386268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c46c93-4f27-46dd-825f-dac2f6f3af83 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:44.575454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d01fc-7f57-41e1-a6fe-a63f2552e18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:44.580019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d01fc-7f57-41e1-a6fe-a63f2552e18c admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:44.581019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d01fc-7f57-41e1-a6fe-a63f2552e18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:44.582868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d01fc-7f57-41e1-a6fe-a63f2552e18c admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:44.586010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d01fc-7f57-41e1-a6fe-a63f2552e18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:44.590447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d01fc-7f57-41e1-a6fe-a63f2552e18c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:44.634112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 857/1691] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:44 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:44.637452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786abcc7-7af3-470d-bbe1-cfb204e69cf9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:44.655453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786abcc7-7af3-470d-bbe1-cfb204e69cf9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:44.663001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85defc-dae3-499e-9bd0-3dde4205f745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:44.664217 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85defc-dae3-499e-9bd0-3dde4205f745 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:44.664841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85defc-dae3-499e-9bd0-3dde4205f745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:44.664946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85defc-dae3-499e-9bd0-3dde4205f745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:44.665740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85defc-dae3-499e-9bd0-3dde4205f745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:44.668037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85defc-dae3-499e-9bd0-3dde4205f745 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:44.701220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 835/1692] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:24:44.706089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d01fc-7f57-41e1-a6fe-a63f2552e18c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:44.756260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d01fc-7f57-41e1-a6fe-a63f2552e18c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:44.768991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6af746-423b-4a15-bd46-eb4ccfb3d773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:44.774539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af746-423b-4a15-bd46-eb4ccfb3d773 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:44.776019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af746-423b-4a15-bd46-eb4ccfb3d773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:44.777272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af746-423b-4a15-bd46-eb4ccfb3d773 admin admin] PATH_INFO: `/v3/projects/3e730361935b4d1fb6cef31f517e1c16/users/4d14a096004c4442a8844fe3ec3580fe/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:44.857804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6af746-423b-4a15-bd46-eb4ccfb3d773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e730361935b4d1fb6cef31f517e1c16, user_id=4d14a096004c4442a8844fe3ec3580fe, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:44.868768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6af746-423b-4a15-bd46-eb4ccfb3d773 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:44.871175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85defc-dae3-499e-9bd0-3dde4205f745 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:44.873718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-da85defc-dae3-499e-9bd0-3dde4205f745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:44.901480 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85defc-dae3-499e-9bd0-3dde4205f745 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:44.903556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 858/1693] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:44 2022] PUT /identity/v3/projects/3e730361935b4d1fb6cef31f517e1c16/users/4d14a096004c4442a8844fe3ec3580fe/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:44.909329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6af746-423b-4a15-bd46-eb4ccfb3d773 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:44.985243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:45.110166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:45.111097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:45.111380 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:45.111654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] PATH_INFO: `/v3/projects/1124a72ba9a64b26a4bb32589d78c35d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:45.115463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1124a72ba9a64b26a4bb32589d78c35d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:45.117416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:45.148227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6af746-423b-4a15-bd46-eb4ccfb3d773 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:45.155007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e77d9e-a268-4443-9fb3-bb4e525943c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:45.156316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77d9e-a268-4443-9fb3-bb4e525943c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:45.156585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77d9e-a268-4443-9fb3-bb4e525943c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:45.156864 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77d9e-a268-4443-9fb3-bb4e525943c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:45.157560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e77d9e-a268-4443-9fb3-bb4e525943c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:45.159250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e77d9e-a268-4443-9fb3-bb4e525943c5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:45.181701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 859/1694] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:45.182707 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e77d9e-a268-4443-9fb3-bb4e525943c5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:45.187447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a4e77d9e-a268-4443-9fb3-bb4e525943c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:45.211287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:45.276892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e77d9e-a268-4443-9fb3-bb4e525943c5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:45.288268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1124a72ba9a64b26a4bb32589d78c35d', 'request_id': 'req-95084dc7-a415-45f2-8aed-a09f61b57aa6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:45.305978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1124a72ba9a64b26a4bb32589d78c35d', 'request_id': 'req-95084dc7-a415-45f2-8aed-a09f61b57aa6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:45.333086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1124a72ba9a64b26a4bb32589d78c35d', 'request_id': 'req-95084dc7-a415-45f2-8aed-a09f61b57aa6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:45.347043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc411aac-ef4b-4e89-a4cf-170b03010c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:45.348280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411aac-ef4b-4e89-a4cf-170b03010c34 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:45.348280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411aac-ef4b-4e89-a4cf-170b03010c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:45.348546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411aac-ef4b-4e89-a4cf-170b03010c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:45.360940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dc411aac-ef4b-4e89-a4cf-170b03010c34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:45.370645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] The token cache is being invalidate because project 1124a72ba9a64b26a4bb32589d78c35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:24:45.370994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:45.373656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:45.376651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 836/1695] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:24:44 2022] DELETE /identity/v3/projects/1124a72ba9a64b26a4bb32589d78c35d => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:45.377471 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:45.384364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:45.456750 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc411aac-ef4b-4e89-a4cf-170b03010c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:45.459074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc411aac-ef4b-4e89-a4cf-170b03010c34 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:45.485148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 860/1696] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:45.488393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9185b-8d8f-4d0f-acaa-18dc6c270ad9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:45.488756 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9185b-8d8f-4d0f-acaa-18dc6c270ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:45.489104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9185b-8d8f-4d0f-acaa-18dc6c270ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:45.514686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-75e9185b-8d8f-4d0f-acaa-18dc6c270ad9 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:45.516766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-75e9185b-8d8f-4d0f-acaa-18dc6c270ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:45.549475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:45.622366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95084dc7-a415-45f2-8aed-a09f61b57aa6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:45.627365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 861/1697] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:45.636855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc21e9a-2af5-4cab-84cd-c3a6535f243c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:45.637481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc21e9a-2af5-4cab-84cd-c3a6535f243c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:45.638261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc21e9a-2af5-4cab-84cd-c3a6535f243c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:45.648852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ccb54-b05a-4782-8c07-3177f8c1b0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:45.654007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ccb54-b05a-4782-8c07-3177f8c1b0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:45.655892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ccb54-b05a-4782-8c07-3177f8c1b0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:45.657256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ccb54-b05a-4782-8c07-3177f8c1b0eb admin admin] PATH_INFO: `/v3/projects/3e730361935b4d1fb6cef31f517e1c16/users/4d14a096004c4442a8844fe3ec3580fe/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:45.663572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ccb54-b05a-4782-8c07-3177f8c1b0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e730361935b4d1fb6cef31f517e1c16, user_id=4d14a096004c4442a8844fe3ec3580fe, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:45.672864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ccb54-b05a-4782-8c07-3177f8c1b0eb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:45.706062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 837/1698] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:45 2022] PUT /identity/v3/projects/3e730361935b4d1fb6cef31f517e1c16/users/4d14a096004c4442a8844fe3ec3580fe/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:45.721927 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a91ba8-ecb2-4351-816d-4b8e43ec4793 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:45.722271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a91ba8-ecb2-4351-816d-4b8e43ec4793 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:45.722652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a91ba8-ecb2-4351-816d-4b8e43ec4793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:45.729104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fdc21e9a-2af5-4cab-84cd-c3a6535f243c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:45.730661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fdc21e9a-2af5-4cab-84cd-c3a6535f243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:45.795410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-24a91ba8-ecb2-4351-816d-4b8e43ec4793 None None] MFA Rules not processed for user `4d14a096004c4442a8844fe3ec3580fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:45.799150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-24a91ba8-ecb2-4351-816d-4b8e43ec4793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:45.883369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 862/1699] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:24:45.885954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc21e9a-2af5-4cab-84cd-c3a6535f243c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:45.915392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc21e9a-2af5-4cab-84cd-c3a6535f243c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:45.934350 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6591ab-8982-4873-ab03-19d20c479ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:45.935373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6591ab-8982-4873-ab03-19d20c479ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:45.935651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6591ab-8982-4873-ab03-19d20c479ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:45.935932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6591ab-8982-4873-ab03-19d20c479ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:45.936639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6591ab-8982-4873-ab03-19d20c479ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:45.938121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6591ab-8982-4873-ab03-19d20c479ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:45.940020 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6591ab-8982-4873-ab03-19d20c479ca3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:45.981792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 863/1700] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:45.986537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6591ab-8982-4873-ab03-19d20c479ca3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:46.009038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6591ab-8982-4873-ab03-19d20c479ca3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:46.017290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 838/1701] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:46.023383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f26d79-04ed-4ff7-8d97-a6baada8c4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:46.024036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f26d79-04ed-4ff7-8d97-a6baada8c4ca admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:46.024316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f26d79-04ed-4ff7-8d97-a6baada8c4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:46.024589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f26d79-04ed-4ff7-8d97-a6baada8c4ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:46.028407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f26d79-04ed-4ff7-8d97-a6baada8c4ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:46.035352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f26d79-04ed-4ff7-8d97-a6baada8c4ca admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:46.036485 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a91ba8-ecb2-4351-816d-4b8e43ec4793 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:46.040763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-24a91ba8-ecb2-4351-816d-4b8e43ec4793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:46.117003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 864/1702] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:45 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:46.120207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f26d79-04ed-4ff7-8d97-a6baada8c4ca admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:46.164337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:46.274527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a91ba8-ecb2-4351-816d-4b8e43ec4793 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:46.293961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f26d79-04ed-4ff7-8d97-a6baada8c4ca admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:46.306065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21372bc-7cb5-4f5a-aa02-88ad0e58a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:46.306701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21372bc-7cb5-4f5a-aa02-88ad0e58a979 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:46.306984 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21372bc-7cb5-4f5a-aa02-88ad0e58a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:46.307304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21372bc-7cb5-4f5a-aa02-88ad0e58a979 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:46.307887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21372bc-7cb5-4f5a-aa02-88ad0e58a979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:46.315006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21372bc-7cb5-4f5a-aa02-88ad0e58a979 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:46.366846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 865/1703] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:46 2022] POST /identity/v3/users => generated 303 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:24:46.368093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21372bc-7cb5-4f5a-aa02-88ad0e58a979 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:46.388741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21372bc-7cb5-4f5a-aa02-88ad0e58a979 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:46.410010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effcefe-8583-4b2b-aae6-c665f4219d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:46.410645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effcefe-8583-4b2b-aae6-c665f4219d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:46.410929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effcefe-8583-4b2b-aae6-c665f4219d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:46.411204 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effcefe-8583-4b2b-aae6-c665f4219d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:46.415634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0c091-d7be-4770-b880-6d95a924c910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:46.417252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0c091-d7be-4770-b880-6d95a924c910 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:46.418093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0c091-d7be-4770-b880-6d95a924c910 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:46.418465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effcefe-8583-4b2b-aae6-c665f4219d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:46.418859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0c091-d7be-4770-b880-6d95a924c910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:46.420467 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effcefe-8583-4b2b-aae6-c665f4219d1b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:46.451131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 866/1704] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:46.453681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effcefe-8583-4b2b-aae6-c665f4219d1b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:46.477234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effcefe-8583-4b2b-aae6-c665f4219d1b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:46.503569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0a6e9-c5f7-4bb4-9c6d-ce9cc0318744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:46.503569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0a6e9-c5f7-4bb4-9c6d-ce9cc0318744 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:46.503569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0a6e9-c5f7-4bb4-9c6d-ce9cc0318744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:46.503569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0a6e9-c5f7-4bb4-9c6d-ce9cc0318744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:46.504312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0a6e9-c5f7-4bb4-9c6d-ce9cc0318744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:46.504312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0a6e9-c5f7-4bb4-9c6d-ce9cc0318744 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:46.504312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:46.528240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 867/1705] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:46.531548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe494c-ecdb-4240-9e37-0e4ee4c5fcf2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:46.531830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe494c-ecdb-4240-9e37-0e4ee4c5fcf2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:46.532192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe494c-ecdb-4240-9e37-0e4ee4c5fcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:46.609459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a5fe494c-ecdb-4240-9e37-0e4ee4c5fcf2 None None] MFA Rules not processed for user `11898a78089f407aa67cae2c48f99d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:46.613061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a5fe494c-ecdb-4240-9e37-0e4ee4c5fcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:46.637446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0c091-d7be-4770-b880-6d95a924c910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:46.647870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0c091-d7be-4770-b880-6d95a924c910 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:46.678409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 839/1706] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:46.679389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0c091-d7be-4770-b880-6d95a924c910 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:46.719416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0c091-d7be-4770-b880-6d95a924c910 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:46.736971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f28e-b478-4b2b-b7cf-25cd862f8a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:46.737715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f28e-b478-4b2b-b7cf-25cd862f8a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:46.737950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f28e-b478-4b2b-b7cf-25cd862f8a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:46.743963 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f28e-b478-4b2b-b7cf-25cd862f8a44 admin admin] PATH_INFO: `/v3/projects/678745af53284b9d9de1013a0e78b5b5/users/5c1b82de83744122b2888e1940c23087/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:46.794772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71f28e-b478-4b2b-b7cf-25cd862f8a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=678745af53284b9d9de1013a0e78b5b5, user_id=5c1b82de83744122b2888e1940c23087, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:46.797669 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71f28e-b478-4b2b-b7cf-25cd862f8a44 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:46.818418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 868/1707] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:46.847981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 840/1708] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:46 2022] PUT /identity/v3/projects/678745af53284b9d9de1013a0e78b5b5/users/5c1b82de83744122b2888e1940c23087/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:46.857407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef040e-01a8-4902-b7a8-494308e0ecea None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:46.859554 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f28e-b478-4b2b-b7cf-25cd862f8a44 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:46.864519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ff71f28e-b478-4b2b-b7cf-25cd862f8a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:46.876937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef040e-01a8-4902-b7a8-494308e0ecea None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:46.878256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef040e-01a8-4902-b7a8-494308e0ecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:46.970290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f8ef040e-01a8-4902-b7a8-494308e0ecea None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:46.970804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f8ef040e-01a8-4902-b7a8-494308e0ecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:47.042609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f28e-b478-4b2b-b7cf-25cd862f8a44 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:47.057317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ad50a-9235-45cc-841a-d3bc3217d406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:47.057964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ad50a-9235-45cc-841a-d3bc3217d406 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:47.058892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ad50a-9235-45cc-841a-d3bc3217d406 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:47.059179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ad50a-9235-45cc-841a-d3bc3217d406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:47.098313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:47.237174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 869/1709] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:47.237809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef040e-01a8-4902-b7a8-494308e0ecea None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:47.242961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f8ef040e-01a8-4902-b7a8-494308e0ecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:47.316970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ad50a-9235-45cc-841a-d3bc3217d406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:47.327018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ad50a-9235-45cc-841a-d3bc3217d406 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:47.388716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 841/1710] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:47.404388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ad50a-9235-45cc-841a-d3bc3217d406 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:47.411476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6f7ad50a-9235-45cc-841a-d3bc3217d406 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:47.517343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef040e-01a8-4902-b7a8-494308e0ecea None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:47.561554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68d4d9-e308-4545-89c0-661bb1dc18ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:47.562198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d4d9-e308-4545-89c0-661bb1dc18ed service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:47.564952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d4d9-e308-4545-89c0-661bb1dc18ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:47.565255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d4d9-e308-4545-89c0-661bb1dc18ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:47.576026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9c68d4d9-e308-4545-89c0-661bb1dc18ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:47.637998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ad50a-9235-45cc-841a-d3bc3217d406 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:47.650081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae45b83-ab84-48df-b745-32c3939eae77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:47.650720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45b83-ab84-48df-b745-32c3939eae77 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:47.654686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45b83-ab84-48df-b745-32c3939eae77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:47.656260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45b83-ab84-48df-b745-32c3939eae77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:47.708788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae45b83-ab84-48df-b745-32c3939eae77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:47.715819 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae45b83-ab84-48df-b745-32c3939eae77 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:47.749746 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 842/1711] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:47.758647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:47.873430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68d4d9-e308-4545-89c0-661bb1dc18ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:47.886497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68d4d9-e308-4545-89c0-661bb1dc18ed service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:47.921968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 870/1712] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:48.152166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369e7ea-4711-4fc8-8816-6346d6357ff5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:48.152453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369e7ea-4711-4fc8-8816-6346d6357ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:48.152782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369e7ea-4711-4fc8-8816-6346d6357ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:48.223063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c369e7ea-4711-4fc8-8816-6346d6357ff5 None None] MFA Rules not processed for user `2846f016f36f4c61a6ec959478f2dcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:48.225846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c369e7ea-4711-4fc8-8816-6346d6357ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:48.464437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 843/1713] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:48.475167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122629-ea43-48b7-85ea-af1fc62a4662 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:48.475453 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122629-ea43-48b7-85ea-af1fc62a4662 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:48.475941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122629-ea43-48b7-85ea-af1fc62a4662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:48.556728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e3122629-ea43-48b7-85ea-af1fc62a4662 None None] MFA Rules not processed for user `2846f016f36f4c61a6ec959478f2dcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:48.566121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e3122629-ea43-48b7-85ea-af1fc62a4662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:48.589729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 871/1714] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:48.602119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369e7ea-4711-4fc8-8816-6346d6357ff5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:48.638270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369e7ea-4711-4fc8-8816-6346d6357ff5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:48.659501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a75d0b-249c-47d2-be5c-398eacd49cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:48.661586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a75d0b-249c-47d2-be5c-398eacd49cee service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:48.662693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a75d0b-249c-47d2-be5c-398eacd49cee service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:48.663130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a75d0b-249c-47d2-be5c-398eacd49cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:48.681422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a75d0b-249c-47d2-be5c-398eacd49cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:48.683666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a75d0b-249c-47d2-be5c-398eacd49cee service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:48.698906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 844/1715] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:50.474278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14196f-87b6-4714-a659-0c1a365a4499 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:50.475628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14196f-87b6-4714-a659-0c1a365a4499 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:50.476075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14196f-87b6-4714-a659-0c1a365a4499 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:50.478071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 872/1716] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 18 06:24:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:24:50.486710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8cc3b-f35c-4211-9772-62933644d0cc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:50.487156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8cc3b-f35c-4211-9772-62933644d0cc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:50.487320 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8cc3b-f35c-4211-9772-62933644d0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:50.565715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8000d2-95c5-458d-943a-c5e34626c8cd None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:50.566252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8000d2-95c5-458d-943a-c5e34626c8cd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:50.566893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8000d2-95c5-458d-943a-c5e34626c8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:50.628989 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-abf8cc3b-f35c-4211-9772-62933644d0cc None None] MFA Rules not processed for user `1d78e909fc894ddd9b35ead5fe68b898`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:50.631619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-abf8cc3b-f35c-4211-9772-62933644d0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:50.650027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cd8000d2-95c5-458d-943a-c5e34626c8cd None None] MFA Rules not processed for user `b805252c0e714dbcb305ad156ed58113`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:50.651990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cd8000d2-95c5-458d-943a-c5e34626c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:50.675679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 845/1717] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:24:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:50.739391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8cc3b-f35c-4211-9772-62933644d0cc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:50.745634 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 873/1718] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:24:50.751606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:50.762031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8cc3b-f35c-4211-9772-62933644d0cc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:50.772409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f97cad-80a8-48cc-82ee-6c20dc0a2190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:50.778489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f97cad-80a8-48cc-82ee-6c20dc0a2190 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:50.778909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f97cad-80a8-48cc-82ee-6c20dc0a2190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:50.779221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f97cad-80a8-48cc-82ee-6c20dc0a2190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:50.807645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f97cad-80a8-48cc-82ee-6c20dc0a2190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:50.818680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f97cad-80a8-48cc-82ee-6c20dc0a2190 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:50.864721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 846/1719] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:24:50.948022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8000d2-95c5-458d-943a-c5e34626c8cd None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:50.948641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cd8000d2-95c5-458d-943a-c5e34626c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:50.961073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f97cad-80a8-48cc-82ee-6c20dc0a2190 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:50.962538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-74f97cad-80a8-48cc-82ee-6c20dc0a2190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:50.987440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f97cad-80a8-48cc-82ee-6c20dc0a2190 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:50.994777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea414bd-2e00-4c98-8865-b8415cff09e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:50.994959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8000d2-95c5-458d-943a-c5e34626c8cd None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:50.996629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea414bd-2e00-4c98-8865-b8415cff09e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:50.997529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea414bd-2e00-4c98-8865-b8415cff09e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:50.997931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea414bd-2e00-4c98-8865-b8415cff09e5 admin admin] PATH_INFO: `/v3/users/44dc01591b9b49a4a035c1bc29c1eccb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:51.000503 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea414bd-2e00-4c98-8865-b8415cff09e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44dc01591b9b49a4a035c1bc29c1eccb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:51.002912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea414bd-2e00-4c98-8865-b8415cff09e5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:51.012951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6198-ede1-48ca-ab7d-4131ef220e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:51.013578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6198-ede1-48ca-ab7d-4131ef220e51 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:51.014168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6198-ede1-48ca-ab7d-4131ef220e51 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:51.014670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6198-ede1-48ca-ab7d-4131ef220e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:51.037501 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c6198-ede1-48ca-ab7d-4131ef220e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:51.039136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c6198-ede1-48ca-ab7d-4131ef220e51 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:51.076066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 874/1720] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:51.108396 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8ea414bd-2e00-4c98-8865-b8415cff09e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44dc01591b9b49a4a035c1bc29c1eccb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:51.121912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8ea414bd-2e00-4c98-8865-b8415cff09e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44dc01591b9b49a4a035c1bc29c1eccb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:51.123169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8ea414bd-2e00-4c98-8865-b8415cff09e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44dc01591b9b49a4a035c1bc29c1eccb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:51.124758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8ea414bd-2e00-4c98-8865-b8415cff09e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44dc01591b9b49a4a035c1bc29c1eccb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:51.143851 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8ea414bd-2e00-4c98-8865-b8415cff09e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44dc01591b9b49a4a035c1bc29c1eccb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:51.195891 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 847/1721] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:24:50 2022] DELETE /identity/v3/users/44dc01591b9b49a4a035c1bc29c1eccb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:51.201196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368051b-a41f-4856-8313-315c477a5174 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:51.201474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368051b-a41f-4856-8313-315c477a5174 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:51.201744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368051b-a41f-4856-8313-315c477a5174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:51.259086 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-3368051b-a41f-4856-8313-315c477a5174 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:51.261572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3368051b-a41f-4856-8313-315c477a5174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:51.395059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2ef4-0629-45b3-876b-ce2df9afae3a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:51.395422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2ef4-0629-45b3-876b-ce2df9afae3a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:51.395774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2ef4-0629-45b3-876b-ce2df9afae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:51.442492 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 875/1722] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:51.484454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-929a2ef4-0629-45b3-876b-ce2df9afae3a None None] MFA Rules not processed for user `5c1b82de83744122b2888e1940c23087`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:51.485769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-929a2ef4-0629-45b3-876b-ce2df9afae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:51.534350 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368051b-a41f-4856-8313-315c477a5174 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:51.536774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3368051b-a41f-4856-8313-315c477a5174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:51.765641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 848/1723] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:51.766779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a2ef4-0629-45b3-876b-ce2df9afae3a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:51.770760 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-929a2ef4-0629-45b3-876b-ce2df9afae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:51.773099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368051b-a41f-4856-8313-315c477a5174 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:51.791050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921226c-59e7-4e1f-946b-5a6c1e23d6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:51.791687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921226c-59e7-4e1f-946b-5a6c1e23d6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:51.792000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921226c-59e7-4e1f-946b-5a6c1e23d6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:51.792278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921226c-59e7-4e1f-946b-5a6c1e23d6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:51.828781 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:51.829773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a2ef4-0629-45b3-876b-ce2df9afae3a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:51.837687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921226c-59e7-4e1f-946b-5a6c1e23d6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:51.840249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921226c-59e7-4e1f-946b-5a6c1e23d6f5 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:51.857270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84e6ab-4fc6-40fc-9a7f-c8c14029a794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:51.857897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84e6ab-4fc6-40fc-9a7f-c8c14029a794 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:51.858805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84e6ab-4fc6-40fc-9a7f-c8c14029a794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:51.859080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84e6ab-4fc6-40fc-9a7f-c8c14029a794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:51.859710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84e6ab-4fc6-40fc-9a7f-c8c14029a794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:51.861695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84e6ab-4fc6-40fc-9a7f-c8c14029a794 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:51.899150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 876/1724] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:24:51.927754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 849/1725] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:51 2022] POST /identity/v3/projects => generated 403 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:51.931833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921226c-59e7-4e1f-946b-5a6c1e23d6f5 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:51.946728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921226c-59e7-4e1f-946b-5a6c1e23d6f5 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:52.138235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84e6ab-4fc6-40fc-9a7f-c8c14029a794 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:52.138379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33568fc6-9300-42f6-a17f-5181cb0f0495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:52.139186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568fc6-9300-42f6-a17f-5181cb0f0495 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:52.140478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568fc6-9300-42f6-a17f-5181cb0f0495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:52.141089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568fc6-9300-42f6-a17f-5181cb0f0495 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:52.142168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33568fc6-9300-42f6-a17f-5181cb0f0495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:52.144876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33568fc6-9300-42f6-a17f-5181cb0f0495 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:52.145873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5a84e6ab-4fc6-40fc-9a7f-c8c14029a794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:52.178832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 877/1726] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:51 2022] POST /identity/v3/users => generated 308 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:52.188114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33568fc6-9300-42f6-a17f-5181cb0f0495 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:52.207485 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:52.209740 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33568fc6-9300-42f6-a17f-5181cb0f0495 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:52.224412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca163ff3-33f7-4f06-9829-ad8a15847c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:52.225094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca163ff3-33f7-4f06-9829-ad8a15847c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:52.225448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca163ff3-33f7-4f06-9829-ad8a15847c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:52.225847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca163ff3-33f7-4f06-9829-ad8a15847c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:52.226749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca163ff3-33f7-4f06-9829-ad8a15847c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:52.228945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca163ff3-33f7-4f06-9829-ad8a15847c9d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:52.252884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 878/1727] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:52.259516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca163ff3-33f7-4f06-9829-ad8a15847c9d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:52.296092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84e6ab-4fc6-40fc-9a7f-c8c14029a794 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:52.296175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca163ff3-33f7-4f06-9829-ad8a15847c9d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:52.304265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903e4d4-da1e-42fb-991a-f03c593ed6f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:52.304910 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903e4d4-da1e-42fb-991a-f03c593ed6f4 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:52.305174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903e4d4-da1e-42fb-991a-f03c593ed6f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:52.305445 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903e4d4-da1e-42fb-991a-f03c593ed6f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:52.307377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1903e4d4-da1e-42fb-991a-f03c593ed6f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:52.313315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d0614-aab7-4011-94e2-8c579ecdd2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:52.314030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d0614-aab7-4011-94e2-8c579ecdd2fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:52.314409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d0614-aab7-4011-94e2-8c579ecdd2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:52.314654 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d0614-aab7-4011-94e2-8c579ecdd2fb admin admin] PATH_INFO: `/v3/projects/b71b4489a4fd4341bff03caf40441c6c/users/6c15bb0d48744de1a9bbfa8678274e19/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:52.338256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d0614-aab7-4011-94e2-8c579ecdd2fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b71b4489a4fd4341bff03caf40441c6c, user_id=6c15bb0d48744de1a9bbfa8678274e19, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:52.342273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903e4d4-da1e-42fb-991a-f03c593ed6f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:52.344494 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903e4d4-da1e-42fb-991a-f03c593ed6f4 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:52.344715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d0614-aab7-4011-94e2-8c579ecdd2fb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:52.364580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 879/1728] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:52 2022] PUT /identity/v3/projects/b71b4489a4fd4341bff03caf40441c6c/users/6c15bb0d48744de1a9bbfa8678274e19/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:52.369026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359fa35-f1d3-44c7-bcd7-5163f8ba2360 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:52.369542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359fa35-f1d3-44c7-bcd7-5163f8ba2360 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:52.370307 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359fa35-f1d3-44c7-bcd7-5163f8ba2360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:52.373311 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 850/1729] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:52.374208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903e4d4-da1e-42fb-991a-f03c593ed6f4 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:52.396746 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903e4d4-da1e-42fb-991a-f03c593ed6f4 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:52.425833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f359fa35-f1d3-44c7-bcd7-5163f8ba2360 None None] MFA Rules not processed for user `2846f016f36f4c61a6ec959478f2dcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:52.429322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f359fa35-f1d3-44c7-bcd7-5163f8ba2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:52.585777 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 880/1730] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:52.590320 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96c87d-7618-436f-9a47-47f284ff546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:52.591054 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c87d-7618-436f-9a47-47f284ff546b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:52.591442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c87d-7618-436f-9a47-47f284ff546b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:52.591766 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c87d-7618-436f-9a47-47f284ff546b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:52.593352 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96c87d-7618-436f-9a47-47f284ff546b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:52.595922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96c87d-7618-436f-9a47-47f284ff546b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:52.614103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 851/1731] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:52.615195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359fa35-f1d3-44c7-bcd7-5163f8ba2360 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:52.628477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359fa35-f1d3-44c7-bcd7-5163f8ba2360 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:52.647853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fae728-14c0-4a6f-8bf3-44c472615165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:52.648601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fae728-14c0-4a6f-8bf3-44c472615165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:52.648889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fae728-14c0-4a6f-8bf3-44c472615165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:52.649155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fae728-14c0-4a6f-8bf3-44c472615165 admin admin] PATH_INFO: `/v3/projects/b71b4489a4fd4341bff03caf40441c6c/users/6c15bb0d48744de1a9bbfa8678274e19/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:52.651391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fae728-14c0-4a6f-8bf3-44c472615165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b71b4489a4fd4341bff03caf40441c6c, user_id=6c15bb0d48744de1a9bbfa8678274e19, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:52.654149 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fae728-14c0-4a6f-8bf3-44c472615165 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:52.708125 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 881/1732] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:52 2022] PUT /identity/v3/projects/b71b4489a4fd4341bff03caf40441c6c/users/6c15bb0d48744de1a9bbfa8678274e19/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:53.149670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd919f-8e35-4850-8e57-20a080262216 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:53.149670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd919f-8e35-4850-8e57-20a080262216 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:53.150159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd919f-8e35-4850-8e57-20a080262216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:53.238745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-93bd919f-8e35-4850-8e57-20a080262216 None None] MFA Rules not processed for user `da02b9579a5640ed9c4c8aed9807052c`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:53.240865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-93bd919f-8e35-4850-8e57-20a080262216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:53.441808 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 852/1733] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:53.448717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d05c-3bf8-48bb-82d6-3f6c5d508204 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:53.449202 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d05c-3bf8-48bb-82d6-3f6c5d508204 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:53.449628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d05c-3bf8-48bb-82d6-3f6c5d508204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:53.514822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1718d05c-3bf8-48bb-82d6-3f6c5d508204 None None] MFA Rules not processed for user `da02b9579a5640ed9c4c8aed9807052c`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:53.531444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1718d05c-3bf8-48bb-82d6-3f6c5d508204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:53.562616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 882/1734] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:53.574830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd919f-8e35-4850-8e57-20a080262216 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:53.576330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-93bd919f-8e35-4850-8e57-20a080262216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:53.708670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:53.795399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd919f-8e35-4850-8e57-20a080262216 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:53.808982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12a267-98bd-4ef6-a3f1-38938cde290e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:53.810394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12a267-98bd-4ef6-a3f1-38938cde290e service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:53.811283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12a267-98bd-4ef6-a3f1-38938cde290e service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:53.811861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12a267-98bd-4ef6-a3f1-38938cde290e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:53.843796 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718d05c-3bf8-48bb-82d6-3f6c5d508204 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:53.845266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12a267-98bd-4ef6-a3f1-38938cde290e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:53.845374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1718d05c-3bf8-48bb-82d6-3f6c5d508204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:53.848715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12a267-98bd-4ef6-a3f1-38938cde290e service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:53.895560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 853/1735] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:53.969010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:54.027195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718d05c-3bf8-48bb-82d6-3f6c5d508204 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:54.052633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:54.053299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:54.053585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:54.053865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] PATH_INFO: `/v3/projects/39f02e892fdf4d44ab14b5706382dec6` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:54.058942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f02e892fdf4d44ab14b5706382dec6)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:54.061763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:54.207527 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f02e892fdf4d44ab14b5706382dec6', 'request_id': 'req-65267673-a9a0-47ff-9155-c3d5d9ce22ce'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:54.222112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f02e892fdf4d44ab14b5706382dec6', 'request_id': 'req-65267673-a9a0-47ff-9155-c3d5d9ce22ce'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:54.252516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f02e892fdf4d44ab14b5706382dec6', 'request_id': 'req-65267673-a9a0-47ff-9155-c3d5d9ce22ce'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:54.293111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] The token cache is being invalidate because project 39f02e892fdf4d44ab14b5706382dec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:24:54.293414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:54.296414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65267673-a9a0-47ff-9155-c3d5d9ce22ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:54.303354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 883/1736] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:24:53 2022] DELETE /identity/v3/projects/39f02e892fdf4d44ab14b5706382dec6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:24:54.308222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12a267-98bd-4ef6-a3f1-38938cde290e service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:54.349605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12a267-98bd-4ef6-a3f1-38938cde290e service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:54.591305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f19373-dbdb-4b0f-a429-30631cb69e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:54.595932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f19373-dbdb-4b0f-a429-30631cb69e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:54.597968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f19373-dbdb-4b0f-a429-30631cb69e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:54.599938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f19373-dbdb-4b0f-a429-30631cb69e45 admin admin] PATH_INFO: `/v3/users/bfa1388061d948e8b868abbddda600f2` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:54.604716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f19373-dbdb-4b0f-a429-30631cb69e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa1388061d948e8b868abbddda600f2)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:54.607799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f19373-dbdb-4b0f-a429-30631cb69e45 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:54.724512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-51f19373-dbdb-4b0f-a429-30631cb69e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa1388061d948e8b868abbddda600f2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:54.741003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-51f19373-dbdb-4b0f-a429-30631cb69e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa1388061d948e8b868abbddda600f2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:54.742153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-51f19373-dbdb-4b0f-a429-30631cb69e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa1388061d948e8b868abbddda600f2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:54.743469 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-51f19373-dbdb-4b0f-a429-30631cb69e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa1388061d948e8b868abbddda600f2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:54.753093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-51f19373-dbdb-4b0f-a429-30631cb69e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa1388061d948e8b868abbddda600f2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:54.780941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 854/1737] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:24:54 2022] DELETE /identity/v3/users/bfa1388061d948e8b868abbddda600f2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:55.607602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd25b0a-0ddd-40d7-9356-5ebaa3e99974 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:55.609737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd25b0a-0ddd-40d7-9356-5ebaa3e99974 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:55.610182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd25b0a-0ddd-40d7-9356-5ebaa3e99974 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:55.611723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 884/1738] 10.222.0.16 () {54 vars in 912 bytes} [Sun Sep 18 06:24:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:24:55.617869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12002770-e9b6-428e-93ab-0031dc8a8f86 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:55.618387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12002770-e9b6-428e-93ab-0031dc8a8f86 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:55.618708 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12002770-e9b6-428e-93ab-0031dc8a8f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:55.678205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-12002770-e9b6-428e-93ab-0031dc8a8f86 None None] MFA Rules not processed for user `1d78e909fc894ddd9b35ead5fe68b898`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:55.683035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-12002770-e9b6-428e-93ab-0031dc8a8f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:55.821607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:55.844546 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 855/1739] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:24:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:56.068052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd25b0a-0ddd-40d7-9356-5ebaa3e99974 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:56.072580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ccd25b0a-0ddd-40d7-9356-5ebaa3e99974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:56.122267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd25b0a-0ddd-40d7-9356-5ebaa3e99974 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:56.149860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854deee-e1cb-4921-bdeb-43682eadcee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:56.150902 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854deee-e1cb-4921-bdeb-43682eadcee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:56.152229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854deee-e1cb-4921-bdeb-43682eadcee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:56.155127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854deee-e1cb-4921-bdeb-43682eadcee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:56.175607 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854deee-e1cb-4921-bdeb-43682eadcee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:56.177454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854deee-e1cb-4921-bdeb-43682eadcee7 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:56.190075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 885/1740] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:56.322889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b27bc-65fd-4a49-8a1e-17a18ffe848f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:56.323321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b27bc-65fd-4a49-8a1e-17a18ffe848f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:56.323698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b27bc-65fd-4a49-8a1e-17a18ffe848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:56.462279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2d1b27bc-65fd-4a49-8a1e-17a18ffe848f None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:56.468098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2d1b27bc-65fd-4a49-8a1e-17a18ffe848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:56.618667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 856/1741] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:24:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:56.696160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854deee-e1cb-4921-bdeb-43682eadcee7 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:56.704947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8854deee-e1cb-4921-bdeb-43682eadcee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:56.925781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b27bc-65fd-4a49-8a1e-17a18ffe848f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:56.927213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2d1b27bc-65fd-4a49-8a1e-17a18ffe848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:57.006541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854deee-e1cb-4921-bdeb-43682eadcee7 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:57.024629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad717c1-9d4a-4f07-80dd-43285995a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:57.025619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad717c1-9d4a-4f07-80dd-43285995a9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:57.026036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad717c1-9d4a-4f07-80dd-43285995a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:57.026451 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad717c1-9d4a-4f07-80dd-43285995a9f9 admin admin] PATH_INFO: `/v3/users/878b41bb5fb548f69f6427cdecd29447` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:57.032730 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad717c1-9d4a-4f07-80dd-43285995a9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878b41bb5fb548f69f6427cdecd29447)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:57.038279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad717c1-9d4a-4f07-80dd-43285995a9f9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:57.192291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b27bc-65fd-4a49-8a1e-17a18ffe848f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:57.195109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3ad717c1-9d4a-4f07-80dd-43285995a9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878b41bb5fb548f69f6427cdecd29447'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:57.202577 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08207bb-db7d-4bc6-beb7-53f2616f508c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:57.203292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08207bb-db7d-4bc6-beb7-53f2616f508c service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:57.203966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08207bb-db7d-4bc6-beb7-53f2616f508c service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:57.203966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08207bb-db7d-4bc6-beb7-53f2616f508c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:57.214536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3ad717c1-9d4a-4f07-80dd-43285995a9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878b41bb5fb548f69f6427cdecd29447'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:57.215754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3ad717c1-9d4a-4f07-80dd-43285995a9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878b41bb5fb548f69f6427cdecd29447'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:57.216634 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3ad717c1-9d4a-4f07-80dd-43285995a9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878b41bb5fb548f69f6427cdecd29447'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:57.218944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:57.220292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08207bb-db7d-4bc6-beb7-53f2616f508c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:57.227275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08207bb-db7d-4bc6-beb7-53f2616f508c service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:57.242992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3ad717c1-9d4a-4f07-80dd-43285995a9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878b41bb5fb548f69f6427cdecd29447'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:57.255679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 857/1742] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:24:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:24:57.257222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9081d-146a-4565-b968-4c430347e543 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:57.257491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9081d-146a-4565-b968-4c430347e543 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:57.257827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9081d-146a-4565-b968-4c430347e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:57.293720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 886/1743] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:24:56 2022] DELETE /identity/v3/users/878b41bb5fb548f69f6427cdecd29447 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:57.298554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af3cc-eeff-4d3a-a080-f0d09049cb25 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:57.299194 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af3cc-eeff-4d3a-a080-f0d09049cb25 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:57.299679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af3cc-eeff-4d3a-a080-f0d09049cb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:57.355195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ed8af3cc-eeff-4d3a-a080-f0d09049cb25 None None] MFA Rules not processed for user `11898a78089f407aa67cae2c48f99d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:57.359953 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ed8af3cc-eeff-4d3a-a080-f0d09049cb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:57.452173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0ed9081d-146a-4565-b968-4c430347e543 None None] MFA Rules not processed for user `6c15bb0d48744de1a9bbfa8678274e19`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:57.453437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0ed9081d-146a-4565-b968-4c430347e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:57.605190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 887/1744] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:57.609917 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066fbcb-887b-44cc-8072-8e88773de856 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:57.610841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066fbcb-887b-44cc-8072-8e88773de856 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:57.611544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066fbcb-887b-44cc-8072-8e88773de856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:57.643556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5066fbcb-887b-44cc-8072-8e88773de856 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:57.644997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5066fbcb-887b-44cc-8072-8e88773de856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:57.645455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:57.787181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 888/1745] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:57.845862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 858/1746] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 589 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:57.864497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066fbcb-887b-44cc-8072-8e88773de856 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:57.866932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5066fbcb-887b-44cc-8072-8e88773de856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:58.099365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066fbcb-887b-44cc-8072-8e88773de856 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:58.129693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052661d-0a3a-45b8-b441-79713c5301a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:58.132524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052661d-0a3a-45b8-b441-79713c5301a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:58.133544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052661d-0a3a-45b8-b441-79713c5301a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:58.134614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052661d-0a3a-45b8-b441-79713c5301a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:58.166689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052661d-0a3a-45b8-b441-79713c5301a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:58.170491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052661d-0a3a-45b8-b441-79713c5301a7 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:58.200422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 889/1747] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:24:58.513190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9081d-146a-4565-b968-4c430347e543 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:58.515851 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0ed9081d-146a-4565-b968-4c430347e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:58.538958 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9081d-146a-4565-b968-4c430347e543 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:58.550197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:58.550994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:58.551274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:58.551547 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] PATH_INFO: `/v3/projects/a984d7a3bd644775b00a56bccde30f52` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:58.555653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a984d7a3bd644775b00a56bccde30f52)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:58.564784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:58.754235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a984d7a3bd644775b00a56bccde30f52', 'request_id': 'req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:58.772403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a984d7a3bd644775b00a56bccde30f52', 'request_id': 'req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:58.790272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a984d7a3bd644775b00a56bccde30f52', 'request_id': 'req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:58.816896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] The token cache is being invalidate because project a984d7a3bd644775b00a56bccde30f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:24:58.817469 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:58.819442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9eadf0db-ca24-4df2-b9bc-719a9f776d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:24:58.824770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 859/1748] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:24:58 2022] DELETE /identity/v3/projects/a984d7a3bd644775b00a56bccde30f52 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:24:58.829356 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c978894-a732-4053-b80b-09c5045406d8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:58.833731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c978894-a732-4053-b80b-09c5045406d8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:58.834253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c978894-a732-4053-b80b-09c5045406d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:58.864783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2c978894-a732-4053-b80b-09c5045406d8 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:58.866190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2c978894-a732-4053-b80b-09c5045406d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:58.883374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:24:58.957255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 890/1749] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:58.965467 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14d4c-bda0-40f2-9af6-e445e27e0c8d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:58.965825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14d4c-bda0-40f2-9af6-e445e27e0c8d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:58.966176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14d4c-bda0-40f2-9af6-e445e27e0c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:59.070358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a2e14d4c-bda0-40f2-9af6-e445e27e0c8d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:59.077616 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a2e14d4c-bda0-40f2-9af6-e445e27e0c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:59.100103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 860/1750] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:24:59.103443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c978894-a732-4053-b80b-09c5045406d8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:59.135041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c978894-a732-4053-b80b-09c5045406d8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:59.162100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e0143-d753-42d6-9d7d-224607a597c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:59.167353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e0143-d753-42d6-9d7d-224607a597c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:59.171665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e0143-d753-42d6-9d7d-224607a597c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:59.173807 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e0143-d753-42d6-9d7d-224607a597c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:59.175623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e0143-d753-42d6-9d7d-224607a597c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:24:59.177326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e0143-d753-42d6-9d7d-224607a597c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:59.180523 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e0143-d753-42d6-9d7d-224607a597c7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:59.235320 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e14d4c-bda0-40f2-9af6-e445e27e0c8d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:59.241624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 891/1751] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:24:59.251013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e14d4c-bda0-40f2-9af6-e445e27e0c8d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:59.263490 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a75bb5-6d85-4d10-86cb-a41544faf9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:59.264775 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a75bb5-6d85-4d10-86cb-a41544faf9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:59.266421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a75bb5-6d85-4d10-86cb-a41544faf9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:59.266812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a75bb5-6d85-4d10-86cb-a41544faf9c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:59.268094 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a75bb5-6d85-4d10-86cb-a41544faf9c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:59.272826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a75bb5-6d85-4d10-86cb-a41544faf9c1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:59.360281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e0143-d753-42d6-9d7d-224607a597c7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:59.372745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 861/1752] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:24:59 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:24:59.376070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e0143-d753-42d6-9d7d-224607a597c7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:59.604835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92387ce5-ad12-479a-9f80-80ab2e52c391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:59.605777 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92387ce5-ad12-479a-9f80-80ab2e52c391 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:59.606150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92387ce5-ad12-479a-9f80-80ab2e52c391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:59.606547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92387ce5-ad12-479a-9f80-80ab2e52c391 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:59.607288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92387ce5-ad12-479a-9f80-80ab2e52c391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:59.609442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92387ce5-ad12-479a-9f80-80ab2e52c391 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:59.652563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 892/1753] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:24:59 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:24:59.657890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a75bb5-6d85-4d10-86cb-a41544faf9c1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:59.682533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a75bb5-6d85-4d10-86cb-a41544faf9c1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:59.704177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61189-7bbb-47cf-9f30-32386ef3a1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:59.707730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61189-7bbb-47cf-9f30-32386ef3a1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:59.708018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61189-7bbb-47cf-9f30-32386ef3a1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:59.710996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61189-7bbb-47cf-9f30-32386ef3a1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:59.712590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec61189-7bbb-47cf-9f30-32386ef3a1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:59.715053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec61189-7bbb-47cf-9f30-32386ef3a1b0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:59.729604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9cf5-4ddd-4518-882c-74b103b6c31a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:59.729604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9cf5-4ddd-4518-882c-74b103b6c31a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:59.729604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9cf5-4ddd-4518-882c-74b103b6c31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:59.762300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 862/1754] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:59.766875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61189-7bbb-47cf-9f30-32386ef3a1b0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:24:59.808003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f91d9cf5-4ddd-4518-882c-74b103b6c31a None None] MFA Rules not processed for user `b805252c0e714dbcb305ad156ed58113`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:24:59.814903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f91d9cf5-4ddd-4518-882c-74b103b6c31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:24:59.852082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61189-7bbb-47cf-9f30-32386ef3a1b0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:24:59.896402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81514a13-ee20-4947-a417-dde111647812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:24:59.898002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514a13-ee20-4947-a417-dde111647812 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:24:59.901890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514a13-ee20-4947-a417-dde111647812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:24:59.904111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514a13-ee20-4947-a417-dde111647812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:24:59.905463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81514a13-ee20-4947-a417-dde111647812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:24:59.908725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81514a13-ee20-4947-a417-dde111647812 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:24:59.957614 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 863/1755] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:24:59.960054 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81514a13-ee20-4947-a417-dde111647812 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:00.009828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81514a13-ee20-4947-a417-dde111647812 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:00.028798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc57ce-7ca5-4c0e-8fb5-8cd5d227c006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:00.030617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc57ce-7ca5-4c0e-8fb5-8cd5d227c006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:00.030913 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc57ce-7ca5-4c0e-8fb5-8cd5d227c006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:00.033811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc57ce-7ca5-4c0e-8fb5-8cd5d227c006 admin admin] PATH_INFO: `/v3/projects/374ea66ff6e741628e8d53350a599bef/users/47bf6d7531db44778694f1581d284a79/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:00.036071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 893/1756] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:24:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:00.081955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc57ce-7ca5-4c0e-8fb5-8cd5d227c006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374ea66ff6e741628e8d53350a599bef, user_id=47bf6d7531db44778694f1581d284a79, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:00.084481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc57ce-7ca5-4c0e-8fb5-8cd5d227c006 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:00.135351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 864/1757] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:24:59 2022] PUT /identity/v3/projects/374ea66ff6e741628e8d53350a599bef/users/47bf6d7531db44778694f1581d284a79/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:00.147280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffcaab-7252-4759-8e18-2630dee09501 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:00.147805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffcaab-7252-4759-8e18-2630dee09501 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:00.148294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffcaab-7252-4759-8e18-2630dee09501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:00.269983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-76ffcaab-7252-4759-8e18-2630dee09501 None None] MFA Rules not processed for user `47bf6d7531db44778694f1581d284a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:00.273039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-76ffcaab-7252-4759-8e18-2630dee09501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:00.321220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:00.518036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 894/1758] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:00.523802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc57ce-7ca5-4c0e-8fb5-8cd5d227c006 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:00.645029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:00.722149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc57ce-7ca5-4c0e-8fb5-8cd5d227c006 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:00.739262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08837f-0c58-44fa-be27-eebff3ca18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:00.740888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08837f-0c58-44fa-be27-eebff3ca18ad admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:00.741334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08837f-0c58-44fa-be27-eebff3ca18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:00.741703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08837f-0c58-44fa-be27-eebff3ca18ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:00.742827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08837f-0c58-44fa-be27-eebff3ca18ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:00.745941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08837f-0c58-44fa-be27-eebff3ca18ad admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:00.795035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 865/1759] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:00 2022] POST /identity/v3/projects => generated 385 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:00.801480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffcaab-7252-4759-8e18-2630dee09501 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:00.830305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffcaab-7252-4759-8e18-2630dee09501 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:01.105543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2abe0e-a8f1-4129-8336-fb61f93faf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:01.110834 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2abe0e-a8f1-4129-8336-fb61f93faf0c admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:01.112685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2abe0e-a8f1-4129-8336-fb61f93faf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:01.114336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2abe0e-a8f1-4129-8336-fb61f93faf0c admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:01.119483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2abe0e-a8f1-4129-8336-fb61f93faf0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:01.156469 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2abe0e-a8f1-4129-8336-fb61f93faf0c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:01.253578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08837f-0c58-44fa-be27-eebff3ca18ad admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:01.254174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 895/1760] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:00 2022] POST /identity/v3/users => generated 293 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:01.273154 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08837f-0c58-44fa-be27-eebff3ca18ad admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:01.286821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95939ca-049d-4a1d-b920-1b213d235d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:01.287895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95939ca-049d-4a1d-b920-1b213d235d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:01.290062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95939ca-049d-4a1d-b920-1b213d235d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:01.290062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95939ca-049d-4a1d-b920-1b213d235d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:01.291021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95939ca-049d-4a1d-b920-1b213d235d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:01.296139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95939ca-049d-4a1d-b920-1b213d235d3e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:01.333157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2abe0e-a8f1-4129-8336-fb61f93faf0c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:01.341925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 866/1761] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:01.355683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2abe0e-a8f1-4129-8336-fb61f93faf0c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:01.370570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679eda4-7c9f-45ef-8e42-8fda11812724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:01.371873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679eda4-7c9f-45ef-8e42-8fda11812724 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:01.372399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679eda4-7c9f-45ef-8e42-8fda11812724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:01.372922 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679eda4-7c9f-45ef-8e42-8fda11812724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:01.374213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679eda4-7c9f-45ef-8e42-8fda11812724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:01.378618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679eda4-7c9f-45ef-8e42-8fda11812724 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:01.415135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 896/1762] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:01.420426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95939ca-049d-4a1d-b920-1b213d235d3e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:01.459438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95939ca-049d-4a1d-b920-1b213d235d3e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:01.481482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac619e9-762b-40a7-8118-6ec1abe4c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:01.481748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679eda4-7c9f-45ef-8e42-8fda11812724 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:01.482632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac619e9-762b-40a7-8118-6ec1abe4c936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:01.486648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac619e9-762b-40a7-8118-6ec1abe4c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:01.489253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac619e9-762b-40a7-8118-6ec1abe4c936 admin admin] PATH_INFO: `/v3/projects/1a7bf1c888e54d35a5aa1eacb65f5a59/users/3b139a2dcae24b32acc975537774a101/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:01.492182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b679eda4-7c9f-45ef-8e42-8fda11812724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:01.550529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac619e9-762b-40a7-8118-6ec1abe4c936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7bf1c888e54d35a5aa1eacb65f5a59, user_id=3b139a2dcae24b32acc975537774a101, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:01.567286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679eda4-7c9f-45ef-8e42-8fda11812724 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:01.610603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:01.611273 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:01.611554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:01.611829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] PATH_INFO: `/v3/projects/502f9b76995e4ddf8347907359ac61ad` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:01.616935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=502f9b76995e4ddf8347907359ac61ad)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:01.631176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:01.637995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac619e9-762b-40a7-8118-6ec1abe4c936 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:01.713582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 867/1763] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:01 2022] PUT /identity/v3/projects/1a7bf1c888e54d35a5aa1eacb65f5a59/users/3b139a2dcae24b32acc975537774a101/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:01.724993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6467b-18a5-4f2a-86ee-11314c267956 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:01.725275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6467b-18a5-4f2a-86ee-11314c267956 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:01.725608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6467b-18a5-4f2a-86ee-11314c267956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:01.815036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502f9b76995e4ddf8347907359ac61ad', 'request_id': 'req-ead355b0-933f-43c1-9fec-a6a536f6d0ee'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:01.861666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502f9b76995e4ddf8347907359ac61ad', 'request_id': 'req-ead355b0-933f-43c1-9fec-a6a536f6d0ee'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:01.869734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d1c6467b-18a5-4f2a-86ee-11314c267956 None None] MFA Rules not processed for user `3b139a2dcae24b32acc975537774a101`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:01.873013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d1c6467b-18a5-4f2a-86ee-11314c267956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:01.880490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502f9b76995e4ddf8347907359ac61ad', 'request_id': 'req-ead355b0-933f-43c1-9fec-a6a536f6d0ee'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:01.930233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] The token cache is being invalidate because project 502f9b76995e4ddf8347907359ac61ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:01.930564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:01.937902 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ead355b0-933f-43c1-9fec-a6a536f6d0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:01.944960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 897/1764] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:01 2022] DELETE /identity/v3/projects/502f9b76995e4ddf8347907359ac61ad => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:01.952903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a97edf-c346-4a75-840d-c906ee4facc8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:01.953131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a97edf-c346-4a75-840d-c906ee4facc8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:01.953413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a97edf-c346-4a75-840d-c906ee4facc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:02.089290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b1a97edf-c346-4a75-840d-c906ee4facc8 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:02.094982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b1a97edf-c346-4a75-840d-c906ee4facc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:02.307648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 868/1765] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 583 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:02.315156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6467b-18a5-4f2a-86ee-11314c267956 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:02.323480 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d1c6467b-18a5-4f2a-86ee-11314c267956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:02.347836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:02.565596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 898/1766] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 615 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:02.575230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ebd44-cefe-45db-b406-462af401db3c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:02.575230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ebd44-cefe-45db-b406-462af401db3c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:02.575230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ebd44-cefe-45db-b406-462af401db3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:02.580233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6467b-18a5-4f2a-86ee-11314c267956 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:02.586995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895272-0295-49bf-b645-8bffcd7acba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:02.587813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895272-0295-49bf-b645-8bffcd7acba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:02.588289 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895272-0295-49bf-b645-8bffcd7acba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:02.588670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895272-0295-49bf-b645-8bffcd7acba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:02.589571 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7895272-0295-49bf-b645-8bffcd7acba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:02.594689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7895272-0295-49bf-b645-8bffcd7acba1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:02.635799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-611ebd44-cefe-45db-b406-462af401db3c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:02.641840 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-611ebd44-cefe-45db-b406-462af401db3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:02.656095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:02.672096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 899/1767] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:02.678467 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ebd44-cefe-45db-b406-462af401db3c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:02.679642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 869/1768] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:02 2022] POST /identity/v3/projects => generated 385 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:02.683054 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895272-0295-49bf-b645-8bffcd7acba1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:02.728338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ebd44-cefe-45db-b406-462af401db3c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:02.932850 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895272-0295-49bf-b645-8bffcd7acba1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:02.957878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e29e2-6b57-47ed-90ec-a84bc18da937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:02.958531 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e29e2-6b57-47ed-90ec-a84bc18da937 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:02.958811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e29e2-6b57-47ed-90ec-a84bc18da937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:02.960397 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d0530-061e-4700-8f9f-2d89b9696bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:02.961092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d0530-061e-4700-8f9f-2d89b9696bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:02.961363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d0530-061e-4700-8f9f-2d89b9696bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:02.962263 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e29e2-6b57-47ed-90ec-a84bc18da937 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:02.963000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e29e2-6b57-47ed-90ec-a84bc18da937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:02.963478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d0530-061e-4700-8f9f-2d89b9696bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:02.965045 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d0530-061e-4700-8f9f-2d89b9696bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:02.965914 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e29e2-6b57-47ed-90ec-a84bc18da937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:02.973372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e29e2-6b57-47ed-90ec-a84bc18da937 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:02.975067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d0530-061e-4700-8f9f-2d89b9696bf1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:03.025080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 870/1769] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:02 2022] POST /identity/v3/users => generated 299 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:03.031230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 900/1770] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:25:03.032708 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d0530-061e-4700-8f9f-2d89b9696bf1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:03.037803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e29e2-6b57-47ed-90ec-a84bc18da937 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:03.066126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e29e2-6b57-47ed-90ec-a84bc18da937 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:03.078624 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d0530-061e-4700-8f9f-2d89b9696bf1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:03.078815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68d562-0a16-4531-bcb9-7e73b47dd997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:03.079635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d562-0a16-4531-bcb9-7e73b47dd997 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:03.080093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d562-0a16-4531-bcb9-7e73b47dd997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:03.080480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d562-0a16-4531-bcb9-7e73b47dd997 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:03.081294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68d562-0a16-4531-bcb9-7e73b47dd997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:03.083461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68d562-0a16-4531-bcb9-7e73b47dd997 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:03.093807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a38c7-4a4c-4181-82c9-ab7579503e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:03.094438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a38c7-4a4c-4181-82c9-ab7579503e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:03.094714 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a38c7-4a4c-4181-82c9-ab7579503e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:03.094988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a38c7-4a4c-4181-82c9-ab7579503e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:03.095640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a38c7-4a4c-4181-82c9-ab7579503e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:03.101838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a38c7-4a4c-4181-82c9-ab7579503e6d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:03.136039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 871/1771] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:03.137086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a38c7-4a4c-4181-82c9-ab7579503e6d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:03.152884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 901/1772] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:03 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:03.157497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68d562-0a16-4531-bcb9-7e73b47dd997 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:03.190066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a38c7-4a4c-4181-82c9-ab7579503e6d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:03.357359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68d562-0a16-4531-bcb9-7e73b47dd997 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:03.371508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4762e58-82be-42b4-9f07-2953a00df241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:03.377438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4762e58-82be-42b4-9f07-2953a00df241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:03.377938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4762e58-82be-42b4-9f07-2953a00df241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:03.378328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4762e58-82be-42b4-9f07-2953a00df241 admin admin] PATH_INFO: `/v3/projects/09156dabdf6f4b64a86605c30544b280/users/37b4c929e8224f75bf15e19ca8449795/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:03.382431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dd980-8cdc-4787-94ec-9cabf1547332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:03.383960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dd980-8cdc-4787-94ec-9cabf1547332 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:03.384318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dd980-8cdc-4787-94ec-9cabf1547332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:03.384596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dd980-8cdc-4787-94ec-9cabf1547332 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:03.385672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26dd980-8cdc-4787-94ec-9cabf1547332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:03.389046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26dd980-8cdc-4787-94ec-9cabf1547332 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:03.427638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4762e58-82be-42b4-9f07-2953a00df241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09156dabdf6f4b64a86605c30544b280, user_id=37b4c929e8224f75bf15e19ca8449795, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:03.435001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4762e58-82be-42b4-9f07-2953a00df241 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:03.469705 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 902/1773] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:03 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:03.470666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 872/1774] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:03 2022] PUT /identity/v3/projects/09156dabdf6f4b64a86605c30544b280/users/37b4c929e8224f75bf15e19ca8449795/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:03.471812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dd980-8cdc-4787-94ec-9cabf1547332 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:03.487494 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4762e58-82be-42b4-9f07-2953a00df241 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:03.535033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26dd980-8cdc-4787-94ec-9cabf1547332 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:03.617329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:03.733566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4762e58-82be-42b4-9f07-2953a00df241 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:03.768111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09776e7f-cab0-4802-8904-90bc117ef576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:03.768696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09776e7f-cab0-4802-8904-90bc117ef576 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:03.768972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09776e7f-cab0-4802-8904-90bc117ef576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:03.769350 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09776e7f-cab0-4802-8904-90bc117ef576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:03.770005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09776e7f-cab0-4802-8904-90bc117ef576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:03.771643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09776e7f-cab0-4802-8904-90bc117ef576 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:03.775127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386cfff-2307-488c-9c05-b63e4bc515fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:03.775773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386cfff-2307-488c-9c05-b63e4bc515fc admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:03.776098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386cfff-2307-488c-9c05-b63e4bc515fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:03.776377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386cfff-2307-488c-9c05-b63e4bc515fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:03.777045 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386cfff-2307-488c-9c05-b63e4bc515fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:03.779403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386cfff-2307-488c-9c05-b63e4bc515fc admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:03.792859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 903/1775] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:03.794920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09776e7f-cab0-4802-8904-90bc117ef576 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:03.796287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:03.813255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 873/1776] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:03.818195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386cfff-2307-488c-9c05-b63e4bc515fc admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:03.824152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09776e7f-cab0-4802-8904-90bc117ef576 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:03.833535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3ca41-a132-4c25-81d8-88bb72c4dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:03.834467 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3ca41-a132-4c25-81d8-88bb72c4dea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:03.834874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3ca41-a132-4c25-81d8-88bb72c4dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:03.835372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3ca41-a132-4c25-81d8-88bb72c4dea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:03.836196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3ca41-a132-4c25-81d8-88bb72c4dea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:03.839495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3ca41-a132-4c25-81d8-88bb72c4dea1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:03.857674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 904/1777] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:03.858745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3ca41-a132-4c25-81d8-88bb72c4dea1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:03.868988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386cfff-2307-488c-9c05-b63e4bc515fc admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:03.871855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3ca41-a132-4c25-81d8-88bb72c4dea1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:03.883580 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b316c3-35c0-4292-8f7a-658de6d0bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:03.885228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b316c3-35c0-4292-8f7a-658de6d0bade admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:03.885228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b316c3-35c0-4292-8f7a-658de6d0bade admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:03.885228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b316c3-35c0-4292-8f7a-658de6d0bade admin admin] PATH_INFO: `/v3/projects/09156dabdf6f4b64a86605c30544b280/users/37b4c929e8224f75bf15e19ca8449795/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:03.886389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a45a2-965a-4d4b-a3d7-978e654d76c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:03.887830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a45a2-965a-4d4b-a3d7-978e654d76c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:03.888572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a45a2-965a-4d4b-a3d7-978e654d76c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:03.890143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a45a2-965a-4d4b-a3d7-978e654d76c1 admin admin] PATH_INFO: `/v3/projects/2758f271cbb947018fc5fbf91e15371a/users/05266dff10fb403aaada6cf8644bca6f/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:03.904970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b316c3-35c0-4292-8f7a-658de6d0bade admin admin] RBAC: Authorizing `identity:create_grant(project_id=09156dabdf6f4b64a86605c30544b280, user_id=37b4c929e8224f75bf15e19ca8449795, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:03.907954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b316c3-35c0-4292-8f7a-658de6d0bade admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:03.917114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a45a2-965a-4d4b-a3d7-978e654d76c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2758f271cbb947018fc5fbf91e15371a, user_id=05266dff10fb403aaada6cf8644bca6f, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:03.920647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a45a2-965a-4d4b-a3d7-978e654d76c1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:03.970476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 874/1778] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:03 2022] PUT /identity/v3/projects/09156dabdf6f4b64a86605c30544b280/users/37b4c929e8224f75bf15e19ca8449795/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:03.984298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5ce3b-93ff-47ca-9bf0-6ec8f621a01b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:03.984298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5ce3b-93ff-47ca-9bf0-6ec8f621a01b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:03.984298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5ce3b-93ff-47ca-9bf0-6ec8f621a01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:04.002060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 905/1779] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:03 2022] PUT /identity/v3/projects/2758f271cbb947018fc5fbf91e15371a/users/05266dff10fb403aaada6cf8644bca6f/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:04.013766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6243377-2546-4d32-86ff-20d476255f10 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:04.013991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6243377-2546-4d32-86ff-20d476255f10 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:04.014267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6243377-2546-4d32-86ff-20d476255f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:04.166424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f8c5ce3b-93ff-47ca-9bf0-6ec8f621a01b None None] MFA Rules not processed for user `37b4c929e8224f75bf15e19ca8449795`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:04.166424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f8c5ce3b-93ff-47ca-9bf0-6ec8f621a01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:04.227647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c6243377-2546-4d32-86ff-20d476255f10 None None] MFA Rules not processed for user `05266dff10fb403aaada6cf8644bca6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:04.229277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c6243377-2546-4d32-86ff-20d476255f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:04.491420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 875/1780] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:04.495872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8786e-9861-4b53-8736-4eb4bb8cfdf3 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:04.498920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8786e-9861-4b53-8736-4eb4bb8cfdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:04.499502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8786e-9861-4b53-8736-4eb4bb8cfdf3 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:04.507472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 876/1781] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:25:04 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:25:04.510071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8786e-9861-4b53-8736-4eb4bb8cfdf3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:04.512605 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 906/1782] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:04.517500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6243377-2546-4d32-86ff-20d476255f10 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:04.517950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b4f8786e-9861-4b53-8736-4eb4bb8cfdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:04.817623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6243377-2546-4d32-86ff-20d476255f10 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:04.841075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7d5ec-647e-4271-8344-cca0763e6581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:04.842806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d5ec-647e-4271-8344-cca0763e6581 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:04.844713 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d5ec-647e-4271-8344-cca0763e6581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:04.846585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d5ec-647e-4271-8344-cca0763e6581 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:04.848881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7d5ec-647e-4271-8344-cca0763e6581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:04.850563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8786e-9861-4b53-8736-4eb4bb8cfdf3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:04.860483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7d5ec-647e-4271-8344-cca0763e6581 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:04.864967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acc5c5-4723-45ab-8577-d5e0b40f7d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:04.867132 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc5c5-4723-45ab-8577-d5e0b40f7d5a service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:04.867620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc5c5-4723-45ab-8577-d5e0b40f7d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:04.869299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc5c5-4723-45ab-8577-d5e0b40f7d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:04.894857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acc5c5-4723-45ab-8577-d5e0b40f7d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:04.896646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acc5c5-4723-45ab-8577-d5e0b40f7d5a service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:04.922352 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 877/1783] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:04.928258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052824d-e025-4672-8f1f-a7f8ce2a5699 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:04.928551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052824d-e025-4672-8f1f-a7f8ce2a5699 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:04.928884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052824d-e025-4672-8f1f-a7f8ce2a5699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:04.975298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f052824d-e025-4672-8f1f-a7f8ce2a5699 None None] MFA Rules not processed for user `320a1c60b5b6461c8e2e2b6ec74ce78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:04.976974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f052824d-e025-4672-8f1f-a7f8ce2a5699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:05.026061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 907/1784] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:04 2022] POST /identity/v3/projects => generated 385 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:05.032775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7d5ec-647e-4271-8344-cca0763e6581 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:05.068552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:05.269069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 878/1785] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:25:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:05.295973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9503-aebc-4263-a5b3-316d021487b7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:05.295973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9503-aebc-4263-a5b3-316d021487b7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:05.295973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9503-aebc-4263-a5b3-316d021487b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:05.361135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-cfec9503-aebc-4263-a5b3-316d021487b7 None None] MFA Rules not processed for user `1d78e909fc894ddd9b35ead5fe68b898`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:05.363366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7d5ec-647e-4271-8344-cca0763e6581 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:05.366789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cfec9503-aebc-4263-a5b3-316d021487b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:05.381066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:05.385842 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45ef3b-91db-46b2-866e-10a39c69da27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:05.388496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45ef3b-91db-46b2-866e-10a39c69da27 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:05.396318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45ef3b-91db-46b2-866e-10a39c69da27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:05.396655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45ef3b-91db-46b2-866e-10a39c69da27 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:05.407642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45ef3b-91db-46b2-866e-10a39c69da27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:05.415958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45ef3b-91db-46b2-866e-10a39c69da27 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:05.569109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 908/1786] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:05 2022] POST /identity/v3/users => generated 299 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:05.575188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45ef3b-91db-46b2-866e-10a39c69da27 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:05.627257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6e45ef3b-91db-46b2-866e-10a39c69da27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:05.890047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 879/1787] 10.222.0.33 () {58 vars in 1015 bytes} [Sun Sep 18 06:25:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:05.906256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec9503-aebc-4263-a5b3-316d021487b7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:05.961500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec9503-aebc-4263-a5b3-316d021487b7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:05.978821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e59a9-6098-4e33-b434-16c835989f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:05.982089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e59a9-6098-4e33-b434-16c835989f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:05.990126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e59a9-6098-4e33-b434-16c835989f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:05.991153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e59a9-6098-4e33-b434-16c835989f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:05.993027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e59a9-6098-4e33-b434-16c835989f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:05.995730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e59a9-6098-4e33-b434-16c835989f97 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:06.043314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 880/1788] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:06.047990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e59a9-6098-4e33-b434-16c835989f97 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:06.065908 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45ef3b-91db-46b2-866e-10a39c69da27 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:06.079176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e59a9-6098-4e33-b434-16c835989f97 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:06.084942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a9752-9ac6-48d4-bc84-f6cd4e6f8a7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:06.088272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a9752-9ac6-48d4-bc84-f6cd4e6f8a7a service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:06.089640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a9752-9ac6-48d4-bc84-f6cd4e6f8a7a service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:06.091345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a9752-9ac6-48d4-bc84-f6cd4e6f8a7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:06.106120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea294b-7ea8-4415-9cdf-d0f02b6b2c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:06.107834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea294b-7ea8-4415-9cdf-d0f02b6b2c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:06.112004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea294b-7ea8-4415-9cdf-d0f02b6b2c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:06.112440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea294b-7ea8-4415-9cdf-d0f02b6b2c6f admin admin] PATH_INFO: `/v3/projects/ed018418d1b341e9b6d12a4007dd923a/users/d11b142ca5aa42089429a865a4c9e48c/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:06.157449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a9752-9ac6-48d4-bc84-f6cd4e6f8a7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:06.160296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a9752-9ac6-48d4-bc84-f6cd4e6f8a7a service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:06.198679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea294b-7ea8-4415-9cdf-d0f02b6b2c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed018418d1b341e9b6d12a4007dd923a, user_id=d11b142ca5aa42089429a865a4c9e48c, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:06.204420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 909/1789] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:06.213157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea294b-7ea8-4415-9cdf-d0f02b6b2c6f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:06.250289 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 881/1790] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:06 2022] PUT /identity/v3/projects/ed018418d1b341e9b6d12a4007dd923a/users/d11b142ca5aa42089429a865a4c9e48c/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:06.254671 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a9752-9ac6-48d4-bc84-f6cd4e6f8a7a service placement] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:06.282704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a9752-9ac6-48d4-bc84-f6cd4e6f8a7a service placement] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:06.519087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66841c9f-ad95-416b-ab4c-4d1fde75174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:06.522195 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66841c9f-ad95-416b-ab4c-4d1fde75174a admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:06.524971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66841c9f-ad95-416b-ab4c-4d1fde75174a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:06.525253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66841c9f-ad95-416b-ab4c-4d1fde75174a admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:06.525915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66841c9f-ad95-416b-ab4c-4d1fde75174a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:06.532645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66841c9f-ad95-416b-ab4c-4d1fde75174a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:06.563440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea294b-7ea8-4415-9cdf-d0f02b6b2c6f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:06.565209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c5ea294b-7ea8-4415-9cdf-d0f02b6b2c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:06.594035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 910/1791] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:06.605232 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66841c9f-ad95-416b-ab4c-4d1fde75174a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:06.626647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-66841c9f-ad95-416b-ab4c-4d1fde75174a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:06.685376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:06.789079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66841c9f-ad95-416b-ab4c-4d1fde75174a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:06.800877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214307b-0238-47fd-a7f7-625dd911a608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:06.804000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214307b-0238-47fd-a7f7-625dd911a608 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:06.805527 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214307b-0238-47fd-a7f7-625dd911a608 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:06.805926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214307b-0238-47fd-a7f7-625dd911a608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:06.806381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea294b-7ea8-4415-9cdf-d0f02b6b2c6f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:06.825143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214307b-0238-47fd-a7f7-625dd911a608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:06.827300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211649a-d383-4e85-bd42-90f4db8a3960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:06.828423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211649a-d383-4e85-bd42-90f4db8a3960 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:06.829089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214307b-0238-47fd-a7f7-625dd911a608 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:06.851467 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211649a-d383-4e85-bd42-90f4db8a3960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:06.851803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211649a-d383-4e85-bd42-90f4db8a3960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:06.852476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 911/1792] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:06.855139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214307b-0238-47fd-a7f7-625dd911a608 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:06.879163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211649a-d383-4e85-bd42-90f4db8a3960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:06.882308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211649a-d383-4e85-bd42-90f4db8a3960 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:06.888019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214307b-0238-47fd-a7f7-625dd911a608 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:06.905664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ffaec-c90d-4c04-9641-13cf8c3407fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:06.907181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ffaec-c90d-4c04-9641-13cf8c3407fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:06.907575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ffaec-c90d-4c04-9641-13cf8c3407fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:06.909802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ffaec-c90d-4c04-9641-13cf8c3407fe admin admin] PATH_INFO: `/v3/projects/ed018418d1b341e9b6d12a4007dd923a/users/d11b142ca5aa42089429a865a4c9e48c/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:06.913660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ffaec-c90d-4c04-9641-13cf8c3407fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed018418d1b341e9b6d12a4007dd923a, user_id=d11b142ca5aa42089429a865a4c9e48c, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:06.913930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 882/1793] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:06.924795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ffaec-c90d-4c04-9641-13cf8c3407fe admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:06.980202 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 912/1794] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:06 2022] PUT /identity/v3/projects/ed018418d1b341e9b6d12a4007dd923a/users/d11b142ca5aa42089429a865a4c9e48c/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:06.982273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211649a-d383-4e85-bd42-90f4db8a3960 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:06.999084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce9fd-f16d-4b52-9435-9e3bff720fa0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:06.999839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce9fd-f16d-4b52-9435-9e3bff720fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:07.002041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce9fd-f16d-4b52-9435-9e3bff720fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:07.098735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-327ce9fd-f16d-4b52-9435-9e3bff720fa0 None None] MFA Rules not processed for user `d11b142ca5aa42089429a865a4c9e48c`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:07.100911 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211649a-d383-4e85-bd42-90f4db8a3960 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:07.103359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-327ce9fd-f16d-4b52-9435-9e3bff720fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:07.239425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:07.281336 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433fc7a-f098-4433-ae10-40ac5d2a0e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:07.289462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433fc7a-f098-4433-ae10-40ac5d2a0e7b service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:07.289767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433fc7a-f098-4433-ae10-40ac5d2a0e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:07.293038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433fc7a-f098-4433-ae10-40ac5d2a0e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:07.301215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5433fc7a-f098-4433-ae10-40ac5d2a0e7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:07.449881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 913/1795] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:07.472918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433fc7a-f098-4433-ae10-40ac5d2a0e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:07.475647 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433fc7a-f098-4433-ae10-40ac5d2a0e7b service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:07.491479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 883/1796] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:07.647216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce9fd-f16d-4b52-9435-9e3bff720fa0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:07.650823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-327ce9fd-f16d-4b52-9435-9e3bff720fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:07.675419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce9fd-f16d-4b52-9435-9e3bff720fa0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:07.687287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285ebad-a56d-4d63-86cf-b9ad1b911b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:07.688653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ebad-a56d-4d63-86cf-b9ad1b911b91 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:07.689168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ebad-a56d-4d63-86cf-b9ad1b911b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:07.689575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ebad-a56d-4d63-86cf-b9ad1b911b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:07.735626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285ebad-a56d-4d63-86cf-b9ad1b911b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:07.740302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285ebad-a56d-4d63-86cf-b9ad1b911b91 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:07.804080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 914/1797] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:07.870787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433fc7a-f098-4433-ae10-40ac5d2a0e7b service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:08.026519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433fc7a-f098-4433-ae10-40ac5d2a0e7b service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:08.034608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:08.036275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:08.036681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:08.037832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] PATH_INFO: `/v3/users/05266dff10fb403aaada6cf8644bca6f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:08.039227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05266dff10fb403aaada6cf8644bca6f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:08.043636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:08.167147 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05266dff10fb403aaada6cf8644bca6f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:08.186970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05266dff10fb403aaada6cf8644bca6f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:08.187820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05266dff10fb403aaada6cf8644bca6f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:08.188905 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05266dff10fb403aaada6cf8644bca6f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:08.206233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05266dff10fb403aaada6cf8644bca6f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:08.256499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 884/1798] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:07 2022] DELETE /identity/v3/users/05266dff10fb403aaada6cf8644bca6f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:08.261839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac70e6-1b4a-43a5-9184-5e78e482afce None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:08.262310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac70e6-1b4a-43a5-9184-5e78e482afce None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:08.262665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac70e6-1b4a-43a5-9184-5e78e482afce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:08.303541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b3ac70e6-1b4a-43a5-9184-5e78e482afce None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:08.305103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b3ac70e6-1b4a-43a5-9184-5e78e482afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:08.327160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:08.328866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:08.388960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:08.542503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 915/1799] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:08.553943 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aa407-940b-4afc-924e-4951671ce70a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:08.559277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:08.560452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:08.560950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:08.561228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] PATH_INFO: `/v3/users/5c1b82de83744122b2888e1940c23087` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:08.562934 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1b82de83744122b2888e1940c23087)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:08.564934 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:08.665307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1b82de83744122b2888e1940c23087'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:08.689571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac70e6-1b4a-43a5-9184-5e78e482afce None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:08.694105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b3ac70e6-1b4a-43a5-9184-5e78e482afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:08.709611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1b82de83744122b2888e1940c23087'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:08.713870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1b82de83744122b2888e1940c23087'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:08.719872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1b82de83744122b2888e1940c23087'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:08.760200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1b82de83744122b2888e1940c23087'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:08.808854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:08.860376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 885/1800] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:08 2022] DELETE /identity/v3/users/5c1b82de83744122b2888e1940c23087 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:08.957685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac70e6-1b4a-43a5-9184-5e78e482afce None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:09.151741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de53ee4-1545-4c2a-8648-befd9ab54ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:09.153505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de53ee4-1545-4c2a-8648-befd9ab54ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:09.153505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de53ee4-1545-4c2a-8648-befd9ab54ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:09.153505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de53ee4-1545-4c2a-8648-befd9ab54ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:09.155212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3de53ee4-1545-4c2a-8648-befd9ab54ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:09.377947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de53ee4-1545-4c2a-8648-befd9ab54ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:09.380324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de53ee4-1545-4c2a-8648-befd9ab54ffd service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:09.414171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:09.415698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:09.440791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ae322-db58-457f-95d4-05c477d76127 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:09.445155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 916/1801] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:09.453871 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:09.454562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:09.455266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:09.455266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] PATH_INFO: `/v3/projects/678745af53284b9d9de1013a0e78b5b5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:09.457448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] RBAC: Authorizing `identity:delete_project(project_id=678745af53284b9d9de1013a0e78b5b5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:09.459545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:09.631834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '678745af53284b9d9de1013a0e78b5b5', 'request_id': 'req-d4b89aff-6581-4167-8a11-0074a11f902e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:09.652568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '678745af53284b9d9de1013a0e78b5b5', 'request_id': 'req-d4b89aff-6581-4167-8a11-0074a11f902e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:09.677056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '678745af53284b9d9de1013a0e78b5b5', 'request_id': 'req-d4b89aff-6581-4167-8a11-0074a11f902e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:09.713407 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] The token cache is being invalidate because project 678745af53284b9d9de1013a0e78b5b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:09.713711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:09.717537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:09.721536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 886/1802] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:09 2022] DELETE /identity/v3/projects/678745af53284b9d9de1013a0e78b5b5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:09.731214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de53ee4-1545-4c2a-8648-befd9ab54ffd service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:09.758230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de53ee4-1545-4c2a-8648-befd9ab54ffd service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:10.033789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c271152-35f3-401a-a438-ea5328b6d9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:10.040046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c271152-35f3-401a-a438-ea5328b6d9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:10.040391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c271152-35f3-401a-a438-ea5328b6d9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:10.040681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c271152-35f3-401a-a438-ea5328b6d9cd admin admin] PATH_INFO: `/v3/users/6c15bb0d48744de1a9bbfa8678274e19` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:10.059095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c271152-35f3-401a-a438-ea5328b6d9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c15bb0d48744de1a9bbfa8678274e19)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:10.071542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c271152-35f3-401a-a438-ea5328b6d9cd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:10.188836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:10.243933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3c271152-35f3-401a-a438-ea5328b6d9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c15bb0d48744de1a9bbfa8678274e19'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:10.268969 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3c271152-35f3-401a-a438-ea5328b6d9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c15bb0d48744de1a9bbfa8678274e19'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:10.270438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3c271152-35f3-401a-a438-ea5328b6d9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c15bb0d48744de1a9bbfa8678274e19'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:10.271856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3c271152-35f3-401a-a438-ea5328b6d9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c15bb0d48744de1a9bbfa8678274e19'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:10.327123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3c271152-35f3-401a-a438-ea5328b6d9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c15bb0d48744de1a9bbfa8678274e19'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:10.384373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 917/1803] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:09 2022] DELETE /identity/v3/users/6c15bb0d48744de1a9bbfa8678274e19 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:11.222426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:11.224557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:11.273836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b89aff-6581-4167-8a11-0074a11f902e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:11.352918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:11.565892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:11.566548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:11.566827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:11.567106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] PATH_INFO: `/v3/projects/b71b4489a4fd4341bff03caf40441c6c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:11.571003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b71b4489a4fd4341bff03caf40441c6c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:11.578089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:11.808940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b71b4489a4fd4341bff03caf40441c6c', 'request_id': 'req-751c2bc9-d7a3-4eec-a436-2b05db41a483'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:11.862795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b71b4489a4fd4341bff03caf40441c6c', 'request_id': 'req-751c2bc9-d7a3-4eec-a436-2b05db41a483'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:11.896428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b71b4489a4fd4341bff03caf40441c6c', 'request_id': 'req-751c2bc9-d7a3-4eec-a436-2b05db41a483'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:11.955306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] The token cache is being invalidate because project b71b4489a4fd4341bff03caf40441c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:11.955628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:11.964549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-751c2bc9-d7a3-4eec-a436-2b05db41a483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:11.977152 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 887/1804] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:11 2022] DELETE /identity/v3/projects/b71b4489a4fd4341bff03caf40441c6c => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:11.978594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b033cb-620e-4791-b1f7-0b07bd0a91c0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:11.979346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b033cb-620e-4791-b1f7-0b07bd0a91c0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:11.979420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b033cb-620e-4791-b1f7-0b07bd0a91c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:12.042289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-05b033cb-620e-4791-b1f7-0b07bd0a91c0 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:12.043639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-05b033cb-620e-4791-b1f7-0b07bd0a91c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:12.364074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd803e22-f313-4b34-9da0-12925d3e898f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:12.365120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd803e22-f313-4b34-9da0-12925d3e898f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:12.365660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd803e22-f313-4b34-9da0-12925d3e898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:12.373928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 918/1805] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:12.404138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fd803e22-f313-4b34-9da0-12925d3e898f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:12.408811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fd803e22-f313-4b34-9da0-12925d3e898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:12.446140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b033cb-620e-4791-b1f7-0b07bd0a91c0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:12.460733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 888/1806] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:12.466324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b033cb-620e-4791-b1f7-0b07bd0a91c0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:12.485225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c037a6-2343-45d1-be0d-f606a3af961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:12.485902 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c037a6-2343-45d1-be0d-f606a3af961a admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:12.486179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c037a6-2343-45d1-be0d-f606a3af961a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:12.486446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c037a6-2343-45d1-be0d-f606a3af961a admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:12.487424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c037a6-2343-45d1-be0d-f606a3af961a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:12.488483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c037a6-2343-45d1-be0d-f606a3af961a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:12.492632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c037a6-2343-45d1-be0d-f606a3af961a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:12.516932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd803e22-f313-4b34-9da0-12925d3e898f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:12.528075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 919/1807] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:25:12.535855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd803e22-f313-4b34-9da0-12925d3e898f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:12.546040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfb7f1-34ce-4f12-bf5a-899520f6b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:12.547014 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfb7f1-34ce-4f12-bf5a-899520f6b552 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:12.547313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfb7f1-34ce-4f12-bf5a-899520f6b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:12.547641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfb7f1-34ce-4f12-bf5a-899520f6b552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:12.548325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfb7f1-34ce-4f12-bf5a-899520f6b552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:12.552941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfb7f1-34ce-4f12-bf5a-899520f6b552 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:12.658611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 889/1808] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:12 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:12.662957 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c037a6-2343-45d1-be0d-f606a3af961a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:12.678577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c037a6-2343-45d1-be0d-f606a3af961a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:12.848215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d063ade-65e7-4ea8-9ebf-ad0df273c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:12.848803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d063ade-65e7-4ea8-9ebf-ad0df273c6ce admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:12.849103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d063ade-65e7-4ea8-9ebf-ad0df273c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:12.849374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d063ade-65e7-4ea8-9ebf-ad0df273c6ce admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:12.850005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d063ade-65e7-4ea8-9ebf-ad0df273c6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:12.852208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d063ade-65e7-4ea8-9ebf-ad0df273c6ce admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:12.899242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 920/1809] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:12 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:12.904833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfb7f1-34ce-4f12-bf5a-899520f6b552 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:12.917261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfb7f1-34ce-4f12-bf5a-899520f6b552 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:12.922856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63097cd3-ecf8-49af-a132-32c7a02b3bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:12.923480 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63097cd3-ecf8-49af-a132-32c7a02b3bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:12.923758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63097cd3-ecf8-49af-a132-32c7a02b3bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:12.926546 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63097cd3-ecf8-49af-a132-32c7a02b3bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:12.927297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63097cd3-ecf8-49af-a132-32c7a02b3bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:12.928978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63097cd3-ecf8-49af-a132-32c7a02b3bc5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:12.943141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 890/1810] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:12.947473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d063ade-65e7-4ea8-9ebf-ad0df273c6ce admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:12.968714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d063ade-65e7-4ea8-9ebf-ad0df273c6ce admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:12.989709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fd4b0-ea34-4be9-b01a-a42a9f4cf388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:12.991771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fd4b0-ea34-4be9-b01a-a42a9f4cf388 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:12.992458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fd4b0-ea34-4be9-b01a-a42a9f4cf388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:12.993236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fd4b0-ea34-4be9-b01a-a42a9f4cf388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:13.002259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fd4b0-ea34-4be9-b01a-a42a9f4cf388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:13.005364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fd4b0-ea34-4be9-b01a-a42a9f4cf388 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:13.029701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 921/1811] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:13.037833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63097cd3-ecf8-49af-a132-32c7a02b3bc5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:13.071896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63097cd3-ecf8-49af-a132-32c7a02b3bc5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:13.101595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314df796-02f0-4e41-89a7-fbc365ce0018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:13.103160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314df796-02f0-4e41-89a7-fbc365ce0018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:13.105818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314df796-02f0-4e41-89a7-fbc365ce0018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:13.108700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314df796-02f0-4e41-89a7-fbc365ce0018 admin admin] PATH_INFO: `/v3/projects/8994f2682da84e328efb0881a6607c5d/users/8897d692c4e4438aadf657335122d1d6/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:13.137696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fd4b0-ea34-4be9-b01a-a42a9f4cf388 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:13.140988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e75fd4b0-ea34-4be9-b01a-a42a9f4cf388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:13.157957 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314df796-02f0-4e41-89a7-fbc365ce0018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8994f2682da84e328efb0881a6607c5d, user_id=8897d692c4e4438aadf657335122d1d6, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:13.159034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fd4b0-ea34-4be9-b01a-a42a9f4cf388 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:13.164903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:13.165358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314df796-02f0-4e41-89a7-fbc365ce0018 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:13.165542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:13.165827 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:13.166101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] PATH_INFO: `/v3/projects/2758f271cbb947018fc5fbf91e15371a` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:13.167233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2758f271cbb947018fc5fbf91e15371a)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:13.170443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:13.198136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 891/1812] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:13 2022] PUT /identity/v3/projects/8994f2682da84e328efb0881a6607c5d/users/8897d692c4e4438aadf657335122d1d6/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:13.209580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:13.212451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88f3ac-3fc3-4a9f-afea-10322a980034 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:13.213098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88f3ac-3fc3-4a9f-afea-10322a980034 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:13.213574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88f3ac-3fc3-4a9f-afea-10322a980034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:13.279204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2b88f3ac-3fc3-4a9f-afea-10322a980034 None None] MFA Rules not processed for user `8897d692c4e4438aadf657335122d1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:13.281069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2b88f3ac-3fc3-4a9f-afea-10322a980034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:13.323039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2758f271cbb947018fc5fbf91e15371a', 'request_id': 'req-2be9c325-b496-4f68-aa48-23e75083cbe2'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:13.335649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2758f271cbb947018fc5fbf91e15371a', 'request_id': 'req-2be9c325-b496-4f68-aa48-23e75083cbe2'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:13.359559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2758f271cbb947018fc5fbf91e15371a', 'request_id': 'req-2be9c325-b496-4f68-aa48-23e75083cbe2'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:13.367754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:13.377472 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] The token cache is being invalidate because project 2758f271cbb947018fc5fbf91e15371a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:13.377764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:13.378616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:13.382211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 922/1813] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:13 2022] DELETE /identity/v3/projects/2758f271cbb947018fc5fbf91e15371a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:13.390516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:13.395166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:13.459825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 892/1814] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:13.462904 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88f3ac-3fc3-4a9f-afea-10322a980034 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:13.466544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2b88f3ac-3fc3-4a9f-afea-10322a980034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:13.507020 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9c325-b496-4f68-aa48-23e75083cbe2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:13.514573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:13.515415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:13.516392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:13.516679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] PATH_INFO: `/v3/users/d11b142ca5aa42089429a865a4c9e48c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:13.517911 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11b142ca5aa42089429a865a4c9e48c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:13.521355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:13.577501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88f3ac-3fc3-4a9f-afea-10322a980034 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:13.583116 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d271633-3085-46d5-bf53-fe3673174e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:13.583845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d271633-3085-46d5-bf53-fe3673174e34 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:13.584422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d271633-3085-46d5-bf53-fe3673174e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:13.584802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d271633-3085-46d5-bf53-fe3673174e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:13.585693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d271633-3085-46d5-bf53-fe3673174e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:13.594218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d271633-3085-46d5-bf53-fe3673174e34 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:13.612178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11b142ca5aa42089429a865a4c9e48c'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:13.630084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11b142ca5aa42089429a865a4c9e48c'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:13.631506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11b142ca5aa42089429a865a4c9e48c'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:13.634046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11b142ca5aa42089429a865a4c9e48c'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:13.662248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11b142ca5aa42089429a865a4c9e48c'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:13.663964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 893/1815] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:13 2022] POST /identity/v3/projects => generated 369 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:13.670231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0437a-c047-4f30-a5a7-17b23589c3c5 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:13.672539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0437a-c047-4f30-a5a7-17b23589c3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:13.672971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0437a-c047-4f30-a5a7-17b23589c3c5 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:13.674519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 894/1816] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:25:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:25:13.676699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0437a-c047-4f30-a5a7-17b23589c3c5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:13.683307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a5a0437a-c047-4f30-a5a7-17b23589c3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:13.687954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 923/1817] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:13 2022] DELETE /identity/v3/users/d11b142ca5aa42089429a865a4c9e48c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:13.689203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:13.690960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:13.716849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:13.786424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ed70b-fd80-430f-b4e1-cb01f17e5cec admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:13.791883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecc0e2-481f-43a0-b234-687126e3fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:13.792638 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc0e2-481f-43a0-b234-687126e3fc72 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:13.793573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc0e2-481f-43a0-b234-687126e3fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:13.793573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecc0e2-481f-43a0-b234-687126e3fc72 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:13.795281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecc0e2-481f-43a0-b234-687126e3fc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:13.797415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecc0e2-481f-43a0-b234-687126e3fc72 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:13.801429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0437a-c047-4f30-a5a7-17b23589c3c5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:13.811496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a46c37-16ff-4695-be4e-848696f21741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:13.812679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a46c37-16ff-4695-be4e-848696f21741 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:13.812976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a46c37-16ff-4695-be4e-848696f21741 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:13.813230 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a46c37-16ff-4695-be4e-848696f21741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:13.817820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-28a46c37-16ff-4695-be4e-848696f21741 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:13.844215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 924/1818] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:13 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:13.848430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249a834-f18d-4112-a39a-6da6f310b540 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:13.849810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249a834-f18d-4112-a39a-6da6f310b540 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:13.850101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249a834-f18d-4112-a39a-6da6f310b540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:13.894687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a249a834-f18d-4112-a39a-6da6f310b540 None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:13.898991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a249a834-f18d-4112-a39a-6da6f310b540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:13.983813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a46c37-16ff-4695-be4e-848696f21741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:13.985627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a46c37-16ff-4695-be4e-848696f21741 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:13.998275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 895/1819] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:14.000432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a46c37-16ff-4695-be4e-848696f21741 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:14.000669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 925/1820] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:25:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:14.026640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a46c37-16ff-4695-be4e-848696f21741 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:14.045359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88715a-6fac-4476-bf2e-bc1826c32e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:14.046258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88715a-6fac-4476-bf2e-bc1826c32e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:14.046718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88715a-6fac-4476-bf2e-bc1826c32e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:14.047168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88715a-6fac-4476-bf2e-bc1826c32e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:14.048019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88715a-6fac-4476-bf2e-bc1826c32e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:14.050489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88715a-6fac-4476-bf2e-bc1826c32e6b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:14.059267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249a834-f18d-4112-a39a-6da6f310b540 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:14.062278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a249a834-f18d-4112-a39a-6da6f310b540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:14.064816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 896/1821] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:14.071469 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88715a-6fac-4476-bf2e-bc1826c32e6b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:14.078708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249a834-f18d-4112-a39a-6da6f310b540 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:14.084835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:14.085128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4cf78-f86c-4874-9e06-1cb6a3a1419c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:14.085858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4cf78-f86c-4874-9e06-1cb6a3a1419c service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:14.086238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4cf78-f86c-4874-9e06-1cb6a3a1419c service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:14.086615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4cf78-f86c-4874-9e06-1cb6a3a1419c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:14.097737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88715a-6fac-4476-bf2e-bc1826c32e6b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:14.104832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786b610-5a0d-4e84-8a4f-0b4a2d683553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:14.105544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b610-5a0d-4e84-8a4f-0b4a2d683553 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:14.107057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b610-5a0d-4e84-8a4f-0b4a2d683553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:14.107393 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786b610-5a0d-4e84-8a4f-0b4a2d683553 admin admin] PATH_INFO: `/v3/projects/0e68a1669b004c26a785f272bb00c16b/users/4d84870d57cd44ecbe918a4125cc512b/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:14.109055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4cf78-f86c-4874-9e06-1cb6a3a1419c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:14.113750 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4cf78-f86c-4874-9e06-1cb6a3a1419c service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:14.127868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786b610-5a0d-4e84-8a4f-0b4a2d683553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e68a1669b004c26a785f272bb00c16b, user_id=4d84870d57cd44ecbe918a4125cc512b, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:14.131445 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786b610-5a0d-4e84-8a4f-0b4a2d683553 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:14.140783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 926/1822] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:25:14.176424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 897/1823] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:14 2022] PUT /identity/v3/projects/0e68a1669b004c26a785f272bb00c16b/users/4d84870d57cd44ecbe918a4125cc512b/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:14.180977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4cf78-f86c-4874-9e06-1cb6a3a1419c service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:14.196386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4cf78-f86c-4874-9e06-1cb6a3a1419c service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:14.319964 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3eb342-c377-494b-bed9-058ac2e73af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:14.320886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3eb342-c377-494b-bed9-058ac2e73af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:14.321308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3eb342-c377-494b-bed9-058ac2e73af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:14.321847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3eb342-c377-494b-bed9-058ac2e73af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:14.323425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3eb342-c377-494b-bed9-058ac2e73af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:14.326779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3eb342-c377-494b-bed9-058ac2e73af4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:14.340613 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 927/1824] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:14.345444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786b610-5a0d-4e84-8a4f-0b4a2d683553 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:14.361632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786b610-5a0d-4e84-8a4f-0b4a2d683553 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:14.379352 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e233a47-e23d-494c-8de1-e93b44199bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:14.380093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233a47-e23d-494c-8de1-e93b44199bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:14.380379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233a47-e23d-494c-8de1-e93b44199bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:14.380660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233a47-e23d-494c-8de1-e93b44199bf8 admin admin] PATH_INFO: `/v3/projects/0e68a1669b004c26a785f272bb00c16b/users/4d84870d57cd44ecbe918a4125cc512b/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:14.382935 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e233a47-e23d-494c-8de1-e93b44199bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e68a1669b004c26a785f272bb00c16b, user_id=4d84870d57cd44ecbe918a4125cc512b, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:14.387278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e233a47-e23d-494c-8de1-e93b44199bf8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:14.436979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93b855-8b0b-4e9d-8129-51f90319e681 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:14.437267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93b855-8b0b-4e9d-8129-51f90319e681 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:14.437548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93b855-8b0b-4e9d-8129-51f90319e681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:14.440596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 898/1825] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:14 2022] PUT /identity/v3/projects/0e68a1669b004c26a785f272bb00c16b/users/4d84870d57cd44ecbe918a4125cc512b/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:14.479521 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cbb7f-097f-4ad4-8203-0cddf3df73c0 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:14.479825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cbb7f-097f-4ad4-8203-0cddf3df73c0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:14.481719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cbb7f-097f-4ad4-8203-0cddf3df73c0 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:14.483170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 899/1826] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:25:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:25:14.501327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da82b32-33cc-456a-817e-70575ba54aa4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:14.501695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da82b32-33cc-456a-817e-70575ba54aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:14.501975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da82b32-33cc-456a-817e-70575ba54aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:14.551093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ee93b855-8b0b-4e9d-8129-51f90319e681 None None] MFA Rules not processed for user `4d84870d57cd44ecbe918a4125cc512b`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:14.563513 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5da82b32-33cc-456a-817e-70575ba54aa4 None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:14.565547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ee93b855-8b0b-4e9d-8129-51f90319e681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:14.569902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5da82b32-33cc-456a-817e-70575ba54aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:14.587831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:14.711795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 928/1827] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:14.712298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93b855-8b0b-4e9d-8129-51f90319e681 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:14.713754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ee93b855-8b0b-4e9d-8129-51f90319e681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:14.735371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 900/1828] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:25:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:14.768515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da82b32-33cc-456a-817e-70575ba54aa4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:14.845569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93b855-8b0b-4e9d-8129-51f90319e681 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:14.858917 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:14.861518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:14.863008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:14.864191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] PATH_INFO: `/v3/projects/ed018418d1b341e9b6d12a4007dd923a` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:14.866160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed018418d1b341e9b6d12a4007dd923a)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:14.872835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:14.881847 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da82b32-33cc-456a-817e-70575ba54aa4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:14.885874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42626b-e7ba-46e7-81d6-5fef2be2342a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:14.886514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42626b-e7ba-46e7-81d6-5fef2be2342a service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:14.886792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42626b-e7ba-46e7-81d6-5fef2be2342a service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:14.887119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42626b-e7ba-46e7-81d6-5fef2be2342a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:14.913858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42626b-e7ba-46e7-81d6-5fef2be2342a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:14.915335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42626b-e7ba-46e7-81d6-5fef2be2342a service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:14.932948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 901/1829] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:25:14.948034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42626b-e7ba-46e7-81d6-5fef2be2342a service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:14.955441 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4f42626b-e7ba-46e7-81d6-5fef2be2342a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:15.005800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42626b-e7ba-46e7-81d6-5fef2be2342a service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:15.012178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed018418d1b341e9b6d12a4007dd923a', 'request_id': 'req-103c5fb3-f9c9-426b-b2e8-e931b67a778a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:15.031734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed018418d1b341e9b6d12a4007dd923a', 'request_id': 'req-103c5fb3-f9c9-426b-b2e8-e931b67a778a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:15.051425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed018418d1b341e9b6d12a4007dd923a', 'request_id': 'req-103c5fb3-f9c9-426b-b2e8-e931b67a778a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:15.080773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] The token cache is being invalidate because project ed018418d1b341e9b6d12a4007dd923a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:15.081104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:15.082219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-103c5fb3-f9c9-426b-b2e8-e931b67a778a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:15.086065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 929/1830] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:14 2022] DELETE /identity/v3/projects/ed018418d1b341e9b6d12a4007dd923a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:15.091773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c4900-047b-42b9-a8ed-e13f2c99b791 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:15.092072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c4900-047b-42b9-a8ed-e13f2c99b791 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:15.092365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c4900-047b-42b9-a8ed-e13f2c99b791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:15.143188 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:15.160351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-bd2c4900-047b-42b9-a8ed-e13f2c99b791 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:15.161618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bd2c4900-047b-42b9-a8ed-e13f2c99b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:15.165011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683a99d-6c42-499f-b762-d52456bb1110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:15.165797 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683a99d-6c42-499f-b762-d52456bb1110 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:15.173796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683a99d-6c42-499f-b762-d52456bb1110 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:15.174343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683a99d-6c42-499f-b762-d52456bb1110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:15.186532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4683a99d-6c42-499f-b762-d52456bb1110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:15.218344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683a99d-6c42-499f-b762-d52456bb1110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:15.220505 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683a99d-6c42-499f-b762-d52456bb1110 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:15.246141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:15.250344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 902/1831] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:15.355593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 930/1832] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:15.359434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4296b0-6379-4739-a216-7983116546eb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:15.359995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4296b0-6379-4739-a216-7983116546eb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:15.360633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4296b0-6379-4739-a216-7983116546eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:15.396829 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1e4296b0-6379-4739-a216-7983116546eb None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:15.397478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1e4296b0-6379-4739-a216-7983116546eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:15.410572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 903/1833] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:15.415251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c4900-047b-42b9-a8ed-e13f2c99b791 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:15.432804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c4900-047b-42b9-a8ed-e13f2c99b791 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:15.449778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1079f-1162-4d7f-b931-152fc2bf47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:15.451932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1079f-1162-4d7f-b931-152fc2bf47d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:15.452207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1079f-1162-4d7f-b931-152fc2bf47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:15.452484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1079f-1162-4d7f-b931-152fc2bf47d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:15.453519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1079f-1162-4d7f-b931-152fc2bf47d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:15.454477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1079f-1162-4d7f-b931-152fc2bf47d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:15.459252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1079f-1162-4d7f-b931-152fc2bf47d5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:15.501557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 931/1834] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:25:15.506975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4296b0-6379-4739-a216-7983116546eb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:15.528619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4296b0-6379-4739-a216-7983116546eb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:15.538599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872a676-0512-41a0-a6f5-e568e4e11513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:15.542373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872a676-0512-41a0-a6f5-e568e4e11513 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:15.542663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872a676-0512-41a0-a6f5-e568e4e11513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:15.542949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872a676-0512-41a0-a6f5-e568e4e11513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:15.544998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872a676-0512-41a0-a6f5-e568e4e11513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:15.552115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872a676-0512-41a0-a6f5-e568e4e11513 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:15.646071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 904/1835] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:15 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:15.650303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1079f-1162-4d7f-b931-152fc2bf47d5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:15.678235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1079f-1162-4d7f-b931-152fc2bf47d5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:15.790999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a96c1-993e-4394-9712-18673eb0fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:15.792619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a96c1-993e-4394-9712-18673eb0fac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:15.795300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a96c1-993e-4394-9712-18673eb0fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:15.804339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a96c1-993e-4394-9712-18673eb0fac1 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:15.806783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a96c1-993e-4394-9712-18673eb0fac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:15.813750 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a96c1-993e-4394-9712-18673eb0fac1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:15.864844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 932/1836] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:15 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:15.868886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872a676-0512-41a0-a6f5-e568e4e11513 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:15.884459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872a676-0512-41a0-a6f5-e568e4e11513 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:15.893249 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0057a8c-dbcd-45a3-821c-d5e271133b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:15.893966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057a8c-dbcd-45a3-821c-d5e271133b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:15.894306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057a8c-dbcd-45a3-821c-d5e271133b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:15.894646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057a8c-dbcd-45a3-821c-d5e271133b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:15.897337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0057a8c-dbcd-45a3-821c-d5e271133b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:15.899001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0057a8c-dbcd-45a3-821c-d5e271133b86 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:15.916424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 905/1837] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:15.921513 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a96c1-993e-4394-9712-18673eb0fac1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:15.935278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a96c1-993e-4394-9712-18673eb0fac1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:15.941708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b10c5-8e02-4c8b-9c14-7e7b37b62f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:15.943086 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b10c5-8e02-4c8b-9c14-7e7b37b62f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:15.943944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b10c5-8e02-4c8b-9c14-7e7b37b62f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:15.944330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b10c5-8e02-4c8b-9c14-7e7b37b62f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:15.945079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b10c5-8e02-4c8b-9c14-7e7b37b62f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:15.947486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b10c5-8e02-4c8b-9c14-7e7b37b62f7d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:15.964657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 933/1838] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:15.969904 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0057a8c-dbcd-45a3-821c-d5e271133b86 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:15.987485 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0057a8c-dbcd-45a3-821c-d5e271133b86 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:16.001024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f697dd-056c-4c48-b4f7-b1289a8dcc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:16.002765 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f697dd-056c-4c48-b4f7-b1289a8dcc2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:16.003534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f697dd-056c-4c48-b4f7-b1289a8dcc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:16.005425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f697dd-056c-4c48-b4f7-b1289a8dcc2b admin admin] PATH_INFO: `/v3/projects/d1d8f95fd8064447a8fe2d532cedfa1c/users/e8dfd29beabf47f68f15509e948c3234/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:16.038870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f697dd-056c-4c48-b4f7-b1289a8dcc2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d8f95fd8064447a8fe2d532cedfa1c, user_id=e8dfd29beabf47f68f15509e948c3234, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:16.046878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f697dd-056c-4c48-b4f7-b1289a8dcc2b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:16.067084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 906/1839] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:15 2022] PUT /identity/v3/projects/d1d8f95fd8064447a8fe2d532cedfa1c/users/e8dfd29beabf47f68f15509e948c3234/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:16.080529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ae25-89a2-4eec-8340-e3068fa2b39b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:16.081270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ae25-89a2-4eec-8340-e3068fa2b39b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:16.081270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ae25-89a2-4eec-8340-e3068fa2b39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:16.115540 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d855ae25-89a2-4eec-8340-e3068fa2b39b None None] MFA Rules not processed for user `e8dfd29beabf47f68f15509e948c3234`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:16.117383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d855ae25-89a2-4eec-8340-e3068fa2b39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:16.231957 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 934/1840] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:16.236158 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f697dd-056c-4c48-b4f7-b1289a8dcc2b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:16.400832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f697dd-056c-4c48-b4f7-b1289a8dcc2b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:16.400832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2928b-1b74-42ee-b0e9-37624e18d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:16.400832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2928b-1b74-42ee-b0e9-37624e18d64d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:16.400832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2928b-1b74-42ee-b0e9-37624e18d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:16.401751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2928b-1b74-42ee-b0e9-37624e18d64d admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:16.401751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2928b-1b74-42ee-b0e9-37624e18d64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:16.401751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2928b-1b74-42ee-b0e9-37624e18d64d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:16.450019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 907/1841] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:16 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:16.454528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855ae25-89a2-4eec-8340-e3068fa2b39b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:16.471262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855ae25-89a2-4eec-8340-e3068fa2b39b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:16.510274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:16.573187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2e043-83c2-473d-9be5-ec5e698efa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:16.573959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e043-83c2-473d-9be5-ec5e698efa1f admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:16.574306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e043-83c2-473d-9be5-ec5e698efa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:16.574976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2e043-83c2-473d-9be5-ec5e698efa1f admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:16.576234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2e043-83c2-473d-9be5-ec5e698efa1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:16.579867 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2e043-83c2-473d-9be5-ec5e698efa1f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:16.631432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 935/1842] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:16 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:16.635586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2928b-1b74-42ee-b0e9-37624e18d64d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:16.650832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2928b-1b74-42ee-b0e9-37624e18d64d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:16.662540 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c31b3-510b-4bd4-94b9-e04da133206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:16.663162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c31b3-510b-4bd4-94b9-e04da133206a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:16.663683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c31b3-510b-4bd4-94b9-e04da133206a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:16.664185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c31b3-510b-4bd4-94b9-e04da133206a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:16.665026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c31b3-510b-4bd4-94b9-e04da133206a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:16.667568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c31b3-510b-4bd4-94b9-e04da133206a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:16.702495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 908/1843] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:16.706770 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2e043-83c2-473d-9be5-ec5e698efa1f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:16.723558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2e043-83c2-473d-9be5-ec5e698efa1f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:16.736966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7307b-474b-48b8-8be2-7fc329a791c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:16.737742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7307b-474b-48b8-8be2-7fc329a791c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:16.738090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7307b-474b-48b8-8be2-7fc329a791c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:16.738382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7307b-474b-48b8-8be2-7fc329a791c2 admin admin] PATH_INFO: `/v3/projects/5c56e53b40d64e03ac7fe73b5642a56c/users/f9f6152364274a9eaac405eb06e85a96/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:16.771114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7307b-474b-48b8-8be2-7fc329a791c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c56e53b40d64e03ac7fe73b5642a56c, user_id=f9f6152364274a9eaac405eb06e85a96, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:16.775913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7307b-474b-48b8-8be2-7fc329a791c2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:16.815227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 936/1844] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:16 2022] PUT /identity/v3/projects/5c56e53b40d64e03ac7fe73b5642a56c/users/f9f6152364274a9eaac405eb06e85a96/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:16.815536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c31b3-510b-4bd4-94b9-e04da133206a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:16.839316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c31b3-510b-4bd4-94b9-e04da133206a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:16.933541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:16.949375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be71663-5195-459a-a34e-3135182ce6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:16.951424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be71663-5195-459a-a34e-3135182ce6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:16.951942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be71663-5195-459a-a34e-3135182ce6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:16.952294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be71663-5195-459a-a34e-3135182ce6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:16.952946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be71663-5195-459a-a34e-3135182ce6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:16.954826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be71663-5195-459a-a34e-3135182ce6cd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:16.996039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 909/1845] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:17.001302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7307b-474b-48b8-8be2-7fc329a791c2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:17.030294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7307b-474b-48b8-8be2-7fc329a791c2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:17.038212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96672f0f-a9e9-4028-b139-d1abb745f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:17.039161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96672f0f-a9e9-4028-b139-d1abb745f817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:17.039784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96672f0f-a9e9-4028-b139-d1abb745f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:17.040352 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96672f0f-a9e9-4028-b139-d1abb745f817 admin admin] PATH_INFO: `/v3/projects/5c56e53b40d64e03ac7fe73b5642a56c/users/f9f6152364274a9eaac405eb06e85a96/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:17.043362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96672f0f-a9e9-4028-b139-d1abb745f817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c56e53b40d64e03ac7fe73b5642a56c, user_id=f9f6152364274a9eaac405eb06e85a96, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:17.048566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96672f0f-a9e9-4028-b139-d1abb745f817 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:17.084026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 937/1846] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:17 2022] PUT /identity/v3/projects/5c56e53b40d64e03ac7fe73b5642a56c/users/f9f6152364274a9eaac405eb06e85a96/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:17.096165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ee076-8d46-453a-9ab6-ffd6b21ff916 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:17.096165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ee076-8d46-453a-9ab6-ffd6b21ff916 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:17.096165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ee076-8d46-453a-9ab6-ffd6b21ff916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:17.137961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9e3ee076-8d46-453a-9ab6-ffd6b21ff916 None None] MFA Rules not processed for user `f9f6152364274a9eaac405eb06e85a96`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:17.145769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9e3ee076-8d46-453a-9ab6-ffd6b21ff916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:17.291336 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 910/1847] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:17.307047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96672f0f-a9e9-4028-b139-d1abb745f817 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:17.311440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-96672f0f-a9e9-4028-b139-d1abb745f817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:17.426204 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96672f0f-a9e9-4028-b139-d1abb745f817 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:17.435929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c582b-ea45-46ca-9940-0abf5d79f888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:17.436928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c582b-ea45-46ca-9940-0abf5d79f888 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:17.437345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c582b-ea45-46ca-9940-0abf5d79f888 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:17.437716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c582b-ea45-46ca-9940-0abf5d79f888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:17.454395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c582b-ea45-46ca-9940-0abf5d79f888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:17.456598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c582b-ea45-46ca-9940-0abf5d79f888 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:17.492894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 938/1848] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:17.507232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ee076-8d46-453a-9ab6-ffd6b21ff916 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:17.508899 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9e3ee076-8d46-453a-9ab6-ffd6b21ff916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:17.682435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ee076-8d46-453a-9ab6-ffd6b21ff916 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:17.694602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:17.697700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:17.698468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:17.700487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] PATH_INFO: `/v3/users/47bf6d7531db44778694f1581d284a79` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:17.702342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bf6d7531db44778694f1581d284a79)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:17.707238 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:17.804556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bf6d7531db44778694f1581d284a79'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:17.813642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bf6d7531db44778694f1581d284a79'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:17.815681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bf6d7531db44778694f1581d284a79'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:17.818224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bf6d7531db44778694f1581d284a79'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:17.833633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bf6d7531db44778694f1581d284a79'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:17.855172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:17.866486 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 911/1849] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:17 2022] DELETE /identity/v3/users/47bf6d7531db44778694f1581d284a79 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:17.871468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498df7ac-f8f0-448d-aee1-67af7622801e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:17.871635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498df7ac-f8f0-448d-aee1-67af7622801e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:17.872039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498df7ac-f8f0-448d-aee1-67af7622801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:17.904421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-498df7ac-f8f0-448d-aee1-67af7622801e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:17.905960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-498df7ac-f8f0-448d-aee1-67af7622801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:17.989312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 939/1850] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:18.000086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:18.004110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:18.073931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e950231-c58f-465d-a96e-7cf0ff462a63 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:18.077908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7b075-9cc5-4334-ad61-476a8f461a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:18.078628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b075-9cc5-4334-ad61-476a8f461a49 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:18.079005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b075-9cc5-4334-ad61-476a8f461a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:18.079433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b075-9cc5-4334-ad61-476a8f461a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:18.097875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7b075-9cc5-4334-ad61-476a8f461a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:18.099449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7b075-9cc5-4334-ad61-476a8f461a49 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:18.105076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498df7ac-f8f0-448d-aee1-67af7622801e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:18.110409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-498df7ac-f8f0-448d-aee1-67af7622801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:18.112981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 912/1851] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:18.126434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498df7ac-f8f0-448d-aee1-67af7622801e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:18.134946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d459264-9314-4356-9aff-5bad3264f063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:18.135652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d459264-9314-4356-9aff-5bad3264f063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:18.136135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d459264-9314-4356-9aff-5bad3264f063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:18.136692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d459264-9314-4356-9aff-5bad3264f063 admin admin] PATH_INFO: `/v3/users/e8dfd29beabf47f68f15509e948c3234` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:18.138325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d459264-9314-4356-9aff-5bad3264f063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8dfd29beabf47f68f15509e948c3234)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:18.141326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d459264-9314-4356-9aff-5bad3264f063 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:18.172672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:18.202230 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7b075-9cc5-4334-ad61-476a8f461a49 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:18.203964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cae7b075-9cc5-4334-ad61-476a8f461a49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:18.209834 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8d459264-9314-4356-9aff-5bad3264f063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8dfd29beabf47f68f15509e948c3234'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.220981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8d459264-9314-4356-9aff-5bad3264f063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8dfd29beabf47f68f15509e948c3234'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.222816 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8d459264-9314-4356-9aff-5bad3264f063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8dfd29beabf47f68f15509e948c3234'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.223517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8d459264-9314-4356-9aff-5bad3264f063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8dfd29beabf47f68f15509e948c3234'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.224796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7b075-9cc5-4334-ad61-476a8f461a49 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:18.230873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53bd95-e3ab-4ade-bd62-5221195ea1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:18.232165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53bd95-e3ab-4ade-bd62-5221195ea1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:18.232468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53bd95-e3ab-4ade-bd62-5221195ea1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:18.232730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53bd95-e3ab-4ade-bd62-5221195ea1b1 admin admin] PATH_INFO: `/v3/users/8897d692c4e4438aadf657335122d1d6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:18.234035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53bd95-e3ab-4ade-bd62-5221195ea1b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8897d692c4e4438aadf657335122d1d6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:18.236573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53bd95-e3ab-4ade-bd62-5221195ea1b1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:18.254973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8d459264-9314-4356-9aff-5bad3264f063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8dfd29beabf47f68f15509e948c3234'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.273207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 940/1852] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:18 2022] DELETE /identity/v3/users/e8dfd29beabf47f68f15509e948c3234 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:18.289466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147375b-e83c-42ea-9ebf-de28a24f131f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:18.289772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147375b-e83c-42ea-9ebf-de28a24f131f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:18.290044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147375b-e83c-42ea-9ebf-de28a24f131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:18.311797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9147375b-e83c-42ea-9ebf-de28a24f131f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:18.313330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9147375b-e83c-42ea-9ebf-de28a24f131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:18.330244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bb53bd95-e3ab-4ade-bd62-5221195ea1b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8897d692c4e4438aadf657335122d1d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.340220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bb53bd95-e3ab-4ade-bd62-5221195ea1b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8897d692c4e4438aadf657335122d1d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.341913 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bb53bd95-e3ab-4ade-bd62-5221195ea1b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8897d692c4e4438aadf657335122d1d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.342776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bb53bd95-e3ab-4ade-bd62-5221195ea1b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8897d692c4e4438aadf657335122d1d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.358612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bb53bd95-e3ab-4ade-bd62-5221195ea1b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8897d692c4e4438aadf657335122d1d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.382787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 913/1853] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:18 2022] DELETE /identity/v3/users/8897d692c4e4438aadf657335122d1d6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:18.389698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113dfd1-aad4-4aa5-b2f6-d0398d2f8953 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:18.389985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113dfd1-aad4-4aa5-b2f6-d0398d2f8953 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:18.390265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113dfd1-aad4-4aa5-b2f6-d0398d2f8953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:18.394404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 941/1854] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:18.401283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147375b-e83c-42ea-9ebf-de28a24f131f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:18.418206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2113dfd1-aad4-4aa5-b2f6-d0398d2f8953 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:18.420371 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9147375b-e83c-42ea-9ebf-de28a24f131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:18.420515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2113dfd1-aad4-4aa5-b2f6-d0398d2f8953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:18.499922 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147375b-e83c-42ea-9ebf-de28a24f131f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:18.508984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 914/1855] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:18.521860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113dfd1-aad4-4aa5-b2f6-d0398d2f8953 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:18.523203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2113dfd1-aad4-4aa5-b2f6-d0398d2f8953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:18.545939 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:18.572160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84addd7-9671-4f83-9430-46437037a76b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:18.572693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84addd7-9671-4f83-9430-46437037a76b service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:18.572967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84addd7-9671-4f83-9430-46437037a76b service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:18.573237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84addd7-9671-4f83-9430-46437037a76b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:18.589059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84addd7-9671-4f83-9430-46437037a76b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:18.589059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84addd7-9671-4f83-9430-46437037a76b service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:18.594141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:18.611154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 942/1856] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:18.631096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113dfd1-aad4-4aa5-b2f6-d0398d2f8953 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:18.645826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84addd7-9671-4f83-9430-46437037a76b service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:18.647667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a84addd7-9671-4f83-9430-46437037a76b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:18.658727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c507057-5af8-4477-82ed-dece8f30d395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:18.661100 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507057-5af8-4477-82ed-dece8f30d395 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:18.661393 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507057-5af8-4477-82ed-dece8f30d395 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:18.661670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c507057-5af8-4477-82ed-dece8f30d395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:18.670863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84addd7-9671-4f83-9430-46437037a76b service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:18.682164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:18.682934 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:18.683156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:18.683674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] PATH_INFO: `/v3/projects/374ea66ff6e741628e8d53350a599bef` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:18.685198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c507057-5af8-4477-82ed-dece8f30d395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:18.687763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=374ea66ff6e741628e8d53350a599bef)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:18.689523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c507057-5af8-4477-82ed-dece8f30d395 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:18.694929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:18.721501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 915/1857] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:18.790732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374ea66ff6e741628e8d53350a599bef', 'request_id': 'req-ba84fd26-110d-4227-94bf-f220dcc9a8bb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.798945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374ea66ff6e741628e8d53350a599bef', 'request_id': 'req-ba84fd26-110d-4227-94bf-f220dcc9a8bb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.810704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374ea66ff6e741628e8d53350a599bef', 'request_id': 'req-ba84fd26-110d-4227-94bf-f220dcc9a8bb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.827558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] The token cache is being invalidate because project 374ea66ff6e741628e8d53350a599bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:18.827741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.831586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:18.834882 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 943/1858] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:18 2022] DELETE /identity/v3/projects/374ea66ff6e741628e8d53350a599bef => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:18.839316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c507057-5af8-4477-82ed-dece8f30d395 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:18.851699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c507057-5af8-4477-82ed-dece8f30d395 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:18.946452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:18.947202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:18.947584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:18.948078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] PATH_INFO: `/v3/users/3b139a2dcae24b32acc975537774a101` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:18.949286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b139a2dcae24b32acc975537774a101)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:18.952293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:19.036119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b139a2dcae24b32acc975537774a101'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.046570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b139a2dcae24b32acc975537774a101'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.047599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b139a2dcae24b32acc975537774a101'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.048460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b139a2dcae24b32acc975537774a101'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.062767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b139a2dcae24b32acc975537774a101'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.087823 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 916/1859] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:18 2022] DELETE /identity/v3/users/3b139a2dcae24b32acc975537774a101 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:19.199010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:19.201343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:19.217092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84fd26-110d-4227-94bf-f220dcc9a8bb admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:19.268661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:19.270592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:19.317014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:19.317674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:19.317960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:19.318239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] PATH_INFO: `/v3/projects/d1d8f95fd8064447a8fe2d532cedfa1c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:19.322052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d8f95fd8064447a8fe2d532cedfa1c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:19.331365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:19.337191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:19.379856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28654a64-7bbf-430a-9a20-6b5ee1f828aa admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:19.392329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d8f95fd8064447a8fe2d532cedfa1c', 'request_id': 'req-4271be41-b7e0-47c0-8dd8-14ba1172f563'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.401318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d8f95fd8064447a8fe2d532cedfa1c', 'request_id': 'req-4271be41-b7e0-47c0-8dd8-14ba1172f563'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.411248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d8f95fd8064447a8fe2d532cedfa1c', 'request_id': 'req-4271be41-b7e0-47c0-8dd8-14ba1172f563'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.426019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] The token cache is being invalidate because project d1d8f95fd8064447a8fe2d532cedfa1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:19.426392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.427371 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.429106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 944/1860] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:19 2022] DELETE /identity/v3/projects/d1d8f95fd8064447a8fe2d532cedfa1c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:19.432630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:19.434064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:19.447281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:19.447994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:19.448217 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:19.448493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] PATH_INFO: `/v3/projects/8994f2682da84e328efb0881a6607c5d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:19.449620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8994f2682da84e328efb0881a6607c5d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:19.452281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:19.457882 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:19.523379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8994f2682da84e328efb0881a6607c5d', 'request_id': 'req-632a4483-6590-4df9-a386-b9773d77add6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.530847 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8994f2682da84e328efb0881a6607c5d', 'request_id': 'req-632a4483-6590-4df9-a386-b9773d77add6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.537901 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271be41-b7e0-47c0-8dd8-14ba1172f563 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:19.539582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8994f2682da84e328efb0881a6607c5d', 'request_id': 'req-632a4483-6590-4df9-a386-b9773d77add6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.557781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] The token cache is being invalidate because project 8994f2682da84e328efb0881a6607c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:19.558592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.560681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.565902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 917/1861] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:19 2022] DELETE /identity/v3/projects/8994f2682da84e328efb0881a6607c5d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:19.565902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:19.565902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:19.603248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:19.604192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:19.604469 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:19.604733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] PATH_INFO: `/v3/users/f9f6152364274a9eaac405eb06e85a96` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:19.606323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f6152364274a9eaac405eb06e85a96)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:19.608013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:19.647972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a4483-6590-4df9-a386-b9773d77add6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:19.653772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:19.654592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:19.654876 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:19.655197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] PATH_INFO: `/v3/projects/1a7bf1c888e54d35a5aa1eacb65f5a59` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:19.656380 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7bf1c888e54d35a5aa1eacb65f5a59)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:19.658421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:19.662966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f6152364274a9eaac405eb06e85a96'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.670679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:19.671218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f6152364274a9eaac405eb06e85a96'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.671869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f6152364274a9eaac405eb06e85a96'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.672533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f6152364274a9eaac405eb06e85a96'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.687660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f6152364274a9eaac405eb06e85a96'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.702427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 945/1862] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:19 2022] DELETE /identity/v3/users/f9f6152364274a9eaac405eb06e85a96 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:19.703035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:19.705110 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:19.714181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7bf1c888e54d35a5aa1eacb65f5a59', 'request_id': 'req-2fd6359b-8d08-4112-b073-155ef8e9c049'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.721659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7bf1c888e54d35a5aa1eacb65f5a59', 'request_id': 'req-2fd6359b-8d08-4112-b073-155ef8e9c049'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.729710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7bf1c888e54d35a5aa1eacb65f5a59', 'request_id': 'req-2fd6359b-8d08-4112-b073-155ef8e9c049'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.750195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] The token cache is being invalidate because project 1a7bf1c888e54d35a5aa1eacb65f5a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:19.750562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.751312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.753231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 918/1863] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:19 2022] DELETE /identity/v3/projects/1a7bf1c888e54d35a5aa1eacb65f5a59 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:19.757917 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:19.762206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:19.763297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:19.806953 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acb4e9-9dcd-438a-aedd-d97c0a7f8e29 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:19.813461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:19.814536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:19.815464 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:19.815762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] PATH_INFO: `/v3/users/4d84870d57cd44ecbe918a4125cc512b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:19.817734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d84870d57cd44ecbe918a4125cc512b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:19.820012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:19.891107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6359b-8d08-4112-b073-155ef8e9c049 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:19.897369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c02c2-e43f-48e3-b6ce-6e8c895d5255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:19.898027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c02c2-e43f-48e3-b6ce-6e8c895d5255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:19.898385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c02c2-e43f-48e3-b6ce-6e8c895d5255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:19.898659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c02c2-e43f-48e3-b6ce-6e8c895d5255 admin admin] PATH_INFO: `/v3/users/37b4c929e8224f75bf15e19ca8449795` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:19.899991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c02c2-e43f-48e3-b6ce-6e8c895d5255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b4c929e8224f75bf15e19ca8449795)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:19.901988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c02c2-e43f-48e3-b6ce-6e8c895d5255 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:19.909515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d84870d57cd44ecbe918a4125cc512b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.920278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d84870d57cd44ecbe918a4125cc512b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.922496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d84870d57cd44ecbe918a4125cc512b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.923549 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d84870d57cd44ecbe918a4125cc512b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.940648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d84870d57cd44ecbe918a4125cc512b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.964111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 946/1864] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:19 2022] DELETE /identity/v3/users/4d84870d57cd44ecbe918a4125cc512b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:19.972495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae2c02c2-e43f-48e3-b6ce-6e8c895d5255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b4c929e8224f75bf15e19ca8449795'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.989246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae2c02c2-e43f-48e3-b6ce-6e8c895d5255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b4c929e8224f75bf15e19ca8449795'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.989925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae2c02c2-e43f-48e3-b6ce-6e8c895d5255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b4c929e8224f75bf15e19ca8449795'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.990724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae2c02c2-e43f-48e3-b6ce-6e8c895d5255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b4c929e8224f75bf15e19ca8449795'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:19.999615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae2c02c2-e43f-48e3-b6ce-6e8c895d5255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b4c929e8224f75bf15e19ca8449795'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.028687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 919/1865] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:19 2022] DELETE /identity/v3/users/37b4c929e8224f75bf15e19ca8449795 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:20.234253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:20.236337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:20.361210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925846b7-e028-4f6e-9d45-32c7f04fe837 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:20.432762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:20.433421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:20.433754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:20.434034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] PATH_INFO: `/v3/projects/5c56e53b40d64e03ac7fe73b5642a56c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:20.435919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c56e53b40d64e03ac7fe73b5642a56c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:20.437877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:20.447727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:20.507303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c56e53b40d64e03ac7fe73b5642a56c', 'request_id': 'req-d1e98266-9913-40c8-99b3-3c43499ffe39'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.514784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c56e53b40d64e03ac7fe73b5642a56c', 'request_id': 'req-d1e98266-9913-40c8-99b3-3c43499ffe39'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.529175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c56e53b40d64e03ac7fe73b5642a56c', 'request_id': 'req-d1e98266-9913-40c8-99b3-3c43499ffe39'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.548111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] The token cache is being invalidate because project 5c56e53b40d64e03ac7fe73b5642a56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:20.548736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.549904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.552007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 947/1866] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:20 2022] DELETE /identity/v3/projects/5c56e53b40d64e03ac7fe73b5642a56c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:20.557467 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb6f8c-8d48-4570-9e41-9a48bd005441 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:20.557946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb6f8c-8d48-4570-9e41-9a48bd005441 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:20.558266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb6f8c-8d48-4570-9e41-9a48bd005441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:20.576736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:20.578424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:20.603285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8fcb6f8c-8d48-4570-9e41-9a48bd005441 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:20.608926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8fcb6f8c-8d48-4570-9e41-9a48bd005441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:20.641622 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:20.655078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e98266-9913-40c8-99b3-3c43499ffe39 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:20.660006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:20.660777 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:20.661059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:20.661329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] PATH_INFO: `/v3/projects/0e68a1669b004c26a785f272bb00c16b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:20.662463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e68a1669b004c26a785f272bb00c16b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:20.664409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:20.696068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 920/1867] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:20.697036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb6f8c-8d48-4570-9e41-9a48bd005441 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:20.704599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8fcb6f8c-8d48-4570-9e41-9a48bd005441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:20.719615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb6f8c-8d48-4570-9e41-9a48bd005441 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:20.720143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e68a1669b004c26a785f272bb00c16b', 'request_id': 'req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.726800 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e68a1669b004c26a785f272bb00c16b', 'request_id': 'req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.735503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e68a1669b004c26a785f272bb00c16b', 'request_id': 'req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.748179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] The token cache is being invalidate because project 0e68a1669b004c26a785f272bb00c16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:20.748860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.749448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-238dec02-d3f2-4cec-846a-d4e5cb3ef4e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.751412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 948/1868] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:20 2022] DELETE /identity/v3/projects/0e68a1669b004c26a785f272bb00c16b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:20.752750 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e58de-e6af-4cb2-99cc-65daa6cad3cb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:20.753100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e58de-e6af-4cb2-99cc-65daa6cad3cb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:20.753442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e58de-e6af-4cb2-99cc-65daa6cad3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:20.775299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6a1e58de-e6af-4cb2-99cc-65daa6cad3cb None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:20.776553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6a1e58de-e6af-4cb2-99cc-65daa6cad3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:20.799389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:20.799620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:20.800252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:20.800595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:20.800977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] PATH_INFO: `/v3/projects/09156dabdf6f4b64a86605c30544b280` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:20.802205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09156dabdf6f4b64a86605c30544b280)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:20.804308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:20.857749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 949/1869] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:20.859204 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e15d5b-28e5-4fa5-9d0d-ad77874f540f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:20.859485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e15d5b-28e5-4fa5-9d0d-ad77874f540f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:20.859755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e15d5b-28e5-4fa5-9d0d-ad77874f540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:20.869316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09156dabdf6f4b64a86605c30544b280', 'request_id': 'req-771ea8d8-961d-4582-a25f-c114777fb08b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.876591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09156dabdf6f4b64a86605c30544b280', 'request_id': 'req-771ea8d8-961d-4582-a25f-c114777fb08b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.879499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-25e15d5b-28e5-4fa5-9d0d-ad77874f540f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:20.880736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-25e15d5b-28e5-4fa5-9d0d-ad77874f540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:20.885603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09156dabdf6f4b64a86605c30544b280', 'request_id': 'req-771ea8d8-961d-4582-a25f-c114777fb08b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.896101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] The token cache is being invalidate because project 09156dabdf6f4b64a86605c30544b280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:20.896392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.897049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:20.903039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 921/1870] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:20 2022] DELETE /identity/v3/projects/09156dabdf6f4b64a86605c30544b280 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:20.903039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:20.903039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:20.942122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 950/1871] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:20.943374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5261b-f821-43da-873d-c42486a38e2b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:20.944092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5261b-f821-43da-873d-c42486a38e2b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:20.944092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5261b-f821-43da-873d-c42486a38e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:20.958923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:20.963610 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-33c5261b-f821-43da-873d-c42486a38e2b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:20.964886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-33c5261b-f821-43da-873d-c42486a38e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:20.973963 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 951/1872] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:20.975099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea911d-3ddc-452f-bd02-4462403662f7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:20.975383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea911d-3ddc-452f-bd02-4462403662f7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:20.975652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea911d-3ddc-452f-bd02-4462403662f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:20.979459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ea8d8-961d-4582-a25f-c114777fb08b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:20.985880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2cbda-c359-4e8f-a8d8-9178c0f797bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:20.986516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2cbda-c359-4e8f-a8d8-9178c0f797bb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:20.986794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2cbda-c359-4e8f-a8d8-9178c0f797bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:20.987070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2cbda-c359-4e8f-a8d8-9178c0f797bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:20.987719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2cbda-c359-4e8f-a8d8-9178c0f797bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:20.988061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2cbda-c359-4e8f-a8d8-9178c0f797bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:20.989868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2cbda-c359-4e8f-a8d8-9178c0f797bb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:20.995644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-feea911d-3ddc-452f-bd02-4462403662f7 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:20.996992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-feea911d-3ddc-452f-bd02-4462403662f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:21.002337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 922/1873] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:25:21.004914 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 952/1874] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:21.006765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea911d-3ddc-452f-bd02-4462403662f7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.007142 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9924-6dbf-4828-969d-b5f36ad5c3fa None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.007426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9924-6dbf-4828-969d-b5f36ad5c3fa None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.007700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f9924-6dbf-4828-969d-b5f36ad5c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.017138 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea911d-3ddc-452f-bd02-4462403662f7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.021702 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d8036-49e4-4125-9f70-84315944a3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.022294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d8036-49e4-4125-9f70-84315944a3fe admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.022572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d8036-49e4-4125-9f70-84315944a3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.022846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d8036-49e4-4125-9f70-84315944a3fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.023465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d8036-49e4-4125-9f70-84315944a3fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.025394 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d8036-49e4-4125-9f70-84315944a3fe admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.031644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3e3f9924-6dbf-4828-969d-b5f36ad5c3fa None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:21.032908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3e3f9924-6dbf-4828-969d-b5f36ad5c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:21.041291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 923/1875] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:21.041880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f9924-6dbf-4828-969d-b5f36ad5c3fa None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.052290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f9924-6dbf-4828-969d-b5f36ad5c3fa None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.056698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 953/1876] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:21 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:21.056928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906000b-fd59-4594-9107-08941c3e82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.057515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906000b-fd59-4594-9107-08941c3e82f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.057711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d8036-49e4-4125-9f70-84315944a3fe admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.057792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906000b-fd59-4594-9107-08941c3e82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.058043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906000b-fd59-4594-9107-08941c3e82f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.058675 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906000b-fd59-4594-9107-08941c3e82f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:21.058975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906000b-fd59-4594-9107-08941c3e82f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.061003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906000b-fd59-4594-9107-08941c3e82f2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.072754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 924/1877] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:25:21.076938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906000b-fd59-4594-9107-08941c3e82f2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.088157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906000b-fd59-4594-9107-08941c3e82f2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.121695 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d8036-49e4-4125-9f70-84315944a3fe admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.126721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65297-a4e0-4833-8170-09cf0cd631fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.127768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65297-a4e0-4833-8170-09cf0cd631fa admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.128097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65297-a4e0-4833-8170-09cf0cd631fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.128382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c65297-a4e0-4833-8170-09cf0cd631fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.129038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c65297-a4e0-4833-8170-09cf0cd631fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:21.129715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c65297-a4e0-4833-8170-09cf0cd631fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.131764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c65297-a4e0-4833-8170-09cf0cd631fa admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.144048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 954/1878] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:25:21.144826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65297-a4e0-4833-8170-09cf0cd631fa admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.149913 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a58492-4ff0-4840-8b6d-a0cfcfdb2996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.150544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a58492-4ff0-4840-8b6d-a0cfcfdb2996 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.150810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a58492-4ff0-4840-8b6d-a0cfcfdb2996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.151082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a58492-4ff0-4840-8b6d-a0cfcfdb2996 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.151709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a58492-4ff0-4840-8b6d-a0cfcfdb2996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.154940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a58492-4ff0-4840-8b6d-a0cfcfdb2996 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.155058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c65297-a4e0-4833-8170-09cf0cd631fa admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.159561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83540816-31ab-4df2-8add-2b876ac1614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.160172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83540816-31ab-4df2-8add-2b876ac1614e admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.160527 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83540816-31ab-4df2-8add-2b876ac1614e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.160805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83540816-31ab-4df2-8add-2b876ac1614e admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.161420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83540816-31ab-4df2-8add-2b876ac1614e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.163369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83540816-31ab-4df2-8add-2b876ac1614e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.178279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 925/1879] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:21 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:21.179438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a58492-4ff0-4840-8b6d-a0cfcfdb2996 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.189784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a58492-4ff0-4840-8b6d-a0cfcfdb2996 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.195363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd79f2-89f7-4c60-adbc-3be33f403f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.196082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd79f2-89f7-4c60-adbc-3be33f403f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.196372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd79f2-89f7-4c60-adbc-3be33f403f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.196681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd79f2-89f7-4c60-adbc-3be33f403f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.197251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 955/1880] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:21 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:21.198101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83540816-31ab-4df2-8add-2b876ac1614e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.200438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd79f2-89f7-4c60-adbc-3be33f403f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.202406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:21.202596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd79f2-89f7-4c60-adbc-3be33f403f3c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.232975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 926/1881] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:21 2022] POST /identity/v3/projects => generated 409 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:21.233809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd79f2-89f7-4c60-adbc-3be33f403f3c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.273841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83540816-31ab-4df2-8add-2b876ac1614e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.310401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd79f2-89f7-4c60-adbc-3be33f403f3c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.316753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d185a-d2db-4214-b06a-e76df5dc41d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.317591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d185a-d2db-4214-b06a-e76df5dc41d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.317958 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d185a-d2db-4214-b06a-e76df5dc41d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.318323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d185a-d2db-4214-b06a-e76df5dc41d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.319322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d185a-d2db-4214-b06a-e76df5dc41d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.331963 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d185a-d2db-4214-b06a-e76df5dc41d2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.360874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 927/1882] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:21 2022] POST /identity/v3/users => generated 285 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:21.362389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d185a-d2db-4214-b06a-e76df5dc41d2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.374589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d185a-d2db-4214-b06a-e76df5dc41d2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.384726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb4c75-39c0-4985-81f6-628ce09d6f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.385900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb4c75-39c0-4985-81f6-628ce09d6f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.386403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb4c75-39c0-4985-81f6-628ce09d6f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.386522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31d019-86fb-4f88-988e-2bce1f56c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.387005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb4c75-39c0-4985-81f6-628ce09d6f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.387122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31d019-86fb-4f88-988e-2bce1f56c758 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.387852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31d019-86fb-4f88-988e-2bce1f56c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.388161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31d019-86fb-4f88-988e-2bce1f56c758 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.389036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31d019-86fb-4f88-988e-2bce1f56c758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.389319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb4c75-39c0-4985-81f6-628ce09d6f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.391206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31d019-86fb-4f88-988e-2bce1f56c758 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.391586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb4c75-39c0-4985-81f6-628ce09d6f68 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.406682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 956/1883] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:21.407891 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb4c75-39c0-4985-81f6-628ce09d6f68 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.423434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb4c75-39c0-4985-81f6-628ce09d6f68 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.430998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5843d-9345-4c3d-b7bf-535af2f1c427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.432324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5843d-9345-4c3d-b7bf-535af2f1c427 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.432666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5843d-9345-4c3d-b7bf-535af2f1c427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.433317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5843d-9345-4c3d-b7bf-535af2f1c427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.434094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5843d-9345-4c3d-b7bf-535af2f1c427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.436168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 928/1884] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:21 2022] POST /identity/v3/users => generated 305 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:21.436323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5843d-9345-4c3d-b7bf-535af2f1c427 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.437416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31d019-86fb-4f88-988e-2bce1f56c758 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.450509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:21.457389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 957/1885] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:21.457389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5843d-9345-4c3d-b7bf-535af2f1c427 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.462579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31d019-86fb-4f88-988e-2bce1f56c758 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.471124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5843d-9345-4c3d-b7bf-535af2f1c427 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.473286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2396c48-4fc3-4e84-ab25-8155b5e79278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.474658 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2396c48-4fc3-4e84-ab25-8155b5e79278 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.474658 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2396c48-4fc3-4e84-ab25-8155b5e79278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.476286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2396c48-4fc3-4e84-ab25-8155b5e79278 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.476970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cdd70-a7e5-4488-a9d2-078310412bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.477095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2396c48-4fc3-4e84-ab25-8155b5e79278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.477667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cdd70-a7e5-4488-a9d2-078310412bad admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.478232 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cdd70-a7e5-4488-a9d2-078310412bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.478829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cdd70-a7e5-4488-a9d2-078310412bad admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.478982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2396c48-4fc3-4e84-ab25-8155b5e79278 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.479562 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cdd70-a7e5-4488-a9d2-078310412bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.481842 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cdd70-a7e5-4488-a9d2-078310412bad admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.494873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 958/1886] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:21.496050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cdd70-a7e5-4488-a9d2-078310412bad admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.511308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 929/1887] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:21.517236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cdd70-a7e5-4488-a9d2-078310412bad admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.518801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2396c48-4fc3-4e84-ab25-8155b5e79278 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.529538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2396c48-4fc3-4e84-ab25-8155b5e79278 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.531435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd8e14-1090-42e8-b7f5-5f56ac3b6367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.534332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd8e14-1090-42e8-b7f5-5f56ac3b6367 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.534464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fde03-e7b7-45e0-bce1-eac1ac141b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.534832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd8e14-1090-42e8-b7f5-5f56ac3b6367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.535031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fde03-e7b7-45e0-bce1-eac1ac141b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.535174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd8e14-1090-42e8-b7f5-5f56ac3b6367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.535268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fde03-e7b7-45e0-bce1-eac1ac141b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.535497 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fde03-e7b7-45e0-bce1-eac1ac141b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.536597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd8e14-1090-42e8-b7f5-5f56ac3b6367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.536726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fde03-e7b7-45e0-bce1-eac1ac141b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.537941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fde03-e7b7-45e0-bce1-eac1ac141b9b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.538052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd8e14-1090-42e8-b7f5-5f56ac3b6367 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.552132 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 930/1888] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:21.553965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 959/1889] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:21.554881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd8e14-1090-42e8-b7f5-5f56ac3b6367 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.557594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fde03-e7b7-45e0-bce1-eac1ac141b9b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.572074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd8e14-1090-42e8-b7f5-5f56ac3b6367 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.575532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fde03-e7b7-45e0-bce1-eac1ac141b9b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.578619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b70c56-ab4b-487d-914a-fd0e0d461b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.579530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b70c56-ab4b-487d-914a-fd0e0d461b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.579822 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b70c56-ab4b-487d-914a-fd0e0d461b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.580143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b70c56-ab4b-487d-914a-fd0e0d461b9c admin admin] PATH_INFO: `/v3/projects/1cd78c8daa9c43fe87067e267c755f3a/users/19faecaff359400194490cb3ba255ab7/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.583420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1c616-6d30-4ae9-9fb5-0e5f3b7c9c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.584631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1c616-6d30-4ae9-9fb5-0e5f3b7c9c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.584830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1c616-6d30-4ae9-9fb5-0e5f3b7c9c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.585329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1c616-6d30-4ae9-9fb5-0e5f3b7c9c53 admin admin] PATH_INFO: `/v3/projects/8563e5d1a74a4ff596147fd70742bb10/users/4fc59dd6c4d64a539d9b5fdfecfb40b1/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.616128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b70c56-ab4b-487d-914a-fd0e0d461b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd78c8daa9c43fe87067e267c755f3a, user_id=19faecaff359400194490cb3ba255ab7, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.617255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1c616-6d30-4ae9-9fb5-0e5f3b7c9c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8563e5d1a74a4ff596147fd70742bb10, user_id=4fc59dd6c4d64a539d9b5fdfecfb40b1, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.619125 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b70c56-ab4b-487d-914a-fd0e0d461b9c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.620809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1c616-6d30-4ae9-9fb5-0e5f3b7c9c53 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.637280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 960/1890] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:21 2022] PUT /identity/v3/projects/1cd78c8daa9c43fe87067e267c755f3a/users/19faecaff359400194490cb3ba255ab7/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:21.638108 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b70c56-ab4b-487d-914a-fd0e0d461b9c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.641615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 931/1891] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:21 2022] PUT /identity/v3/projects/8563e5d1a74a4ff596147fd70742bb10/users/4fc59dd6c4d64a539d9b5fdfecfb40b1/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:21.647079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ee4b8-5b02-4a66-8094-a3453ae08b19 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.647623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ee4b8-5b02-4a66-8094-a3453ae08b19 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.649023 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ee4b8-5b02-4a66-8094-a3453ae08b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.679926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-db0ee4b8-5b02-4a66-8094-a3453ae08b19 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:21.681154 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-db0ee4b8-5b02-4a66-8094-a3453ae08b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:21.713704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:21.733279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b70c56-ab4b-487d-914a-fd0e0d461b9c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.814479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 932/1892] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:21.814479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e419-4096-467f-9f07-38ffc0e89d5f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.814479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e419-4096-467f-9f07-38ffc0e89d5f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.814479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e419-4096-467f-9f07-38ffc0e89d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.840111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017873f-3dec-430b-8d9d-985bb051fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.841618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017873f-3dec-430b-8d9d-985bb051fef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.841708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017873f-3dec-430b-8d9d-985bb051fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.841968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017873f-3dec-430b-8d9d-985bb051fef0 admin admin] PATH_INFO: `/v3/projects/db0e441ad02f4a69a887e345e30f35dc/users/f2cbdf38211f48179220d19e3cb2c845/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.848303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d0c9e419-4096-467f-9f07-38ffc0e89d5f None None] MFA Rules not processed for user `4fc59dd6c4d64a539d9b5fdfecfb40b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:21.849521 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d0c9e419-4096-467f-9f07-38ffc0e89d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:21.876116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017873f-3dec-430b-8d9d-985bb051fef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0e441ad02f4a69a887e345e30f35dc, user_id=f2cbdf38211f48179220d19e3cb2c845, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:21.878845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017873f-3dec-430b-8d9d-985bb051fef0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:21.894698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 961/1893] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:21 2022] PUT /identity/v3/projects/db0e441ad02f4a69a887e345e30f35dc/users/f2cbdf38211f48179220d19e3cb2c845/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:21.895776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017873f-3dec-430b-8d9d-985bb051fef0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:21.898536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3017873f-3dec-430b-8d9d-985bb051fef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:21.958466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 933/1894] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:21 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:21.959534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b7ab0-010b-41b5-868c-f4503415e5b9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.960046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b7ab0-010b-41b5-868c-f4503415e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.960144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b7ab0-010b-41b5-868c-f4503415e5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.970581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017873f-3dec-430b-8d9d-985bb051fef0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:21.975357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0697-9740-4fc5-9154-16283d466f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:21.976620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0697-9740-4fc5-9154-16283d466f81 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:21.976620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0697-9740-4fc5-9154-16283d466f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:21.976891 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0697-9740-4fc5-9154-16283d466f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:21.990995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ca2b7ab0-010b-41b5-868c-f4503415e5b9 None None] MFA Rules not processed for user `f2cbdf38211f48179220d19e3cb2c845`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:21.992319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ca2b7ab0-010b-41b5-868c-f4503415e5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:22.035129 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:22.053184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0697-9740-4fc5-9154-16283d466f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.054922 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0697-9740-4fc5-9154-16283d466f81 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.065418 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 934/1895] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:22.068052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b7ab0-010b-41b5-868c-f4503415e5b9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.074047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 962/1896] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:22.076855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0697-9740-4fc5-9154-16283d466f81 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.086459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b7ab0-010b-41b5-868c-f4503415e5b9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.089876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0697-9740-4fc5-9154-16283d466f81 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.092077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83a39-baba-447a-aee0-17ab3ad369c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.092911 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83a39-baba-447a-aee0-17ab3ad369c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.093252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83a39-baba-447a-aee0-17ab3ad369c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.093639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83a39-baba-447a-aee0-17ab3ad369c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.094548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf83a39-baba-447a-aee0-17ab3ad369c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.096064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4a04-bb9b-4d3f-a23f-f78ca40c996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.096731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf83a39-baba-447a-aee0-17ab3ad369c0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.096839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4a04-bb9b-4d3f-a23f-f78ca40c996d admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.097206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4a04-bb9b-4d3f-a23f-f78ca40c996d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.097717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4a04-bb9b-4d3f-a23f-f78ca40c996d admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.098206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d4a04-bb9b-4d3f-a23f-f78ca40c996d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.100593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d4a04-bb9b-4d3f-a23f-f78ca40c996d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.130592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 935/1897] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:22 2022] POST /identity/v3/projects => generated 409 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:22.134875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83a39-baba-447a-aee0-17ab3ad369c0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.138716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 963/1898] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:22 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:22.143525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4a04-bb9b-4d3f-a23f-f78ca40c996d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.154346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:22.222762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4a04-bb9b-4d3f-a23f-f78ca40c996d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.223705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83a39-baba-447a-aee0-17ab3ad369c0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.229849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839670-9069-439d-b47d-688e3f828aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.230909 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839670-9069-439d-b47d-688e3f828aef admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.231032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099959-3290-461b-aab5-8c3eaeb46532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.231161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839670-9069-439d-b47d-688e3f828aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.231305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839670-9069-439d-b47d-688e3f828aef admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.232167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61839670-9069-439d-b47d-688e3f828aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.234920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61839670-9069-439d-b47d-688e3f828aef admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.238260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099959-3290-461b-aab5-8c3eaeb46532 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.238855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099959-3290-461b-aab5-8c3eaeb46532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.238984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099959-3290-461b-aab5-8c3eaeb46532 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.239656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c099959-3290-461b-aab5-8c3eaeb46532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.242074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c099959-3290-461b-aab5-8c3eaeb46532 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.269609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 964/1899] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:22 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:22.270780 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839670-9069-439d-b47d-688e3f828aef admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.287738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839670-9069-439d-b47d-688e3f828aef admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.291847 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 936/1900] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:22 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:22.293331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099959-3290-461b-aab5-8c3eaeb46532 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.294967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831767f-3c98-4889-8540-ff9773257041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.296401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831767f-3c98-4889-8540-ff9773257041 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.296686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831767f-3c98-4889-8540-ff9773257041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.296961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831767f-3c98-4889-8540-ff9773257041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.298077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831767f-3c98-4889-8540-ff9773257041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.300155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831767f-3c98-4889-8540-ff9773257041 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.307771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099959-3290-461b-aab5-8c3eaeb46532 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.313552 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165719c3-2121-4c33-81e9-38dda86bf6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.313946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 965/1901] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:22.317796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165719c3-2121-4c33-81e9-38dda86bf6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.318218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165719c3-2121-4c33-81e9-38dda86bf6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.318509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165719c3-2121-4c33-81e9-38dda86bf6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.318615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831767f-3c98-4889-8540-ff9773257041 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.319208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165719c3-2121-4c33-81e9-38dda86bf6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.321016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165719c3-2121-4c33-81e9-38dda86bf6e5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.333522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 937/1902] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:22.336482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831767f-3c98-4889-8540-ff9773257041 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.338194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165719c3-2121-4c33-81e9-38dda86bf6e5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.344047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5ac73-ca49-4b36-8e1a-f97058c1f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.345728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5ac73-ca49-4b36-8e1a-f97058c1f198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.346012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5ac73-ca49-4b36-8e1a-f97058c1f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.347340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5ac73-ca49-4b36-8e1a-f97058c1f198 admin admin] PATH_INFO: `/v3/projects/9aea8851882c40c898ed4336f1d3e89b/users/154015d7398e493ba617676e792f714b/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.359019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165719c3-2121-4c33-81e9-38dda86bf6e5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.364033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1da56-f8df-497e-a137-981a62e87627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.364886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1da56-f8df-497e-a137-981a62e87627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.365172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1da56-f8df-497e-a137-981a62e87627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.366604 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1da56-f8df-497e-a137-981a62e87627 admin admin] PATH_INFO: `/v3/projects/33868edbe507461f8591080640ecf7ae/users/8cb2b265f27142178818e7b8449ffbcc/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.384154 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1da56-f8df-497e-a137-981a62e87627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33868edbe507461f8591080640ecf7ae, user_id=8cb2b265f27142178818e7b8449ffbcc, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.385871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5ac73-ca49-4b36-8e1a-f97058c1f198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aea8851882c40c898ed4336f1d3e89b, user_id=154015d7398e493ba617676e792f714b, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.387854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1da56-f8df-497e-a137-981a62e87627 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.392306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5ac73-ca49-4b36-8e1a-f97058c1f198 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.425446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 938/1903] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:22 2022] PUT /identity/v3/projects/33868edbe507461f8591080640ecf7ae/users/8cb2b265f27142178818e7b8449ffbcc/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:22.425685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 966/1904] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:22 2022] PUT /identity/v3/projects/9aea8851882c40c898ed4336f1d3e89b/users/154015d7398e493ba617676e792f714b/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:22.433155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5ac73-ca49-4b36-8e1a-f97058c1f198 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.433494 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1da56-f8df-497e-a137-981a62e87627 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.525593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5ac73-ca49-4b36-8e1a-f97058c1f198 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.533153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33c8b1-773c-4d31-aeda-862730e5a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.533975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33c8b1-773c-4d31-aeda-862730e5a6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.534296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33c8b1-773c-4d31-aeda-862730e5a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.534577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33c8b1-773c-4d31-aeda-862730e5a6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.535223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33c8b1-773c-4d31-aeda-862730e5a6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.536138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1da56-f8df-497e-a137-981a62e87627 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.537144 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33c8b1-773c-4d31-aeda-862730e5a6d0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.546185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2918d-4d00-4646-872c-a1504177dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.546635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2918d-4d00-4646-872c-a1504177dfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.546978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2918d-4d00-4646-872c-a1504177dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.547253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2918d-4d00-4646-872c-a1504177dfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.548010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2918d-4d00-4646-872c-a1504177dfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.550720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2918d-4d00-4646-872c-a1504177dfc4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.552501 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 967/1905] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:22.556448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33c8b1-773c-4d31-aeda-862730e5a6d0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.573740 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33c8b1-773c-4d31-aeda-862730e5a6d0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.582260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ff024-82fa-4631-9f5b-4c43a826d279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.583265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ff024-82fa-4631-9f5b-4c43a826d279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.583811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ff024-82fa-4631-9f5b-4c43a826d279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.584616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ff024-82fa-4631-9f5b-4c43a826d279 admin admin] PATH_INFO: `/v3/projects/9aea8851882c40c898ed4336f1d3e89b/users/154015d7398e493ba617676e792f714b/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.586576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 939/1906] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:22.587710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2918d-4d00-4646-872c-a1504177dfc4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.589151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ff024-82fa-4631-9f5b-4c43a826d279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aea8851882c40c898ed4336f1d3e89b, user_id=154015d7398e493ba617676e792f714b, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.592500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ff024-82fa-4631-9f5b-4c43a826d279 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.606754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2918d-4d00-4646-872c-a1504177dfc4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.612718 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 968/1907] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:22 2022] PUT /identity/v3/projects/9aea8851882c40c898ed4336f1d3e89b/users/154015d7398e493ba617676e792f714b/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:22.614254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:22.623975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33417-cac0-406e-a690-9024d4a7e12a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.625578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33417-cac0-406e-a690-9024d4a7e12a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.626017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33417-cac0-406e-a690-9024d4a7e12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.657675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6fc33417-cac0-406e-a690-9024d4a7e12a None None] MFA Rules not processed for user `154015d7398e493ba617676e792f714b`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:22.658904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6fc33417-cac0-406e-a690-9024d4a7e12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:22.703499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0feb3b3-af70-4fbf-ac2f-9b4fca02047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:22.704319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feb3b3-af70-4fbf-ac2f-9b4fca02047e admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.704596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feb3b3-af70-4fbf-ac2f-9b4fca02047e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.704868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0feb3b3-af70-4fbf-ac2f-9b4fca02047e admin admin] PATH_INFO: `/v3/projects/33868edbe507461f8591080640ecf7ae/users/8cb2b265f27142178818e7b8449ffbcc/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.707267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0feb3b3-af70-4fbf-ac2f-9b4fca02047e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33868edbe507461f8591080640ecf7ae, user_id=8cb2b265f27142178818e7b8449ffbcc, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:22.712827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0feb3b3-af70-4fbf-ac2f-9b4fca02047e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:22.713317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:22.735772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 940/1908] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:22 2022] PUT /identity/v3/projects/33868edbe507461f8591080640ecf7ae/users/8cb2b265f27142178818e7b8449ffbcc/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:22.748903 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3140fc-9a1f-44aa-8ea5-aaad66da28bb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:22.749184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3140fc-9a1f-44aa-8ea5-aaad66da28bb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:22.749470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3140fc-9a1f-44aa-8ea5-aaad66da28bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:22.777438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 969/1909] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:22.781440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6c3140fc-9a1f-44aa-8ea5-aaad66da28bb None None] MFA Rules not processed for user `8cb2b265f27142178818e7b8449ffbcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:22.783091 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c3140fc-9a1f-44aa-8ea5-aaad66da28bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:22.793717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc33417-cac0-406e-a690-9024d4a7e12a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.797480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6fc33417-cac0-406e-a690-9024d4a7e12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:22.883960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 941/1910] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:22 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:22.894806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3140fc-9a1f-44aa-8ea5-aaad66da28bb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:22.896662 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c3140fc-9a1f-44aa-8ea5-aaad66da28bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:22.916216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc33417-cac0-406e-a690-9024d4a7e12a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:22.997825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3140fc-9a1f-44aa-8ea5-aaad66da28bb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:23.003622 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf6b7a-f80c-4604-8402-b556a6e52f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:23.004289 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf6b7a-f80c-4604-8402-b556a6e52f18 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:23.004572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf6b7a-f80c-4604-8402-b556a6e52f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:23.004859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf6b7a-f80c-4604-8402-b556a6e52f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:23.023701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf6b7a-f80c-4604-8402-b556a6e52f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:23.025175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf6b7a-f80c-4604-8402-b556a6e52f18 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:23.026157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44a981-af57-4c47-9733-c21754e516c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:23.027835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a981-af57-4c47-9733-c21754e516c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:23.028200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a981-af57-4c47-9733-c21754e516c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:23.028434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a981-af57-4c47-9733-c21754e516c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:23.036325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 942/1911] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:22 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:25:23.037715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb07f-60d7-4f63-b9e2-384e9da162a1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:23.038003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb07f-60d7-4f63-b9e2-384e9da162a1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:23.038354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bb07f-60d7-4f63-b9e2-384e9da162a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:23.078880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-629bb07f-60d7-4f63-b9e2-384e9da162a1 None None] MFA Rules not processed for user `19faecaff359400194490cb3ba255ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:23.081302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-629bb07f-60d7-4f63-b9e2-384e9da162a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:23.136202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:23.187175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44a981-af57-4c47-9733-c21754e516c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:23.189766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44a981-af57-4c47-9733-c21754e516c3 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:23.215100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 970/1912] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:23.269877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 943/1913] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:23.270347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44a981-af57-4c47-9733-c21754e516c3 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:23.341170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:23.369639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44a981-af57-4c47-9733-c21754e516c3 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:23.375420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13841-b598-4acd-aca6-2a8dd7fdfced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:23.376671 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13841-b598-4acd-aca6-2a8dd7fdfced admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:23.377266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13841-b598-4acd-aca6-2a8dd7fdfced admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:23.377745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13841-b598-4acd-aca6-2a8dd7fdfced admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:23.378727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a13841-b598-4acd-aca6-2a8dd7fdfced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:23.380875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a13841-b598-4acd-aca6-2a8dd7fdfced admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:23.396141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bb07f-60d7-4f63-b9e2-384e9da162a1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:23.411339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bb07f-60d7-4f63-b9e2-384e9da162a1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:23.417707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156f5a9-bd56-4581-852d-8efbb085455a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:23.419869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f5a9-bd56-4581-852d-8efbb085455a service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:23.421254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f5a9-bd56-4581-852d-8efbb085455a service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:23.421524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f5a9-bd56-4581-852d-8efbb085455a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:23.426318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 971/1914] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:23 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:23.430617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13841-b598-4acd-aca6-2a8dd7fdfced admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:23.506157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156f5a9-bd56-4581-852d-8efbb085455a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:23.507691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156f5a9-bd56-4581-852d-8efbb085455a service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:23.517899 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 944/1915] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:25:23.518683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156f5a9-bd56-4581-852d-8efbb085455a service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:23.523071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13841-b598-4acd-aca6-2a8dd7fdfced admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:23.526968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156f5a9-bd56-4581-852d-8efbb085455a service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:23.530789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a76b6-c23a-40ad-bf87-edb36c87d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:23.531628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a76b6-c23a-40ad-bf87-edb36c87d782 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:23.532045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a76b6-c23a-40ad-bf87-edb36c87d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:23.532597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a76b6-c23a-40ad-bf87-edb36c87d782 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:23.533512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a76b6-c23a-40ad-bf87-edb36c87d782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:23.536710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a76b6-c23a-40ad-bf87-edb36c87d782 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:23.568979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 972/1916] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:23 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:23.572917 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a76b6-c23a-40ad-bf87-edb36c87d782 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:23.585568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a76b6-c23a-40ad-bf87-edb36c87d782 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:23.593326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25d16c-13bf-478c-8b5e-32fa37ffee0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:23.594798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25d16c-13bf-478c-8b5e-32fa37ffee0e admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:23.594798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25d16c-13bf-478c-8b5e-32fa37ffee0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:23.595154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25d16c-13bf-478c-8b5e-32fa37ffee0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:23.595935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25d16c-13bf-478c-8b5e-32fa37ffee0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:23.597778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25d16c-13bf-478c-8b5e-32fa37ffee0e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:23.615233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 973/1917] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:23.616139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25d16c-13bf-478c-8b5e-32fa37ffee0e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:23.623801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a8aba-e3fa-40ed-a89e-527d6f21ce3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:23.624443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a8aba-e3fa-40ed-a89e-527d6f21ce3f service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:23.624722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a8aba-e3fa-40ed-a89e-527d6f21ce3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:23.624990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a8aba-e3fa-40ed-a89e-527d6f21ce3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:23.626990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25d16c-13bf-478c-8b5e-32fa37ffee0e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:23.631721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d00a8-3a8a-4175-b40a-5d0fc87705c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:23.632429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d00a8-3a8a-4175-b40a-5d0fc87705c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:23.632961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d00a8-3a8a-4175-b40a-5d0fc87705c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:23.633240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d00a8-3a8a-4175-b40a-5d0fc87705c9 admin admin] PATH_INFO: `/v3/projects/5aae61e3ff3a4f62884779b429f3c891/users/f51d754ba668485c9e06f6443b9f59f5/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:23.649110 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d00a8-3a8a-4175-b40a-5d0fc87705c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aae61e3ff3a4f62884779b429f3c891, user_id=f51d754ba668485c9e06f6443b9f59f5, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:23.651764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d00a8-3a8a-4175-b40a-5d0fc87705c9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:23.666925 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 974/1918] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:23 2022] PUT /identity/v3/projects/5aae61e3ff3a4f62884779b429f3c891/users/f51d754ba668485c9e06f6443b9f59f5/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:23.671809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d00a8-3a8a-4175-b40a-5d0fc87705c9 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:23.703250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a8aba-e3fa-40ed-a89e-527d6f21ce3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:23.705379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a8aba-e3fa-40ed-a89e-527d6f21ce3f service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:23.717663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 945/1919] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:23 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:23.742888 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d00a8-3a8a-4175-b40a-5d0fc87705c9 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:23.749580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b26e66-906c-47e9-acaf-0e1e8572c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:23.750644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26e66-906c-47e9-acaf-0e1e8572c757 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:23.751086 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26e66-906c-47e9-acaf-0e1e8572c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:23.751371 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26e66-906c-47e9-acaf-0e1e8572c757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:23.752127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b26e66-906c-47e9-acaf-0e1e8572c757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:23.754386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b26e66-906c-47e9-acaf-0e1e8572c757 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:23.773509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 975/1920] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:23.774794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a8aba-e3fa-40ed-a89e-527d6f21ce3f service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:23.790260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a8aba-e3fa-40ed-a89e-527d6f21ce3f service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:23.797234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ccf1-98f6-48e4-996a-84f3b3b9045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:23.798002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ccf1-98f6-48e4-996a-84f3b3b9045e admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:23.798442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ccf1-98f6-48e4-996a-84f3b3b9045e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:23.798791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ccf1-98f6-48e4-996a-84f3b3b9045e admin admin] PATH_INFO: `/v3/projects/5aae61e3ff3a4f62884779b429f3c891/users/f51d754ba668485c9e06f6443b9f59f5/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:23.801502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ccf1-98f6-48e4-996a-84f3b3b9045e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aae61e3ff3a4f62884779b429f3c891, user_id=f51d754ba668485c9e06f6443b9f59f5, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:23.818790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ccf1-98f6-48e4-996a-84f3b3b9045e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:23.849844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:23.873481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 946/1921] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:23 2022] PUT /identity/v3/projects/5aae61e3ff3a4f62884779b429f3c891/users/f51d754ba668485c9e06f6443b9f59f5/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:24.695513 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643567-4976-46d6-bed5-1040c2a1ff8f None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:24.696113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643567-4976-46d6-bed5-1040c2a1ff8f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:24.696113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643567-4976-46d6-bed5-1040c2a1ff8f None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:24.697630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 976/1922] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:25:24.729201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf2aab-c140-48fc-9a22-06c99af30d50 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:24.729744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf2aab-c140-48fc-9a22-06c99af30d50 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:24.729744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf2aab-c140-48fc-9a22-06c99af30d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:24.757631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-57cf2aab-c140-48fc-9a22-06c99af30d50 None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:24.759049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-57cf2aab-c140-48fc-9a22-06c99af30d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:24.957033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 947/1923] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:25:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:25.094249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4643567-4976-46d6-bed5-1040c2a1ff8f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:25.097322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f4643567-4976-46d6-bed5-1040c2a1ff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:25.144360 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4643567-4976-46d6-bed5-1040c2a1ff8f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:25.154630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09650b-be93-46b5-9cbf-cf93a0d2804b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:25.154952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09650b-be93-46b5-9cbf-cf93a0d2804b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:25.155240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09650b-be93-46b5-9cbf-cf93a0d2804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:25.161499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0645d2-ed7a-4aff-af87-b7d519342e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:25.162208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0645d2-ed7a-4aff-af87-b7d519342e93 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:25.162561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0645d2-ed7a-4aff-af87-b7d519342e93 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:25.164673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0645d2-ed7a-4aff-af87-b7d519342e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:25.179764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0645d2-ed7a-4aff-af87-b7d519342e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:25.179764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0645d2-ed7a-4aff-af87-b7d519342e93 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:25.192017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:25.212872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 977/1924] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:25.222196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bc09650b-be93-46b5-9cbf-cf93a0d2804b None None] MFA Rules not processed for user `f51d754ba668485c9e06f6443b9f59f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:25.223473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bc09650b-be93-46b5-9cbf-cf93a0d2804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:25.381106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 948/1925] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:25.383485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6df39-a437-42e0-9853-a1e9a35de170 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:25.383801 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6df39-a437-42e0-9853-a1e9a35de170 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:25.384645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6df39-a437-42e0-9853-a1e9a35de170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:25.416199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-47a6df39-a437-42e0-9853-a1e9a35de170 None None] MFA Rules not processed for user `19faecaff359400194490cb3ba255ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:25.417499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-47a6df39-a437-42e0-9853-a1e9a35de170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:25.494570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 978/1926] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:25.502659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09650b-be93-46b5-9cbf-cf93a0d2804b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:25.524757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09650b-be93-46b5-9cbf-cf93a0d2804b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:25.535493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a38f83-b88b-4ce4-bb1c-a1de27bd6e0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:25.536211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38f83-b88b-4ce4-bb1c-a1de27bd6e0e service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:25.536989 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38f83-b88b-4ce4-bb1c-a1de27bd6e0e service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:25.537311 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38f83-b88b-4ce4-bb1c-a1de27bd6e0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:25.554662 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a38f83-b88b-4ce4-bb1c-a1de27bd6e0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:25.557366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a38f83-b88b-4ce4-bb1c-a1de27bd6e0e service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:25.570886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 949/1927] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:27.978095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6df39-a437-42e0-9853-a1e9a35de170 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:28.042806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6df39-a437-42e0-9853-a1e9a35de170 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:28.047825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:28.048494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:28.048771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:28.049042 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] PATH_INFO: `/v3/users/f2cbdf38211f48179220d19e3cb2c845` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:28.050322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2cbdf38211f48179220d19e3cb2c845)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:28.052274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:28.104124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2cbdf38211f48179220d19e3cb2c845'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:28.112970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2cbdf38211f48179220d19e3cb2c845'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:28.113729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2cbdf38211f48179220d19e3cb2c845'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:28.114385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2cbdf38211f48179220d19e3cb2c845'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:28.130523 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2cbdf38211f48179220d19e3cb2c845'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:28.143466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 979/1928] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:27 2022] DELETE /identity/v3/users/f2cbdf38211f48179220d19e3cb2c845 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:28.148327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a6339-2e4b-4652-9cee-8c4ec22d1985 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:28.148842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a6339-2e4b-4652-9cee-8c4ec22d1985 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:28.148919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a6339-2e4b-4652-9cee-8c4ec22d1985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:28.180625 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-4d4a6339-2e4b-4652-9cee-8c4ec22d1985 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:28.181812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4d4a6339-2e4b-4652-9cee-8c4ec22d1985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:28.238535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 950/1929] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:28.249053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:28.250515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:28.276239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:28.309215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d4078-2852-421b-ab55-5d62e85778d6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:28.313284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba6cf1-7b55-4e7d-9b1e-62588f16f59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:28.313893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba6cf1-7b55-4e7d-9b1e-62588f16f59e service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:28.314172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba6cf1-7b55-4e7d-9b1e-62588f16f59e service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:28.314446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba6cf1-7b55-4e7d-9b1e-62588f16f59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:28.323808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba6cf1-7b55-4e7d-9b1e-62588f16f59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:28.325443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba6cf1-7b55-4e7d-9b1e-62588f16f59e service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:28.335046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 980/1930] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:28.820849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a6339-2e4b-4652-9cee-8c4ec22d1985 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:28.822465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4d4a6339-2e4b-4652-9cee-8c4ec22d1985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:28.847234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:28.856990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a6339-2e4b-4652-9cee-8c4ec22d1985 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:28.863558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:28.864500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:28.864792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:28.865404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] PATH_INFO: `/v3/projects/db0e441ad02f4a69a887e345e30f35dc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:28.867188 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0e441ad02f4a69a887e345e30f35dc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:28.868316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:28.999358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0e441ad02f4a69a887e345e30f35dc', 'request_id': 'req-1b2cca89-45a0-43e7-a9ca-2de6848aba78'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.009289 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0e441ad02f4a69a887e345e30f35dc', 'request_id': 'req-1b2cca89-45a0-43e7-a9ca-2de6848aba78'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.025605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0e441ad02f4a69a887e345e30f35dc', 'request_id': 'req-1b2cca89-45a0-43e7-a9ca-2de6848aba78'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.039386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] The token cache is being invalidate because project db0e441ad02f4a69a887e345e30f35dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:29.039732 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.040538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.046660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 951/1931] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:28 2022] DELETE /identity/v3/projects/db0e441ad02f4a69a887e345e30f35dc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:29.047613 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba6cf1-7b55-4e7d-9b1e-62588f16f59e service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:29.063026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba6cf1-7b55-4e7d-9b1e-62588f16f59e service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:29.100065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:29.101628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:29.170745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316125b5-664c-4682-8811-f06d68722cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:29.172004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316125b5-664c-4682-8811-f06d68722cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:29.172468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316125b5-664c-4682-8811-f06d68722cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:29.173107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316125b5-664c-4682-8811-f06d68722cf6 admin admin] PATH_INFO: `/v3/users/154015d7398e493ba617676e792f714b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:29.174713 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316125b5-664c-4682-8811-f06d68722cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154015d7398e493ba617676e792f714b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:29.177562 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316125b5-664c-4682-8811-f06d68722cf6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:29.187327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cca89-45a0-43e7-a9ca-2de6848aba78 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:29.198942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:29.199971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:29.200259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:29.200538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] PATH_INFO: `/v3/users/e9ee7d217bc845b399915ae0043a9da5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:29.201713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ee7d217bc845b399915ae0043a9da5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:29.203639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:29.243825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-316125b5-664c-4682-8811-f06d68722cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154015d7398e493ba617676e792f714b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.252784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-316125b5-664c-4682-8811-f06d68722cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154015d7398e493ba617676e792f714b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.253401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-316125b5-664c-4682-8811-f06d68722cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154015d7398e493ba617676e792f714b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.254062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-316125b5-664c-4682-8811-f06d68722cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154015d7398e493ba617676e792f714b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.268567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-316125b5-664c-4682-8811-f06d68722cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154015d7398e493ba617676e792f714b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.272639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ee7d217bc845b399915ae0043a9da5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.282771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ee7d217bc845b399915ae0043a9da5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.283372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 981/1932] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:29 2022] DELETE /identity/v3/users/154015d7398e493ba617676e792f714b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:29.284080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ee7d217bc845b399915ae0043a9da5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.284287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ee7d217bc845b399915ae0043a9da5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.293269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ee7d217bc845b399915ae0043a9da5'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.320339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 952/1933] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:29 2022] DELETE /identity/v3/users/e9ee7d217bc845b399915ae0043a9da5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:29.326425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eae6d-af10-431e-ac8f-f046a2fdacb2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:29.328092 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eae6d-af10-431e-ac8f-f046a2fdacb2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:29.328395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eae6d-af10-431e-ac8f-f046a2fdacb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:29.356578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fd6eae6d-af10-431e-ac8f-f046a2fdacb2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:29.358166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fd6eae6d-af10-431e-ac8f-f046a2fdacb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:29.414615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:29.442776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 982/1934] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:29.449990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:29.451631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:29.462752 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:29.528986 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d960f-1600-4cd9-845d-275ab6a90596 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:29.534299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccd069-5895-48ef-80a2-1b0ae352b26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:29.535110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd069-5895-48ef-80a2-1b0ae352b26b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:29.535454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd069-5895-48ef-80a2-1b0ae352b26b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:29.537365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd069-5895-48ef-80a2-1b0ae352b26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:29.551418 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccd069-5895-48ef-80a2-1b0ae352b26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:29.553360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccd069-5895-48ef-80a2-1b0ae352b26b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:29.565167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 953/1935] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:25:29.653765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eae6d-af10-431e-ac8f-f046a2fdacb2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:29.655255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fd6eae6d-af10-431e-ac8f-f046a2fdacb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:29.667294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eae6d-af10-431e-ac8f-f046a2fdacb2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:29.672357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:29.673031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:29.673355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:29.673632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] PATH_INFO: `/v3/projects/9aea8851882c40c898ed4336f1d3e89b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:29.674764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aea8851882c40c898ed4336f1d3e89b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:29.676692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:29.736510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aea8851882c40c898ed4336f1d3e89b', 'request_id': 'req-a7347918-038b-4e4d-8ce7-2b2d9c86208a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.743410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aea8851882c40c898ed4336f1d3e89b', 'request_id': 'req-a7347918-038b-4e4d-8ce7-2b2d9c86208a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.751782 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aea8851882c40c898ed4336f1d3e89b', 'request_id': 'req-a7347918-038b-4e4d-8ce7-2b2d9c86208a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.764718 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] The token cache is being invalidate because project 9aea8851882c40c898ed4336f1d3e89b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:29.765010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.765666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a7347918-038b-4e4d-8ce7-2b2d9c86208a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:29.767172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 983/1936] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:29 2022] DELETE /identity/v3/projects/9aea8851882c40c898ed4336f1d3e89b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:29.773026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b14c4-6264-4134-946d-f559fd635053 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:29.773366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b14c4-6264-4134-946d-f559fd635053 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:29.773645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b14c4-6264-4134-946d-f559fd635053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:29.797527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0e0b14c4-6264-4134-946d-f559fd635053 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:29.798751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0e0b14c4-6264-4134-946d-f559fd635053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:29.912473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 954/1937] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:29.921730 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3ea6-2b1c-4868-9518-a6926b8583a7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:29.923679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3ea6-2b1c-4868-9518-a6926b8583a7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:29.926192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3ea6-2b1c-4868-9518-a6926b8583a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:29.965846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ffda3ea6-2b1c-4868-9518-a6926b8583a7 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:29.967647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ffda3ea6-2b1c-4868-9518-a6926b8583a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:30.009303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 984/1938] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:30.014325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b14c4-6264-4134-946d-f559fd635053 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:30.027742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b14c4-6264-4134-946d-f559fd635053 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:30.034212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9920b2e-89e7-4cef-8e9d-3d72c520b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:30.034907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9920b2e-89e7-4cef-8e9d-3d72c520b788 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:30.035410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9920b2e-89e7-4cef-8e9d-3d72c520b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:30.035768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9920b2e-89e7-4cef-8e9d-3d72c520b788 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:30.041120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9920b2e-89e7-4cef-8e9d-3d72c520b788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:30.041573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9920b2e-89e7-4cef-8e9d-3d72c520b788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:30.044053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9920b2e-89e7-4cef-8e9d-3d72c520b788 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:30.060793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda3ea6-2b1c-4868-9518-a6926b8583a7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:30.063919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 955/1939] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:25:30.064438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ffda3ea6-2b1c-4868-9518-a6926b8583a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:30.070112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9920b2e-89e7-4cef-8e9d-3d72c520b788 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:30.116570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda3ea6-2b1c-4868-9518-a6926b8583a7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:30.117552 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9920b2e-89e7-4cef-8e9d-3d72c520b788 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:30.126933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60107c-39bd-45c9-9264-380e219ee49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:30.127287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60107c-39bd-45c9-9264-380e219ee49d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:30.127582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60107c-39bd-45c9-9264-380e219ee49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:30.127862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60107c-39bd-45c9-9264-380e219ee49d admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:30.128227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:30.128619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60107c-39bd-45c9-9264-380e219ee49d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:30.129118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:30.129677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:30.130628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60107c-39bd-45c9-9264-380e219ee49d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:30.132109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] PATH_INFO: `/v3/projects/cb393d4bafcc45c790ccb2951b1299e4` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:30.134108 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb393d4bafcc45c790ccb2951b1299e4)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:30.139574 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:30.193794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 956/1940] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:30 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:30.202804 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60107c-39bd-45c9-9264-380e219ee49d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:30.259931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb393d4bafcc45c790ccb2951b1299e4', 'request_id': 'req-44e894c5-139a-4f71-9792-6b5ae7b0276a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.274889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb393d4bafcc45c790ccb2951b1299e4', 'request_id': 'req-44e894c5-139a-4f71-9792-6b5ae7b0276a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.285198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb393d4bafcc45c790ccb2951b1299e4', 'request_id': 'req-44e894c5-139a-4f71-9792-6b5ae7b0276a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.298765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] The token cache is being invalidate because project cb393d4bafcc45c790ccb2951b1299e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:30.299428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.300985 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.302812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 985/1941] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:30 2022] DELETE /identity/v3/projects/cb393d4bafcc45c790ccb2951b1299e4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:30.304125 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:30.306784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:30.370067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60107c-39bd-45c9-9264-380e219ee49d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:30.387222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:30.413970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e894c5-139a-4f71-9792-6b5ae7b0276a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:30.421648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:30.422636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:30.423061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:30.423513 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] PATH_INFO: `/v3/users/4fc59dd6c4d64a539d9b5fdfecfb40b1` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:30.426414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc59dd6c4d64a539d9b5fdfecfb40b1)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:30.429076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:30.448228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:30.502573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc59dd6c4d64a539d9b5fdfecfb40b1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.514583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc59dd6c4d64a539d9b5fdfecfb40b1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.516737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc59dd6c4d64a539d9b5fdfecfb40b1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.517783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc59dd6c4d64a539d9b5fdfecfb40b1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.534185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd881cb-1c1f-4cb9-b7a3-223e330bd703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:30.534868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd881cb-1c1f-4cb9-b7a3-223e330bd703 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:30.535076 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd881cb-1c1f-4cb9-b7a3-223e330bd703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:30.535352 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd881cb-1c1f-4cb9-b7a3-223e330bd703 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:30.536015 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd881cb-1c1f-4cb9-b7a3-223e330bd703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:30.536382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc59dd6c4d64a539d9b5fdfecfb40b1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.541922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd881cb-1c1f-4cb9-b7a3-223e330bd703 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:30.552901 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 986/1942] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:30 2022] DELETE /identity/v3/users/4fc59dd6c4d64a539d9b5fdfecfb40b1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:30.554997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:30.556836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:30.571275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 957/1943] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:30 2022] POST /identity/v3/users => generated 285 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:30.572871 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473a448-5439-4704-95ae-10109025c2a2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:30.573328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473a448-5439-4704-95ae-10109025c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:30.573681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473a448-5439-4704-95ae-10109025c2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:30.599745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3473a448-5439-4704-95ae-10109025c2a2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:30.600706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3473a448-5439-4704-95ae-10109025c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:30.675022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c3037-cb3f-4f83-aa01-2a7fd03aab8d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:30.683417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:30.684890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:30.685562 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:30.686604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] PATH_INFO: `/v3/users/4d14a096004c4442a8844fe3ec3580fe` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:30.689274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d14a096004c4442a8844fe3ec3580fe)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:30.691494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:30.744981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 958/1944] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:30.745792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473a448-5439-4704-95ae-10109025c2a2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:30.747938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3473a448-5439-4704-95ae-10109025c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:30.771930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473a448-5439-4704-95ae-10109025c2a2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:30.786448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d14a096004c4442a8844fe3ec3580fe'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.788165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49ff09-b471-4dec-9dfc-074b6d396742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:30.788802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49ff09-b471-4dec-9dfc-074b6d396742 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:30.789079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49ff09-b471-4dec-9dfc-074b6d396742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:30.789364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49ff09-b471-4dec-9dfc-074b6d396742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:30.790019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49ff09-b471-4dec-9dfc-074b6d396742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:30.791821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49ff09-b471-4dec-9dfc-074b6d396742 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:30.805665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d14a096004c4442a8844fe3ec3580fe'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.806509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d14a096004c4442a8844fe3ec3580fe'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.807340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d14a096004c4442a8844fe3ec3580fe'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.815215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 959/1945] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:30.818826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49ff09-b471-4dec-9dfc-074b6d396742 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:30.820811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4e49ff09-b471-4dec-9dfc-074b6d396742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:30.841500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:30.862567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d14a096004c4442a8844fe3ec3580fe'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:30.888227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 987/1946] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:30 2022] DELETE /identity/v3/users/4d14a096004c4442a8844fe3ec3580fe => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:30.891944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:30.894434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:30.955601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49ff09-b471-4dec-9dfc-074b6d396742 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:31.021559 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a28ca-de08-4229-9570-97eb610e0f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:31.022423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a28ca-de08-4229-9570-97eb610e0f54 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:31.023045 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a28ca-de08-4229-9570-97eb610e0f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:31.023588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a28ca-de08-4229-9570-97eb610e0f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:31.026170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8f0a28ca-de08-4229-9570-97eb610e0f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:31.040936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:31.046527 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170b71c-fd22-41a1-a4fd-5d0d67b1c638 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:31.059825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c84ac6-a627-4ad6-959a-296b174c5117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:31.061012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c84ac6-a627-4ad6-959a-296b174c5117 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:31.061012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c84ac6-a627-4ad6-959a-296b174c5117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:31.061668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c84ac6-a627-4ad6-959a-296b174c5117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:31.062217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c84ac6-a627-4ad6-959a-296b174c5117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:31.063958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c84ac6-a627-4ad6-959a-296b174c5117 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:31.077621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 988/1947] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:31.083943 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c84ac6-a627-4ad6-959a-296b174c5117 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:31.099413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c84ac6-a627-4ad6-959a-296b174c5117 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:31.110206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acaeac-d25a-4824-9055-4547310b185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:31.113715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a28ca-de08-4229-9570-97eb610e0f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:31.116593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a28ca-de08-4229-9570-97eb610e0f54 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:31.124354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acaeac-d25a-4824-9055-4547310b185b admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:31.125804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acaeac-d25a-4824-9055-4547310b185b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:31.126236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acaeac-d25a-4824-9055-4547310b185b admin admin] PATH_INFO: `/v3/projects/62c7ecbbc2b04fa1a1994301b5b7dbe5/users/381b817147ce4e30991b961a95578af0/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:31.131782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 960/1948] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:31.153141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acaeac-d25a-4824-9055-4547310b185b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c7ecbbc2b04fa1a1994301b5b7dbe5, user_id=381b817147ce4e30991b961a95578af0, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:31.156165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acaeac-d25a-4824-9055-4547310b185b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:31.172925 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 989/1949] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:31 2022] PUT /identity/v3/projects/62c7ecbbc2b04fa1a1994301b5b7dbe5/users/381b817147ce4e30991b961a95578af0/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:31.183187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c78acf-1850-4d7c-ac38-e046adc8e0b0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:31.183551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c78acf-1850-4d7c-ac38-e046adc8e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:31.183834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c78acf-1850-4d7c-ac38-e046adc8e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:31.227122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-83c78acf-1850-4d7c-ac38-e046adc8e0b0 None None] MFA Rules not processed for user `381b817147ce4e30991b961a95578af0`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:31.228638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-83c78acf-1850-4d7c-ac38-e046adc8e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:31.317878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 961/1950] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:31.338448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acaeac-d25a-4824-9055-4547310b185b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:31.340149 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e9acaeac-d25a-4824-9055-4547310b185b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:31.435073 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acaeac-d25a-4824-9055-4547310b185b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:31.441256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c63a44-4464-4128-bd88-ee31cfef12b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c498b5857f42f2ab84423f8f4ea11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:31.441968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c63a44-4464-4128-bd88-ee31cfef12b3 service glance] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:31.442366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c63a44-4464-4128-bd88-ee31cfef12b3 service glance] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:31.442701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c63a44-4464-4128-bd88-ee31cfef12b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:31.473945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c63a44-4464-4128-bd88-ee31cfef12b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:31.476853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c63a44-4464-4128-bd88-ee31cfef12b3 service glance] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:31.492716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 990/1951] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:31.930128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c78acf-1850-4d7c-ac38-e046adc8e0b0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:31.932885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-83c78acf-1850-4d7c-ac38-e046adc8e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:31.946590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c63a44-4464-4128-bd88-ee31cfef12b3 service glance] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:31.948046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-50c63a44-4464-4128-bd88-ee31cfef12b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:32.037233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c78acf-1850-4d7c-ac38-e046adc8e0b0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:32.048887 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:32.051118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.051472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.051861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] PATH_INFO: `/v3/projects/8563e5d1a74a4ff596147fd70742bb10` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.054846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:32.055601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8563e5d1a74a4ff596147fd70742bb10)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:32.059008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:32.112770 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c63a44-4464-4128-bd88-ee31cfef12b3 service glance] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:32.121768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:32.122424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.122699 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.122970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] PATH_INFO: `/v3/projects/3e730361935b4d1fb6cef31f517e1c16` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.124196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e730361935b4d1fb6cef31f517e1c16)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:32.126632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:32.127630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:32.141385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8563e5d1a74a4ff596147fd70742bb10', 'request_id': 'req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.150287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8563e5d1a74a4ff596147fd70742bb10', 'request_id': 'req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.160222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8563e5d1a74a4ff596147fd70742bb10', 'request_id': 'req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.173070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] The token cache is being invalidate because project 8563e5d1a74a4ff596147fd70742bb10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:32.173443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.174134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.178683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 962/1952] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:31 2022] DELETE /identity/v3/projects/8563e5d1a74a4ff596147fd70742bb10 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:32.179535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:32.180877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:32.197086 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e730361935b4d1fb6cef31f517e1c16', 'request_id': 'req-81d861d3-11eb-40cf-aea5-0e80bf9df824'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.203335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e730361935b4d1fb6cef31f517e1c16', 'request_id': 'req-81d861d3-11eb-40cf-aea5-0e80bf9df824'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.211735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e730361935b4d1fb6cef31f517e1c16', 'request_id': 'req-81d861d3-11eb-40cf-aea5-0e80bf9df824'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.222459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] The token cache is being invalidate because project 3e730361935b4d1fb6cef31f517e1c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:32.222746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.223374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-81d861d3-11eb-40cf-aea5-0e80bf9df824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.224909 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 991/1953] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:31 2022] DELETE /identity/v3/projects/3e730361935b4d1fb6cef31f517e1c16 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:32.230987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6465f1d-85c1-4e39-a5bf-4721ac950b3b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.231369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6465f1d-85c1-4e39-a5bf-4721ac950b3b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.231890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6465f1d-85c1-4e39-a5bf-4721ac950b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.251817 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a6465f1d-85c1-4e39-a5bf-4721ac950b3b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:32.253061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a6465f1d-85c1-4e39-a5bf-4721ac950b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:32.253278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2176b39-4166-4b15-ae1d-e2df64ecc3b2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:32.327353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 992/1954] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:32.335298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa1c5-de6a-40a0-b92c-b18a2c4b3bd4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.335582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa1c5-de6a-40a0-b92c-b18a2c4b3bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.335855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa1c5-de6a-40a0-b92c-b18a2c4b3bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.341262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:32.342030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.342532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.342879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] PATH_INFO: `/v3/users/8cb2b265f27142178818e7b8449ffbcc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.344346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb2b265f27142178818e7b8449ffbcc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:32.352257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:32.363846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4effa1c5-de6a-40a0-b92c-b18a2c4b3bd4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:32.365144 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4effa1c5-de6a-40a0-b92c-b18a2c4b3bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:32.386620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 993/1955] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:32.392090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effa1c5-de6a-40a0-b92c-b18a2c4b3bd4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:32.406083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effa1c5-de6a-40a0-b92c-b18a2c4b3bd4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:32.412331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83ad6a-5acb-40a9-83c1-ad72dc211042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:32.412938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83ad6a-5acb-40a9-83c1-ad72dc211042 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.413210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83ad6a-5acb-40a9-83c1-ad72dc211042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.413472 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83ad6a-5acb-40a9-83c1-ad72dc211042 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.414150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83ad6a-5acb-40a9-83c1-ad72dc211042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:32.414489 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83ad6a-5acb-40a9-83c1-ad72dc211042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:32.414948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb2b265f27142178818e7b8449ffbcc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.416306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83ad6a-5acb-40a9-83c1-ad72dc211042 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:32.425544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb2b265f27142178818e7b8449ffbcc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.426331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb2b265f27142178818e7b8449ffbcc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.427131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb2b265f27142178818e7b8449ffbcc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.431532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 994/1956] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:25:32.436236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83ad6a-5acb-40a9-83c1-ad72dc211042 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:32.438229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-eb83ad6a-5acb-40a9-83c1-ad72dc211042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:32.440945 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb2b265f27142178818e7b8449ffbcc'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:32.451199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:32.468440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 963/1957] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:32 2022] DELETE /identity/v3/users/8cb2b265f27142178818e7b8449ffbcc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:32.477179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83ad6a-5acb-40a9-83c1-ad72dc211042 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:32.550110 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:32.595960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5aafc-e6b8-4a68-8480-d67bf062e7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:32.597330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5aafc-e6b8-4a68-8480-d67bf062e7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.597811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5aafc-e6b8-4a68-8480-d67bf062e7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.598567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5aafc-e6b8-4a68-8480-d67bf062e7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.599752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5aafc-e6b8-4a68-8480-d67bf062e7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:32.609123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5aafc-e6b8-4a68-8480-d67bf062e7e8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:32.675560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 995/1958] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:32 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:32.675761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:32.689633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13a45c-bfd9-4e23-b023-f0a317d216ce admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:32.768081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f450-eae5-4b8d-b116-58764396f076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:32.768081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f450-eae5-4b8d-b116-58764396f076 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.768081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f450-eae5-4b8d-b116-58764396f076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.768081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f450-eae5-4b8d-b116-58764396f076 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.768550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553f450-eae5-4b8d-b116-58764396f076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:32.772522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553f450-eae5-4b8d-b116-58764396f076 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:32.797779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 964/1959] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:32 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:32.802342 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5aafc-e6b8-4a68-8480-d67bf062e7e8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:32.815242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5aafc-e6b8-4a68-8480-d67bf062e7e8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:32.820523 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4885cdc-ae52-48d7-96b8-e6cb20c118b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:32.821270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4885cdc-ae52-48d7-96b8-e6cb20c118b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.821628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4885cdc-ae52-48d7-96b8-e6cb20c118b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.821907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4885cdc-ae52-48d7-96b8-e6cb20c118b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.822644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4885cdc-ae52-48d7-96b8-e6cb20c118b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:32.837109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4885cdc-ae52-48d7-96b8-e6cb20c118b8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:32.859006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 996/1960] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:32.868005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f450-eae5-4b8d-b116-58764396f076 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:32.881696 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f450-eae5-4b8d-b116-58764396f076 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:32.889940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4885cdc-ae52-48d7-96b8-e6cb20c118b8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:32.892073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba993c92-b28e-4363-932a-e910921510e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:32.892485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e4885cdc-ae52-48d7-96b8-e6cb20c118b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:32.893525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba993c92-b28e-4363-932a-e910921510e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.893917 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba993c92-b28e-4363-932a-e910921510e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.894310 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba993c92-b28e-4363-932a-e910921510e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.895483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba993c92-b28e-4363-932a-e910921510e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:32.904261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba993c92-b28e-4363-932a-e910921510e8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:32.916042 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4885cdc-ae52-48d7-96b8-e6cb20c118b8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:32.917135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 965/1961] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:32.921343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba993c92-b28e-4363-932a-e910921510e8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:32.928707 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:32.929620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.930011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.930472 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] PATH_INFO: `/v3/projects/33868edbe507461f8591080640ecf7ae` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.934499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33868edbe507461f8591080640ecf7ae)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:32.934684 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba993c92-b28e-4363-932a-e910921510e8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:32.935171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:32.941048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12499c-7d9b-480f-bfb8-795022053ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:32.941721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12499c-7d9b-480f-bfb8-795022053ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:32.941997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12499c-7d9b-480f-bfb8-795022053ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:32.942270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12499c-7d9b-480f-bfb8-795022053ad9 admin admin] PATH_INFO: `/v3/projects/115e3512d5cc456e9ef3a0468428cec9/users/eac810bd00574dac9e6082f4c5f1f623/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:32.970703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12499c-7d9b-480f-bfb8-795022053ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115e3512d5cc456e9ef3a0468428cec9, user_id=eac810bd00574dac9e6082f4c5f1f623, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:32.974584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12499c-7d9b-480f-bfb8-795022053ad9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:32.990493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 966/1962] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:32 2022] PUT /identity/v3/projects/115e3512d5cc456e9ef3a0468428cec9/users/eac810bd00574dac9e6082f4c5f1f623/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:33.005685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33868edbe507461f8591080640ecf7ae', 'request_id': 'req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:33.013585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33868edbe507461f8591080640ecf7ae', 'request_id': 'req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:33.020942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d44c4-1456-4238-92a3-4cefdc4985c2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.021741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d44c4-1456-4238-92a3-4cefdc4985c2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.022551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d44c4-1456-4238-92a3-4cefdc4985c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.029588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33868edbe507461f8591080640ecf7ae', 'request_id': 'req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:33.043392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] The token cache is being invalidate because project 33868edbe507461f8591080640ecf7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:33.043700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:33.044579 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1c1a88cc-9e97-4c77-8384-5b32a6931f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:33.045915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 997/1963] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:32 2022] DELETE /identity/v3/projects/33868edbe507461f8591080640ecf7ae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:33.050502 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb4c6-6962-44c5-983e-2b23d7712659 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.050844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb4c6-6962-44c5-983e-2b23d7712659 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.051340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb4c6-6962-44c5-983e-2b23d7712659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.064040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-172d44c4-1456-4238-92a3-4cefdc4985c2 None None] MFA Rules not processed for user `eac810bd00574dac9e6082f4c5f1f623`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:33.065353 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-172d44c4-1456-4238-92a3-4cefdc4985c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:33.083426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-615eb4c6-6962-44c5-983e-2b23d7712659 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:33.084676 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-615eb4c6-6962-44c5-983e-2b23d7712659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:33.176136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 998/1964] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:33.177986 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc71f1-cbf2-470d-b581-1876d8b5d173 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.178276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc71f1-cbf2-470d-b581-1876d8b5d173 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.178550 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc71f1-cbf2-470d-b581-1876d8b5d173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.180112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 967/1965] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:33.185675 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d44c4-1456-4238-92a3-4cefdc4985c2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.188034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-172d44c4-1456-4238-92a3-4cefdc4985c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:33.204657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d44c4-1456-4238-92a3-4cefdc4985c2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.211159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cbfc71f1-cbf2-470d-b581-1876d8b5d173 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:33.212662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cbfc71f1-cbf2-470d-b581-1876d8b5d173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:33.212916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229e365-1e72-445e-9b15-d6e95a93c469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.213608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229e365-1e72-445e-9b15-d6e95a93c469 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.213952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229e365-1e72-445e-9b15-d6e95a93c469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.214292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229e365-1e72-445e-9b15-d6e95a93c469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.215507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229e365-1e72-445e-9b15-d6e95a93c469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.217689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229e365-1e72-445e-9b15-d6e95a93c469 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.225257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 999/1966] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:33.226509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc71f1-cbf2-470d-b581-1876d8b5d173 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.237653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc71f1-cbf2-470d-b581-1876d8b5d173 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.244525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729fca1-8817-4777-b412-ac4a9fbb52b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.245246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729fca1-8817-4777-b412-ac4a9fbb52b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.245599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729fca1-8817-4777-b412-ac4a9fbb52b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.246006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729fca1-8817-4777-b412-ac4a9fbb52b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.247207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729fca1-8817-4777-b412-ac4a9fbb52b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:33.247528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729fca1-8817-4777-b412-ac4a9fbb52b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.249161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729fca1-8817-4777-b412-ac4a9fbb52b3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.255874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 968/1967] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:33 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:33.258986 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229e365-1e72-445e-9b15-d6e95a93c469 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.263242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1000/1968] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:25:33.270079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729fca1-8817-4777-b412-ac4a9fbb52b3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.279345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:33.284145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729fca1-8817-4777-b412-ac4a9fbb52b3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.317988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:33.344435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229e365-1e72-445e-9b15-d6e95a93c469 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.349162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c6994-bacc-404b-93a0-acdc214799b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.349951 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c6994-bacc-404b-93a0-acdc214799b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.350224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c6994-bacc-404b-93a0-acdc214799b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.350848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c6994-bacc-404b-93a0-acdc214799b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.351685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c6994-bacc-404b-93a0-acdc214799b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.354074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c6994-bacc-404b-93a0-acdc214799b5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.367464 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fea96-c349-4e31-93f9-8e605d8bd4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.368172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fea96-c349-4e31-93f9-8e605d8bd4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.368505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fea96-c349-4e31-93f9-8e605d8bd4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.368778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fea96-c349-4e31-93f9-8e605d8bd4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.369409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fea96-c349-4e31-93f9-8e605d8bd4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.372107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fea96-c349-4e31-93f9-8e605d8bd4d1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.381782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 969/1969] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:33 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:33.392047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c6994-bacc-404b-93a0-acdc214799b5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.406715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c6994-bacc-404b-93a0-acdc214799b5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.407135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1001/1970] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:33 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:33.411651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fea96-c349-4e31-93f9-8e605d8bd4d1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.478354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09efa43-f5d5-4dfe-9687-67db6708cbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.478975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09efa43-f5d5-4dfe-9687-67db6708cbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.479252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09efa43-f5d5-4dfe-9687-67db6708cbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.479526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09efa43-f5d5-4dfe-9687-67db6708cbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.480378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09efa43-f5d5-4dfe-9687-67db6708cbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.482195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09efa43-f5d5-4dfe-9687-67db6708cbf7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.483978 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fea96-c349-4e31-93f9-8e605d8bd4d1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.489045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c938f-7647-4d37-9b4e-cbf1b7588760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.489655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c938f-7647-4d37-9b4e-cbf1b7588760 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.489927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c938f-7647-4d37-9b4e-cbf1b7588760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.490203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c938f-7647-4d37-9b4e-cbf1b7588760 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.490826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c938f-7647-4d37-9b4e-cbf1b7588760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.492867 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c938f-7647-4d37-9b4e-cbf1b7588760 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.494676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 970/1971] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:33.498831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09efa43-f5d5-4dfe-9687-67db6708cbf7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.515759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09efa43-f5d5-4dfe-9687-67db6708cbf7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.522193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbc611-ba22-427a-b6c3-957284df68a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.522573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbc611-ba22-427a-b6c3-957284df68a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.522778 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbc611-ba22-427a-b6c3-957284df68a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.523053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbc611-ba22-427a-b6c3-957284df68a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.523886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbc611-ba22-427a-b6c3-957284df68a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.528518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1002/1972] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:33 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:33.528686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbc611-ba22-427a-b6c3-957284df68a0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.530315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c938f-7647-4d37-9b4e-cbf1b7588760 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.539929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 971/1973] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:33.544890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c938f-7647-4d37-9b4e-cbf1b7588760 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.547275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbc611-ba22-427a-b6c3-957284df68a0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.551165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e41d9f-dfb6-4922-9cbd-02bc34a740ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.551991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41d9f-dfb6-4922-9cbd-02bc34a740ce admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.552280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41d9f-dfb6-4922-9cbd-02bc34a740ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.552558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41d9f-dfb6-4922-9cbd-02bc34a740ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.553414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e41d9f-dfb6-4922-9cbd-02bc34a740ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.555842 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e41d9f-dfb6-4922-9cbd-02bc34a740ce admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.562653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbc611-ba22-427a-b6c3-957284df68a0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.574678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1003/1974] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:33.574878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63bfd1-dfdf-4343-ab59-8432d4b439c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.574878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63bfd1-dfdf-4343-ab59-8432d4b439c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.574878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63bfd1-dfdf-4343-ab59-8432d4b439c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.574878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63bfd1-dfdf-4343-ab59-8432d4b439c7 admin admin] PATH_INFO: `/v3/projects/42f2b5e64c5044328b163c041c009851/users/d0fdaed803a840ab933c3218bda904a4/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.576168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e41d9f-dfb6-4922-9cbd-02bc34a740ce admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.594752 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63bfd1-dfdf-4343-ab59-8432d4b439c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f2b5e64c5044328b163c041c009851, user_id=d0fdaed803a840ab933c3218bda904a4, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.596864 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e41d9f-dfb6-4922-9cbd-02bc34a740ce admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.599192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63bfd1-dfdf-4343-ab59-8432d4b439c7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.609938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e10c-3ac5-4ba2-8445-c29b7939739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.610660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e10c-3ac5-4ba2-8445-c29b7939739c admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.611004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e10c-3ac5-4ba2-8445-c29b7939739c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.612017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e10c-3ac5-4ba2-8445-c29b7939739c admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.612774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e10c-3ac5-4ba2-8445-c29b7939739c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.614448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e10c-3ac5-4ba2-8445-c29b7939739c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.617688 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 972/1975] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:33 2022] PUT /identity/v3/projects/42f2b5e64c5044328b163c041c009851/users/d0fdaed803a840ab933c3218bda904a4/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:33.626236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1004/1976] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:33.628236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70d234-45b3-462d-9cf2-a06d1c4dbaba None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.628524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70d234-45b3-462d-9cf2-a06d1c4dbaba None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.628805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70d234-45b3-462d-9cf2-a06d1c4dbaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.631685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e10c-3ac5-4ba2-8445-c29b7939739c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.642431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e10c-3ac5-4ba2-8445-c29b7939739c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.666466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1a70d234-45b3-462d-9cf2-a06d1c4dbaba None None] MFA Rules not processed for user `d0fdaed803a840ab933c3218bda904a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:33.668250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1a70d234-45b3-462d-9cf2-a06d1c4dbaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:33.750214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:33.767092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 973/1977] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:33.768944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70d234-45b3-462d-9cf2-a06d1c4dbaba None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.805053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd60db-d735-476e-8d65-c2fd7fdbe1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.806345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd60db-d735-476e-8d65-c2fd7fdbe1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.806615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd60db-d735-476e-8d65-c2fd7fdbe1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.806889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd60db-d735-476e-8d65-c2fd7fdbe1b1 admin admin] PATH_INFO: `/v3/projects/d4a240f4a26041ac9f03438e89818710/users/3e54f49068fc437d8249e0a907ab0c9b/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.847364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd60db-d735-476e-8d65-c2fd7fdbe1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a240f4a26041ac9f03438e89818710, user_id=3e54f49068fc437d8249e0a907ab0c9b, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.860623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd60db-d735-476e-8d65-c2fd7fdbe1b1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.862404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70d234-45b3-462d-9cf2-a06d1c4dbaba None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:33.868198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b700be-85eb-4d4b-a7a2-82e832d8e54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:33.868992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b700be-85eb-4d4b-a7a2-82e832d8e54d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.869629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b700be-85eb-4d4b-a7a2-82e832d8e54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.872754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b700be-85eb-4d4b-a7a2-82e832d8e54d admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.873782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b700be-85eb-4d4b-a7a2-82e832d8e54d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:33.875860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b700be-85eb-4d4b-a7a2-82e832d8e54d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:33.878570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1005/1978] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:33 2022] PUT /identity/v3/projects/d4a240f4a26041ac9f03438e89818710/users/3e54f49068fc437d8249e0a907ab0c9b/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:33.891144 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624e4d-ea29-40f6-b288-cd2ba3ecd874 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:33.891509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624e4d-ea29-40f6-b288-cd2ba3ecd874 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:33.891845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624e4d-ea29-40f6-b288-cd2ba3ecd874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:33.907120 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:33.918278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 974/1979] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:33 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:33.923087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b700be-85eb-4d4b-a7a2-82e832d8e54d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:33.942495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cf624e4d-ea29-40f6-b288-cd2ba3ecd874 None None] MFA Rules not processed for user `3e54f49068fc437d8249e0a907ab0c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:33.944005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cf624e4d-ea29-40f6-b288-cd2ba3ecd874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:33.999041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b700be-85eb-4d4b-a7a2-82e832d8e54d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.004398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaa1a7-4728-46a7-a0ec-49c411fd745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.005188 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaa1a7-4728-46a7-a0ec-49c411fd745f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.005469 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaa1a7-4728-46a7-a0ec-49c411fd745f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.005954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaa1a7-4728-46a7-a0ec-49c411fd745f admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.006827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaa1a7-4728-46a7-a0ec-49c411fd745f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.008986 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaa1a7-4728-46a7-a0ec-49c411fd745f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.020734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1006/1980] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:34.025269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf624e4d-ea29-40f6-b288-cd2ba3ecd874 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.032092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 975/1981] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:33 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:34.035924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaa1a7-4728-46a7-a0ec-49c411fd745f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.038385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf624e4d-ea29-40f6-b288-cd2ba3ecd874 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.043700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a2d1-d8b4-4129-8204-e780ce633ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.044370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a2d1-d8b4-4129-8204-e780ce633ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.044645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a2d1-d8b4-4129-8204-e780ce633ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.044917 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a2d1-d8b4-4129-8204-e780ce633ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.045543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a2d1-d8b4-4129-8204-e780ce633ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.046860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaa1a7-4728-46a7-a0ec-49c411fd745f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.047494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a2d1-d8b4-4129-8204-e780ce633ccf admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.052184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8746b4-6970-4bb2-b2bc-80ae3fdaab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.052787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8746b4-6970-4bb2-b2bc-80ae3fdaab78 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.053378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8746b4-6970-4bb2-b2bc-80ae3fdaab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.053378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8746b4-6970-4bb2-b2bc-80ae3fdaab78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.053976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8746b4-6970-4bb2-b2bc-80ae3fdaab78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.055561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8746b4-6970-4bb2-b2bc-80ae3fdaab78 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.066038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 976/1982] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:34.070512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8746b4-6970-4bb2-b2bc-80ae3fdaab78 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.078294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1007/1983] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:34 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:34.081497 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8746b4-6970-4bb2-b2bc-80ae3fdaab78 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.082334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a2d1-d8b4-4129-8204-e780ce633ccf admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.138475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:34.145344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3542317-a678-4ba2-bfbb-578e2071d83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.146041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542317-a678-4ba2-bfbb-578e2071d83d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.146502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542317-a678-4ba2-bfbb-578e2071d83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.146779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3542317-a678-4ba2-bfbb-578e2071d83d admin admin] PATH_INFO: `/v3/projects/5df2447e3f4b45ec9b73fd6308e59e01/users/3221cab421a64b80af32e3c84e8408ea/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.150647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a2d1-d8b4-4129-8204-e780ce633ccf admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.156543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f600a06-3a26-4696-b6c1-cc8d12bb8fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.157528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f600a06-3a26-4696-b6c1-cc8d12bb8fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.157879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f600a06-3a26-4696-b6c1-cc8d12bb8fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.158221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f600a06-3a26-4696-b6c1-cc8d12bb8fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.158927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f600a06-3a26-4696-b6c1-cc8d12bb8fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.161112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f600a06-3a26-4696-b6c1-cc8d12bb8fc0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.162787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3542317-a678-4ba2-bfbb-578e2071d83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df2447e3f4b45ec9b73fd6308e59e01, user_id=3221cab421a64b80af32e3c84e8408ea, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.165736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3542317-a678-4ba2-bfbb-578e2071d83d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.180212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 977/1984] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:34 2022] PUT /identity/v3/projects/5df2447e3f4b45ec9b73fd6308e59e01/users/3221cab421a64b80af32e3c84e8408ea/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:34.185397 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3542317-a678-4ba2-bfbb-578e2071d83d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.189675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1008/1985] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:34 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:34.195640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f600a06-3a26-4696-b6c1-cc8d12bb8fc0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.211315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f600a06-3a26-4696-b6c1-cc8d12bb8fc0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.281017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a221c-d85c-4b1b-a54f-f19f08a337c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.281808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a221c-d85c-4b1b-a54f-f19f08a337c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.282225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a221c-d85c-4b1b-a54f-f19f08a337c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.282597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a221c-d85c-4b1b-a54f-f19f08a337c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.283458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a221c-d85c-4b1b-a54f-f19f08a337c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.285413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a221c-d85c-4b1b-a54f-f19f08a337c1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.287226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:34.292241 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3542317-a678-4ba2-bfbb-578e2071d83d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.299847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1009/1986] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:34.301826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc7d2-0b66-47bb-99ac-3ed492f31777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.302465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc7d2-0b66-47bb-99ac-3ed492f31777 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.302744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc7d2-0b66-47bb-99ac-3ed492f31777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.303071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc7d2-0b66-47bb-99ac-3ed492f31777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.303421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a221c-d85c-4b1b-a54f-f19f08a337c1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.303782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dc7d2-0b66-47bb-99ac-3ed492f31777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.305513 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dc7d2-0b66-47bb-99ac-3ed492f31777 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.317594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a221c-d85c-4b1b-a54f-f19f08a337c1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.323383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 978/1987] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:34.324759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0077d13-c6bc-4d95-89ab-18b21cb5f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.325547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0077d13-c6bc-4d95-89ab-18b21cb5f33a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.325660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc7d2-0b66-47bb-99ac-3ed492f31777 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.326030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0077d13-c6bc-4d95-89ab-18b21cb5f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.326432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0077d13-c6bc-4d95-89ab-18b21cb5f33a admin admin] PATH_INFO: `/v3/projects/3abe2d7dc6484d11aabe2c33ce6607a5/users/528454da99c44221ba004e913dfe6a8d/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.339859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc7d2-0b66-47bb-99ac-3ed492f31777 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.342423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0077d13-c6bc-4d95-89ab-18b21cb5f33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abe2d7dc6484d11aabe2c33ce6607a5, user_id=528454da99c44221ba004e913dfe6a8d, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.345273 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0077d13-c6bc-4d95-89ab-18b21cb5f33a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.350642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729437f-271a-4ad1-81ed-ca1ba6364217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.351361 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729437f-271a-4ad1-81ed-ca1ba6364217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.351699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729437f-271a-4ad1-81ed-ca1ba6364217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.351944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729437f-271a-4ad1-81ed-ca1ba6364217 admin admin] PATH_INFO: `/v3/projects/5df2447e3f4b45ec9b73fd6308e59e01/users/3221cab421a64b80af32e3c84e8408ea/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.354438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729437f-271a-4ad1-81ed-ca1ba6364217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df2447e3f4b45ec9b73fd6308e59e01, user_id=3221cab421a64b80af32e3c84e8408ea, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.357889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729437f-271a-4ad1-81ed-ca1ba6364217 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.361420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1010/1988] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:34 2022] PUT /identity/v3/projects/3abe2d7dc6484d11aabe2c33ce6607a5/users/528454da99c44221ba004e913dfe6a8d/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:34.365459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0077d13-c6bc-4d95-89ab-18b21cb5f33a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.373759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 979/1989] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:34 2022] PUT /identity/v3/projects/5df2447e3f4b45ec9b73fd6308e59e01/users/3221cab421a64b80af32e3c84e8408ea/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:34.384505 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cef18b-ef30-49f5-837f-d7da6ee8270d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.384757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cef18b-ef30-49f5-837f-d7da6ee8270d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.385141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cef18b-ef30-49f5-837f-d7da6ee8270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.421717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-16cef18b-ef30-49f5-837f-d7da6ee8270d None None] MFA Rules not processed for user `3221cab421a64b80af32e3c84e8408ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:34.423033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-16cef18b-ef30-49f5-837f-d7da6ee8270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:34.488162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0077d13-c6bc-4d95-89ab-18b21cb5f33a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.548431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 980/1990] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:34.561111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cef18b-ef30-49f5-837f-d7da6ee8270d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.562675 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-16cef18b-ef30-49f5-837f-d7da6ee8270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:34.619396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aec23-a3a2-4507-9aee-6dd85353f947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.620045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aec23-a3a2-4507-9aee-6dd85353f947 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.620321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aec23-a3a2-4507-9aee-6dd85353f947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.621593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aec23-a3a2-4507-9aee-6dd85353f947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.622680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aec23-a3a2-4507-9aee-6dd85353f947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.624481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aec23-a3a2-4507-9aee-6dd85353f947 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.635607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:34.641327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1011/1991] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:34.646096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aec23-a3a2-4507-9aee-6dd85353f947 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.647606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cef18b-ef30-49f5-837f-d7da6ee8270d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.659192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1823b-446d-445d-99c5-75c462a7a1e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.660025 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1823b-446d-445d-99c5-75c462a7a1e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.660410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1823b-446d-445d-99c5-75c462a7a1e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.660786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1823b-446d-445d-99c5-75c462a7a1e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.661157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aec23-a3a2-4507-9aee-6dd85353f947 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.666241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac68271-7086-4148-bc64-5bb181801bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.666454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68271-7086-4148-bc64-5bb181801bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.666731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68271-7086-4148-bc64-5bb181801bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.667006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68271-7086-4148-bc64-5bb181801bc0 admin admin] PATH_INFO: `/v3/projects/3abe2d7dc6484d11aabe2c33ce6607a5/users/528454da99c44221ba004e913dfe6a8d/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.669350 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac68271-7086-4148-bc64-5bb181801bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abe2d7dc6484d11aabe2c33ce6607a5, user_id=528454da99c44221ba004e913dfe6a8d, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.672028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac68271-7086-4148-bc64-5bb181801bc0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.672276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1823b-446d-445d-99c5-75c462a7a1e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:34.673833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1823b-446d-445d-99c5-75c462a7a1e5 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:34.685346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1012/1992] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:34 2022] PUT /identity/v3/projects/3abe2d7dc6484d11aabe2c33ce6607a5/users/528454da99c44221ba004e913dfe6a8d/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:34.694123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 981/1993] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:25:34.698650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bc672-5dc9-4649-988f-8fe341ff31c8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.699767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bc672-5dc9-4649-988f-8fe341ff31c8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.700176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bc672-5dc9-4649-988f-8fe341ff31c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.737590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9d2bc672-5dc9-4649-988f-8fe341ff31c8 None None] MFA Rules not processed for user `528454da99c44221ba004e913dfe6a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:34.738465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9d2bc672-5dc9-4649-988f-8fe341ff31c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:34.741777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1823b-446d-445d-99c5-75c462a7a1e5 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.743748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8dc1823b-446d-445d-99c5-75c462a7a1e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:34.776482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1823b-446d-445d-99c5-75c462a7a1e5 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.878485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:34.901461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906cf2b-eea2-41e6-a454-c4bd62830dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.907282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906cf2b-eea2-41e6-a454-c4bd62830dea service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.907642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906cf2b-eea2-41e6-a454-c4bd62830dea service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.907977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906cf2b-eea2-41e6-a454-c4bd62830dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:34.942599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1013/1994] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:34.952096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bc672-5dc9-4649-988f-8fe341ff31c8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:34.965287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bc672-5dc9-4649-988f-8fe341ff31c8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:34.978483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253e161-6fad-4d45-97b8-671aeec2abc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:34.979234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253e161-6fad-4d45-97b8-671aeec2abc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:34.979580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253e161-6fad-4d45-97b8-671aeec2abc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:34.980641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253e161-6fad-4d45-97b8-671aeec2abc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:35.014553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906cf2b-eea2-41e6-a454-c4bd62830dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:35.016341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906cf2b-eea2-41e6-a454-c4bd62830dea service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:35.029008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 982/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:35.108462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253e161-6fad-4d45-97b8-671aeec2abc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:35.110306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253e161-6fad-4d45-97b8-671aeec2abc1 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:35.124090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1014/1996] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:25:38.496229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906cf2b-eea2-41e6-a454-c4bd62830dea service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:38.572316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906cf2b-eea2-41e6-a454-c4bd62830dea service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:38.578404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:38.579969 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:38.580105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:38.581850 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] PATH_INFO: `/v3/users/eac810bd00574dac9e6082f4c5f1f623` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:38.581850 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac810bd00574dac9e6082f4c5f1f623)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:38.583867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:38.653259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac810bd00574dac9e6082f4c5f1f623'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:38.658359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:38.672804 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac810bd00574dac9e6082f4c5f1f623'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:38.675073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac810bd00574dac9e6082f4c5f1f623'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:38.676594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac810bd00574dac9e6082f4c5f1f623'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:38.686309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac810bd00574dac9e6082f4c5f1f623'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:38.737835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 983/1997] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:38 2022] DELETE /identity/v3/users/eac810bd00574dac9e6082f4c5f1f623 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:38.742616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f34fa-6eea-4689-a5a4-67f7f9432243 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:38.743169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f34fa-6eea-4689-a5a4-67f7f9432243 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:38.743169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f34fa-6eea-4689-a5a4-67f7f9432243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:38.786781 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d77f34fa-6eea-4689-a5a4-67f7f9432243 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:38.790316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d77f34fa-6eea-4689-a5a4-67f7f9432243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:38.973673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1015/1998] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:38.985791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:38.987689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:39.057145 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87583761-fdac-40c1-9036-596544049b89 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:39.061698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fe496-e461-4b2f-a91d-5f9ee2a83de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:39.062312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fe496-e461-4b2f-a91d-5f9ee2a83de6 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:39.062591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fe496-e461-4b2f-a91d-5f9ee2a83de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:39.062869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fe496-e461-4b2f-a91d-5f9ee2a83de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:39.072601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fe496-e461-4b2f-a91d-5f9ee2a83de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:39.075073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fe496-e461-4b2f-a91d-5f9ee2a83de6 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:39.085586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 984/1999] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:39.467543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f34fa-6eea-4689-a5a4-67f7f9432243 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:39.469029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d77f34fa-6eea-4689-a5a4-67f7f9432243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:39.491937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f34fa-6eea-4689-a5a4-67f7f9432243 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:39.499080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:39.500479 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:39.500784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:39.510466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] PATH_INFO: `/v3/projects/115e3512d5cc456e9ef3a0468428cec9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:39.517034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] RBAC: Authorizing `identity:delete_project(project_id=115e3512d5cc456e9ef3a0468428cec9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:39.532870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:39.606366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115e3512d5cc456e9ef3a0468428cec9', 'request_id': 'req-605840c6-dc3e-43d1-9fde-6065edf5423a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:39.613730 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115e3512d5cc456e9ef3a0468428cec9', 'request_id': 'req-605840c6-dc3e-43d1-9fde-6065edf5423a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:39.622407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115e3512d5cc456e9ef3a0468428cec9', 'request_id': 'req-605840c6-dc3e-43d1-9fde-6065edf5423a'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:39.634657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] The token cache is being invalidate because project 115e3512d5cc456e9ef3a0468428cec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:39.634941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:39.635606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:39.638285 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1016/2000] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:39 2022] DELETE /identity/v3/projects/115e3512d5cc456e9ef3a0468428cec9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:39.642537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fe496-e461-4b2f-a91d-5f9ee2a83de6 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:39.655344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fe496-e461-4b2f-a91d-5f9ee2a83de6 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:39.733493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:39.734482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:39.734982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:39.735487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] PATH_INFO: `/v3/users/d0fdaed803a840ab933c3218bda904a4` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:39.737456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0fdaed803a840ab933c3218bda904a4)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:39.741259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:39.805819 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0fdaed803a840ab933c3218bda904a4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:39.821134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0fdaed803a840ab933c3218bda904a4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:39.821805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0fdaed803a840ab933c3218bda904a4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:39.822439 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0fdaed803a840ab933c3218bda904a4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:39.845611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0fdaed803a840ab933c3218bda904a4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:39.856792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:39.878778 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 985/2001] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:39 2022] DELETE /identity/v3/users/d0fdaed803a840ab933c3218bda904a4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:40.086411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:40.089355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:40.105984 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:40.222915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605840c6-dc3e-43d1-9fde-6065edf5423a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:40.310913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e626ab-91d2-4ddf-b2f4-a735341f3cbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:40.311568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e626ab-91d2-4ddf-b2f4-a735341f3cbf service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:40.311849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e626ab-91d2-4ddf-b2f4-a735341f3cbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:40.312158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e626ab-91d2-4ddf-b2f4-a735341f3cbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:40.317326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f6e626ab-91d2-4ddf-b2f4-a735341f3cbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:40.406527 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e626ab-91d2-4ddf-b2f4-a735341f3cbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:40.408228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e626ab-91d2-4ddf-b2f4-a735341f3cbf service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:40.420753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1017/2002] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:40.463349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:40.466089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:40.581133 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa33fc-9299-4e7e-ab63-d999f28ff6b8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:40.588464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:40.589603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:40.590255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:40.590849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] PATH_INFO: `/v3/projects/42f2b5e64c5044328b163c041c009851` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:40.593028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f2b5e64c5044328b163c041c009851)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:40.596464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:40.670635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f2b5e64c5044328b163c041c009851', 'request_id': 'req-f861f045-e690-4b48-9c1c-fff4897457ea'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:40.681128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f2b5e64c5044328b163c041c009851', 'request_id': 'req-f861f045-e690-4b48-9c1c-fff4897457ea'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:40.694229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f2b5e64c5044328b163c041c009851', 'request_id': 'req-f861f045-e690-4b48-9c1c-fff4897457ea'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:40.709209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] The token cache is being invalidate because project 42f2b5e64c5044328b163c041c009851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:40.709516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:40.710174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:40.716546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e626ab-91d2-4ddf-b2f4-a735341f3cbf service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:40.717777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 986/2003] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:40 2022] DELETE /identity/v3/projects/42f2b5e64c5044328b163c041c009851 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:40.732402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e626ab-91d2-4ddf-b2f4-a735341f3cbf service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:40.813165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daf7c4-bf95-4de8-a30b-a24db5afed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:40.813907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daf7c4-bf95-4de8-a30b-a24db5afed73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:40.814247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daf7c4-bf95-4de8-a30b-a24db5afed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:40.814588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daf7c4-bf95-4de8-a30b-a24db5afed73 admin admin] PATH_INFO: `/v3/users/3221cab421a64b80af32e3c84e8408ea` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:40.815793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daf7c4-bf95-4de8-a30b-a24db5afed73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3221cab421a64b80af32e3c84e8408ea)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:40.817804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daf7c4-bf95-4de8-a30b-a24db5afed73 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:40.841286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:40.900503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-38daf7c4-bf95-4de8-a30b-a24db5afed73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3221cab421a64b80af32e3c84e8408ea'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:40.926916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-38daf7c4-bf95-4de8-a30b-a24db5afed73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3221cab421a64b80af32e3c84e8408ea'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:40.930201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-38daf7c4-bf95-4de8-a30b-a24db5afed73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3221cab421a64b80af32e3c84e8408ea'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:40.932375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-38daf7c4-bf95-4de8-a30b-a24db5afed73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3221cab421a64b80af32e3c84e8408ea'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:40.948145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-38daf7c4-bf95-4de8-a30b-a24db5afed73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3221cab421a64b80af32e3c84e8408ea'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:40.965290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1018/2004] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:40 2022] DELETE /identity/v3/users/3221cab421a64b80af32e3c84e8408ea => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:41.913482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:41.915026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:41.952548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861f045-e690-4b48-9c1c-fff4897457ea admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:42.051378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:42.052318 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:42.052817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:42.053295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] PATH_INFO: `/v3/projects/5df2447e3f4b45ec9b73fd6308e59e01` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:42.054634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df2447e3f4b45ec9b73fd6308e59e01)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:42.056783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:42.108679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:42.212759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df2447e3f4b45ec9b73fd6308e59e01', 'request_id': 'req-ce52ac07-39be-4e69-bcf7-a3e13e526e42'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:42.222577 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df2447e3f4b45ec9b73fd6308e59e01', 'request_id': 'req-ce52ac07-39be-4e69-bcf7-a3e13e526e42'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:42.233881 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df2447e3f4b45ec9b73fd6308e59e01', 'request_id': 'req-ce52ac07-39be-4e69-bcf7-a3e13e526e42'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:42.252190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] The token cache is being invalidate because project 5df2447e3f4b45ec9b73fd6308e59e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:42.253053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:42.253922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ce52ac07-39be-4e69-bcf7-a3e13e526e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:42.261883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801a9a-9f07-445e-b934-6d8ae3c569e1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:42.262416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801a9a-9f07-445e-b934-6d8ae3c569e1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:42.262510 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801a9a-9f07-445e-b934-6d8ae3c569e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:42.262720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 987/2005] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:41 2022] DELETE /identity/v3/projects/5df2447e3f4b45ec9b73fd6308e59e01 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:42.299703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-20801a9a-9f07-445e-b934-6d8ae3c569e1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:42.300941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-20801a9a-9f07-445e-b934-6d8ae3c569e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:42.435568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1019/2006] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:42.451144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304828e-33e9-488b-be75-6f0336f1a74f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:42.451592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304828e-33e9-488b-be75-6f0336f1a74f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:42.452024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304828e-33e9-488b-be75-6f0336f1a74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:42.501096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7304828e-33e9-488b-be75-6f0336f1a74f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:42.505399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7304828e-33e9-488b-be75-6f0336f1a74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:42.518519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 988/2007] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:42.529648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20801a9a-9f07-445e-b934-6d8ae3c569e1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:42.556997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20801a9a-9f07-445e-b934-6d8ae3c569e1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:42.570170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23d198-500b-40a2-98c8-0224e2cd9b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:42.571114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23d198-500b-40a2-98c8-0224e2cd9b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:42.572848 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23d198-500b-40a2-98c8-0224e2cd9b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:42.573889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23d198-500b-40a2-98c8-0224e2cd9b56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:42.576181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23d198-500b-40a2-98c8-0224e2cd9b56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:42.577786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23d198-500b-40a2-98c8-0224e2cd9b56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:42.582804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23d198-500b-40a2-98c8-0224e2cd9b56 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:42.621646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1020/2008] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:25:42.626794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304828e-33e9-488b-be75-6f0336f1a74f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:42.645019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304828e-33e9-488b-be75-6f0336f1a74f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:42.664172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee05799-8fa6-41c5-9c63-d66a372782fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:42.664172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05799-8fa6-41c5-9c63-d66a372782fe admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:42.664172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05799-8fa6-41c5-9c63-d66a372782fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:42.664172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee05799-8fa6-41c5-9c63-d66a372782fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:42.667608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee05799-8fa6-41c5-9c63-d66a372782fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:42.667608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee05799-8fa6-41c5-9c63-d66a372782fe admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:42.726283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 989/2009] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:42 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:42.730721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23d198-500b-40a2-98c8-0224e2cd9b56 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:42.755141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23d198-500b-40a2-98c8-0224e2cd9b56 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:42.868980 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e57523-bedc-45db-843a-6df6f216ad60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:42.869345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e57523-bedc-45db-843a-6df6f216ad60 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:42.869610 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e57523-bedc-45db-843a-6df6f216ad60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:42.869890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e57523-bedc-45db-843a-6df6f216ad60 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:42.871102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e57523-bedc-45db-843a-6df6f216ad60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:42.873177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e57523-bedc-45db-843a-6df6f216ad60 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:42.899935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1021/2010] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:42 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:42.902575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee05799-8fa6-41c5-9c63-d66a372782fe admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:42.918573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee05799-8fa6-41c5-9c63-d66a372782fe admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:42.924149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271746e-9363-4280-8ef6-d0dcee77b201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:42.924775 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271746e-9363-4280-8ef6-d0dcee77b201 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:42.925050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271746e-9363-4280-8ef6-d0dcee77b201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:42.925536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271746e-9363-4280-8ef6-d0dcee77b201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:42.926541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271746e-9363-4280-8ef6-d0dcee77b201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:42.928489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271746e-9363-4280-8ef6-d0dcee77b201 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:42.942973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 990/2011] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:42.948500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e57523-bedc-45db-843a-6df6f216ad60 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:42.960559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e57523-bedc-45db-843a-6df6f216ad60 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:42.966534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71683f4e-668b-4149-adee-b522d1a601b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:42.967244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71683f4e-668b-4149-adee-b522d1a601b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:42.967591 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71683f4e-668b-4149-adee-b522d1a601b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:42.968034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71683f4e-668b-4149-adee-b522d1a601b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:42.969268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71683f4e-668b-4149-adee-b522d1a601b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:42.970991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71683f4e-668b-4149-adee-b522d1a601b6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:42.976885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:42.988094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1022/2012] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:42.989066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271746e-9363-4280-8ef6-d0dcee77b201 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:43.001788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271746e-9363-4280-8ef6-d0dcee77b201 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:43.007555 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f5b12-4b3d-4295-83db-9f866b7f1767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:43.008246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f5b12-4b3d-4295-83db-9f866b7f1767 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:43.008524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f5b12-4b3d-4295-83db-9f866b7f1767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:43.008794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f5b12-4b3d-4295-83db-9f866b7f1767 admin admin] PATH_INFO: `/v3/projects/2e39b20cfca04cbbad04e0b1c5b9fb4e/users/e0485ac888f4471dbc0a748387988303/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:43.028163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f5b12-4b3d-4295-83db-9f866b7f1767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e39b20cfca04cbbad04e0b1c5b9fb4e, user_id=e0485ac888f4471dbc0a748387988303, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:43.031099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f5b12-4b3d-4295-83db-9f866b7f1767 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:43.049611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 991/2013] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:42 2022] PUT /identity/v3/projects/2e39b20cfca04cbbad04e0b1c5b9fb4e/users/e0485ac888f4471dbc0a748387988303/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:43.061550 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b45d-5605-43ed-8625-164f7dc34e4d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:43.061861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b45d-5605-43ed-8625-164f7dc34e4d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:43.062137 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b45d-5605-43ed-8625-164f7dc34e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:43.092809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-75a0b45d-5605-43ed-8625-164f7dc34e4d None None] MFA Rules not processed for user `e0485ac888f4471dbc0a748387988303`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:43.094042 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-75a0b45d-5605-43ed-8625-164f7dc34e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:43.168241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1023/2014] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:43.172717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f5b12-4b3d-4295-83db-9f866b7f1767 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:43.248116 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f5b12-4b3d-4295-83db-9f866b7f1767 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:43.253572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902277d-1020-4db5-a2ca-53f32188b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:43.254341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902277d-1020-4db5-a2ca-53f32188b5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:43.254723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902277d-1020-4db5-a2ca-53f32188b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:43.255101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902277d-1020-4db5-a2ca-53f32188b5d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:43.255839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902277d-1020-4db5-a2ca-53f32188b5d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:43.257867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902277d-1020-4db5-a2ca-53f32188b5d3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:43.295254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 992/2015] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:43 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:43.296647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0b45d-5605-43ed-8625-164f7dc34e4d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:43.309494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0b45d-5605-43ed-8625-164f7dc34e4d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:43.382603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42213b29-9c58-424d-af70-172edf6966c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:43.383227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213b29-9c58-424d-af70-172edf6966c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:43.383505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213b29-9c58-424d-af70-172edf6966c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:43.383778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213b29-9c58-424d-af70-172edf6966c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:43.384503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42213b29-9c58-424d-af70-172edf6966c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:43.387083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42213b29-9c58-424d-af70-172edf6966c4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:43.418732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1024/2016] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:43 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:43.423329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902277d-1020-4db5-a2ca-53f32188b5d3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:43.441728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902277d-1020-4db5-a2ca-53f32188b5d3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:43.448698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad6178-278a-482e-ad84-081e1688611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:43.449331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6178-278a-482e-ad84-081e1688611f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:43.449610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6178-278a-482e-ad84-081e1688611f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:43.449880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad6178-278a-482e-ad84-081e1688611f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:43.450739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad6178-278a-482e-ad84-081e1688611f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:43.452387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad6178-278a-482e-ad84-081e1688611f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:43.484180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42213b29-9c58-424d-af70-172edf6966c4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:43.487922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 993/2017] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:43.500998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42213b29-9c58-424d-af70-172edf6966c4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:43.509864 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22ec27-7fc5-46bb-81c2-5beefc6c5621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:43.510753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22ec27-7fc5-46bb-81c2-5beefc6c5621 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:43.511190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22ec27-7fc5-46bb-81c2-5beefc6c5621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:43.511665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22ec27-7fc5-46bb-81c2-5beefc6c5621 admin admin] PATH_INFO: `/v3/projects/32e6ebba92e34a44a2812a860d20ca94/users/789a114402944d9ab7b512a691ec66d7/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:43.533284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22ec27-7fc5-46bb-81c2-5beefc6c5621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e6ebba92e34a44a2812a860d20ca94, user_id=789a114402944d9ab7b512a691ec66d7, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:43.536511 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22ec27-7fc5-46bb-81c2-5beefc6c5621 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:43.561856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1025/2018] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:43 2022] PUT /identity/v3/projects/32e6ebba92e34a44a2812a860d20ca94/users/789a114402944d9ab7b512a691ec66d7/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:43.565878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad6178-278a-482e-ad84-081e1688611f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:43.583085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad6178-278a-482e-ad84-081e1688611f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:43.601435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:43.768420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13d55e-6e20-4e35-815f-8a67b658e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:43.772070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d55e-6e20-4e35-815f-8a67b658e043 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:43.774874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d55e-6e20-4e35-815f-8a67b658e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:43.774874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d55e-6e20-4e35-815f-8a67b658e043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:43.775524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13d55e-6e20-4e35-815f-8a67b658e043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:43.785909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13d55e-6e20-4e35-815f-8a67b658e043 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:43.825840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 994/2019] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:43.839933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22ec27-7fc5-46bb-81c2-5beefc6c5621 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:43.855348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22ec27-7fc5-46bb-81c2-5beefc6c5621 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:43.877030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56986df-6b47-4e97-82be-e2836b57212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:43.877708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56986df-6b47-4e97-82be-e2836b57212f admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:43.878044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56986df-6b47-4e97-82be-e2836b57212f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:43.878323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56986df-6b47-4e97-82be-e2836b57212f admin admin] PATH_INFO: `/v3/projects/32e6ebba92e34a44a2812a860d20ca94/users/789a114402944d9ab7b512a691ec66d7/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:43.882073 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56986df-6b47-4e97-82be-e2836b57212f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e6ebba92e34a44a2812a860d20ca94, user_id=789a114402944d9ab7b512a691ec66d7, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:43.887677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56986df-6b47-4e97-82be-e2836b57212f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:43.914859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1026/2020] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:43 2022] PUT /identity/v3/projects/32e6ebba92e34a44a2812a860d20ca94/users/789a114402944d9ab7b512a691ec66d7/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:43.926545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33099-4ddf-4c40-89ff-0cec007630a7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:43.928919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33099-4ddf-4c40-89ff-0cec007630a7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:43.929366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33099-4ddf-4c40-89ff-0cec007630a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:43.977351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-77c33099-4ddf-4c40-89ff-0cec007630a7 None None] MFA Rules not processed for user `789a114402944d9ab7b512a691ec66d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:43.979119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-77c33099-4ddf-4c40-89ff-0cec007630a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:44.072421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 995/2021] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:44.086321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56986df-6b47-4e97-82be-e2836b57212f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:44.088508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d56986df-6b47-4e97-82be-e2836b57212f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:44.153965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:44.168398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56986df-6b47-4e97-82be-e2836b57212f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:44.172498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd94006-71ac-41c8-9570-4fb389c837a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:44.173473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94006-71ac-41c8-9570-4fb389c837a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:44.173473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94006-71ac-41c8-9570-4fb389c837a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:44.173853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94006-71ac-41c8-9570-4fb389c837a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:44.186609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd94006-71ac-41c8-9570-4fb389c837a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:44.188214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd94006-71ac-41c8-9570-4fb389c837a9 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:44.204221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1027/2022] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:44.313337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33099-4ddf-4c40-89ff-0cec007630a7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:44.315164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-77c33099-4ddf-4c40-89ff-0cec007630a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:44.330001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33099-4ddf-4c40-89ff-0cec007630a7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:44.337499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d577a17-737b-4bfd-8f4e-9d24bb12e372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:44.338369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d577a17-737b-4bfd-8f4e-9d24bb12e372 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:44.339536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d577a17-737b-4bfd-8f4e-9d24bb12e372 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:44.340740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d577a17-737b-4bfd-8f4e-9d24bb12e372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:44.417498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d577a17-737b-4bfd-8f4e-9d24bb12e372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:44.419415 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d577a17-737b-4bfd-8f4e-9d24bb12e372 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:44.428735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 996/2023] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:25:44.781832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd94006-71ac-41c8-9570-4fb389c837a9 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:44.892056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd94006-71ac-41c8-9570-4fb389c837a9 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:44.905169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:44.906060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:44.906508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:44.907342 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] PATH_INFO: `/v3/users/e0485ac888f4471dbc0a748387988303` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:44.910207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0485ac888f4471dbc0a748387988303)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:44.919655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:45.016308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0485ac888f4471dbc0a748387988303'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.027518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0485ac888f4471dbc0a748387988303'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.028490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0485ac888f4471dbc0a748387988303'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.029654 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0485ac888f4471dbc0a748387988303'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.048218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0485ac888f4471dbc0a748387988303'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.062787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1028/2024] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:44 2022] DELETE /identity/v3/users/e0485ac888f4471dbc0a748387988303 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:45.067162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229cc00-c632-4c48-9b66-e9f9670720f7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:45.067654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229cc00-c632-4c48-9b66-e9f9670720f7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:45.067742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229cc00-c632-4c48-9b66-e9f9670720f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:45.088429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a229cc00-c632-4c48-9b66-e9f9670720f7 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:45.090198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a229cc00-c632-4c48-9b66-e9f9670720f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:45.126830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:45.155090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 997/2025] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:45.164034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:45.165437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:45.230557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81473b25-7ced-4c92-bc93-b9dafe8ebc17 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:45.234243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317af2c8-a17b-43c9-a977-ad46922a4b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:45.234847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317af2c8-a17b-43c9-a977-ad46922a4b09 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:45.235119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317af2c8-a17b-43c9-a977-ad46922a4b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:45.235388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317af2c8-a17b-43c9-a977-ad46922a4b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:45.246423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317af2c8-a17b-43c9-a977-ad46922a4b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:45.248521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317af2c8-a17b-43c9-a977-ad46922a4b09 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:45.259064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1029/2026] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:45.725527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229cc00-c632-4c48-9b66-e9f9670720f7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:45.726992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a229cc00-c632-4c48-9b66-e9f9670720f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:45.740406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229cc00-c632-4c48-9b66-e9f9670720f7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:45.745403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:45.746183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:45.746468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:45.746745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] PATH_INFO: `/v3/projects/2e39b20cfca04cbbad04e0b1c5b9fb4e` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:45.748011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e39b20cfca04cbbad04e0b1c5b9fb4e)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:45.749979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:45.799871 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e39b20cfca04cbbad04e0b1c5b9fb4e', 'request_id': 'req-1d484271-ae16-4890-bb3e-10b5de831af8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.806683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e39b20cfca04cbbad04e0b1c5b9fb4e', 'request_id': 'req-1d484271-ae16-4890-bb3e-10b5de831af8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.816245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e39b20cfca04cbbad04e0b1c5b9fb4e', 'request_id': 'req-1d484271-ae16-4890-bb3e-10b5de831af8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.831446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] The token cache is being invalidate because project 2e39b20cfca04cbbad04e0b1c5b9fb4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:45.831649 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.832459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.834280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 998/2027] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:45 2022] DELETE /identity/v3/projects/2e39b20cfca04cbbad04e0b1c5b9fb4e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:45.838266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317af2c8-a17b-43c9-a977-ad46922a4b09 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:45.853017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317af2c8-a17b-43c9-a977-ad46922a4b09 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:45.856943 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:45.913364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c610c78-118f-4598-a417-5012662ee354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:45.913997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610c78-118f-4598-a417-5012662ee354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:45.914274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610c78-118f-4598-a417-5012662ee354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:45.914548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610c78-118f-4598-a417-5012662ee354 admin admin] PATH_INFO: `/v3/users/789a114402944d9ab7b512a691ec66d7` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:45.915665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c610c78-118f-4598-a417-5012662ee354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789a114402944d9ab7b512a691ec66d7)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:45.918183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c610c78-118f-4598-a417-5012662ee354 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:45.964245 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7c610c78-118f-4598-a417-5012662ee354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789a114402944d9ab7b512a691ec66d7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.971706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7c610c78-118f-4598-a417-5012662ee354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789a114402944d9ab7b512a691ec66d7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.972628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7c610c78-118f-4598-a417-5012662ee354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789a114402944d9ab7b512a691ec66d7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.973380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7c610c78-118f-4598-a417-5012662ee354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789a114402944d9ab7b512a691ec66d7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.986124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7c610c78-118f-4598-a417-5012662ee354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789a114402944d9ab7b512a691ec66d7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:45.999254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1030/2028] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:45 2022] DELETE /identity/v3/users/789a114402944d9ab7b512a691ec66d7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:46.086080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:46.087769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:46.105141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d484271-ae16-4890-bb3e-10b5de831af8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:46.174044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:46.174961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:46.175241 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:46.175515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] PATH_INFO: `/v3/users/3e54f49068fc437d8249e0a907ab0c9b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:46.176696 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e54f49068fc437d8249e0a907ab0c9b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:46.178621 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:46.268455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e54f49068fc437d8249e0a907ab0c9b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:46.280523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e54f49068fc437d8249e0a907ab0c9b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:46.283507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e54f49068fc437d8249e0a907ab0c9b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:46.287003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e54f49068fc437d8249e0a907ab0c9b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:46.304067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e54f49068fc437d8249e0a907ab0c9b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:46.306260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:46.330439 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 999/2029] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:46 2022] DELETE /identity/v3/users/3e54f49068fc437d8249e0a907ab0c9b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:46.335082 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ba17-b2e4-49af-8d9f-670bd4d0ddf1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:46.335390 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ba17-b2e4-49af-8d9f-670bd4d0ddf1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:46.335761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ba17-b2e4-49af-8d9f-670bd4d0ddf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:46.355627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fdd5ba17-b2e4-49af-8d9f-670bd4d0ddf1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:46.356886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fdd5ba17-b2e4-49af-8d9f-670bd4d0ddf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:46.404642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:46.406206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:46.432950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1031/2030] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:46.442698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5ba17-b2e4-49af-8d9f-670bd4d0ddf1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:46.444598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fdd5ba17-b2e4-49af-8d9f-670bd4d0ddf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:46.478981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:46.487114 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37783194-7eaa-484b-ab0b-a4ba5b29c248 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:46.497274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:46.498617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:46.499181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:46.499447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] PATH_INFO: `/v3/projects/32e6ebba92e34a44a2812a860d20ca94` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:46.501389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e6ebba92e34a44a2812a860d20ca94)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:46.503294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:46.516541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5ba17-b2e4-49af-8d9f-670bd4d0ddf1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:46.520500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3c934-589c-44c6-802a-d2a8e3648fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:46.521236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3c934-589c-44c6-802a-d2a8e3648fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:46.521508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3c934-589c-44c6-802a-d2a8e3648fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:46.521776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3c934-589c-44c6-802a-d2a8e3648fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:46.536530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3c934-589c-44c6-802a-d2a8e3648fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:46.536530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3c934-589c-44c6-802a-d2a8e3648fd1 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:46.547553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1032/2031] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:25:46.561815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e6ebba92e34a44a2812a860d20ca94', 'request_id': 'req-07242b62-ca7a-48c9-9a9a-1920718309ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:46.568535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e6ebba92e34a44a2812a860d20ca94', 'request_id': 'req-07242b62-ca7a-48c9-9a9a-1920718309ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:46.578636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e6ebba92e34a44a2812a860d20ca94', 'request_id': 'req-07242b62-ca7a-48c9-9a9a-1920718309ff'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:46.595419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] The token cache is being invalidate because project 32e6ebba92e34a44a2812a860d20ca94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:46.595755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:46.596530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-07242b62-ca7a-48c9-9a9a-1920718309ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:46.598352 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1000/2032] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:46 2022] DELETE /identity/v3/projects/32e6ebba92e34a44a2812a860d20ca94 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:46.604235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddbfc8-5aeb-4c7e-8866-756403467c72 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:46.605109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddbfc8-5aeb-4c7e-8866-756403467c72 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:46.605475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddbfc8-5aeb-4c7e-8866-756403467c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:46.630165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-00ddbfc8-5aeb-4c7e-8866-756403467c72 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:46.631619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-00ddbfc8-5aeb-4c7e-8866-756403467c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:46.726703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1033/2033] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:46.738283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd7f31-a2e9-4495-8d76-ded5ebfd52a6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:46.738693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd7f31-a2e9-4495-8d76-ded5ebfd52a6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:46.739048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd7f31-a2e9-4495-8d76-ded5ebfd52a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:46.763546 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-93cd7f31-a2e9-4495-8d76-ded5ebfd52a6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:46.764946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-93cd7f31-a2e9-4495-8d76-ded5ebfd52a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:46.773339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1001/2034] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:46.780182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddbfc8-5aeb-4c7e-8866-756403467c72 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:46.798050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddbfc8-5aeb-4c7e-8866-756403467c72 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:46.805638 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66d7da-e060-4452-810c-872a55aa92c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:46.806386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66d7da-e060-4452-810c-872a55aa92c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:46.806723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66d7da-e060-4452-810c-872a55aa92c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:46.807058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66d7da-e060-4452-810c-872a55aa92c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:46.808799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66d7da-e060-4452-810c-872a55aa92c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:46.809184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66d7da-e060-4452-810c-872a55aa92c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:46.811066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66d7da-e060-4452-810c-872a55aa92c9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:46.828399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1034/2035] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:25:46.830149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd7f31-a2e9-4495-8d76-ded5ebfd52a6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:46.842517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd7f31-a2e9-4495-8d76-ded5ebfd52a6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:46.848056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f2ea4-0768-445b-b0c7-886f1d733bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:46.848769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f2ea4-0768-445b-b0c7-886f1d733bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:46.849110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f2ea4-0768-445b-b0c7-886f1d733bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:46.849601 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f2ea4-0768-445b-b0c7-886f1d733bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:46.850329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f2ea4-0768-445b-b0c7-886f1d733bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:46.853255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f2ea4-0768-445b-b0c7-886f1d733bd4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:46.888419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1002/2036] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:46 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:46.892537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66d7da-e060-4452-810c-872a55aa92c9 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:46.898646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f2ea4-0768-445b-b0c7-886f1d733bd4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:46.900273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0d2f2ea4-0768-445b-b0c7-886f1d733bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:46.905602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66d7da-e060-4452-810c-872a55aa92c9 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:46.952527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:46.973185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede3a96-d863-45c8-83de-c69600a3f317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:46.973802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede3a96-d863-45c8-83de-c69600a3f317 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:46.974061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede3a96-d863-45c8-83de-c69600a3f317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:46.974332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede3a96-d863-45c8-83de-c69600a3f317 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:46.974945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede3a96-d863-45c8-83de-c69600a3f317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:46.975640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f2ea4-0768-445b-b0c7-886f1d733bd4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:46.976877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede3a96-d863-45c8-83de-c69600a3f317 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:46.981330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:46.981961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:46.982242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:46.982516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] PATH_INFO: `/v3/projects/d4a240f4a26041ac9f03438e89818710` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:46.983641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a240f4a26041ac9f03438e89818710)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:46.985655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:47.002012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1035/2037] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:46 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:47.005796 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede3a96-d863-45c8-83de-c69600a3f317 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:47.015814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede3a96-d863-45c8-83de-c69600a3f317 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:47.020840 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a670a-4f18-49e1-a811-065f994b11ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:47.021426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a670a-4f18-49e1-a811-065f994b11ef admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.021705 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a670a-4f18-49e1-a811-065f994b11ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.022313 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a670a-4f18-49e1-a811-065f994b11ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.022785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a670a-4f18-49e1-a811-065f994b11ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:47.024345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a670a-4f18-49e1-a811-065f994b11ef admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:47.035748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1036/2038] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:47.038071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a240f4a26041ac9f03438e89818710', 'request_id': 'req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.039806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a670a-4f18-49e1-a811-065f994b11ef admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:47.045159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a240f4a26041ac9f03438e89818710', 'request_id': 'req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.050666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a670a-4f18-49e1-a811-065f994b11ef admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:47.053176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a240f4a26041ac9f03438e89818710', 'request_id': 'req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.065213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] The token cache is being invalidate because project d4a240f4a26041ac9f03438e89818710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:47.065499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.066171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.067680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1003/2039] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:46 2022] DELETE /identity/v3/projects/d4a240f4a26041ac9f03438e89818710 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:47.072109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:47.074321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:47.086298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:47.117159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23210c16-522b-4a29-b926-fd8f7b11a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:47.117675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210c16-522b-4a29-b926-fd8f7b11a00c admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.117950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210c16-522b-4a29-b926-fd8f7b11a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.118219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210c16-522b-4a29-b926-fd8f7b11a00c admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.118851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23210c16-522b-4a29-b926-fd8f7b11a00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:47.121727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23210c16-522b-4a29-b926-fd8f7b11a00c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:47.131494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1037/2040] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:47.136010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23210c16-522b-4a29-b926-fd8f7b11a00c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:47.138014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-23210c16-522b-4a29-b926-fd8f7b11a00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:47.146485 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc58df4-192b-416e-9e7f-9e6a0ed9f4c4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:47.152063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:47.152707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.152983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.153257 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] PATH_INFO: `/v3/users/528454da99c44221ba004e913dfe6a8d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.154478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=528454da99c44221ba004e913dfe6a8d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:47.154616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23210c16-522b-4a29-b926-fd8f7b11a00c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:47.156456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:47.160421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1584a-2bea-4fc9-ad64-b3574249fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:47.161214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1584a-2bea-4fc9-ad64-b3574249fb9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.161686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1584a-2bea-4fc9-ad64-b3574249fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.161972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1584a-2bea-4fc9-ad64-b3574249fb9a admin admin] PATH_INFO: `/v3/projects/cd1a046dfdb54377a87fabd09e405e6f/users/44a9dac5d09041e2a593cede9c48998e/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.181645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1584a-2bea-4fc9-ad64-b3574249fb9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1a046dfdb54377a87fabd09e405e6f, user_id=44a9dac5d09041e2a593cede9c48998e, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:47.185084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1584a-2bea-4fc9-ad64-b3574249fb9a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:47.199426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1038/2041] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:47 2022] PUT /identity/v3/projects/cd1a046dfdb54377a87fabd09e405e6f/users/44a9dac5d09041e2a593cede9c48998e/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:47.210324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee92295-e168-4741-bbac-d397fa73adec None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.210602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee92295-e168-4741-bbac-d397fa73adec None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.210897 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee92295-e168-4741-bbac-d397fa73adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.218093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528454da99c44221ba004e913dfe6a8d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.227085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528454da99c44221ba004e913dfe6a8d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.228030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528454da99c44221ba004e913dfe6a8d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.228706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528454da99c44221ba004e913dfe6a8d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.235792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528454da99c44221ba004e913dfe6a8d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.239867 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8ee92295-e168-4741-bbac-d397fa73adec None None] MFA Rules not processed for user `44a9dac5d09041e2a593cede9c48998e`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:47.241239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8ee92295-e168-4741-bbac-d397fa73adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:47.243774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:47.259714 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1004/2042] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:47 2022] DELETE /identity/v3/users/528454da99c44221ba004e913dfe6a8d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:47.317798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1039/2043] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:47.330259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:47.331756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:47.396781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d960c1d-8e53-465f-92ec-caa059868ea6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:47.401456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b898de-79ca-4f88-bc81-9247a3a41a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:47.402117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b898de-79ca-4f88-bc81-9247a3a41a80 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.402401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b898de-79ca-4f88-bc81-9247a3a41a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.402674 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b898de-79ca-4f88-bc81-9247a3a41a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.464539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b898de-79ca-4f88-bc81-9247a3a41a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:47.465993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b898de-79ca-4f88-bc81-9247a3a41a80 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:47.476005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1005/2044] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:47.501640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee92295-e168-4741-bbac-d397fa73adec None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:47.503853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8ee92295-e168-4741-bbac-d397fa73adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:47.583600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee92295-e168-4741-bbac-d397fa73adec None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:47.637234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:47.648221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b898de-79ca-4f88-bc81-9247a3a41a80 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:47.649692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b8b898de-79ca-4f88-bc81-9247a3a41a80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:47.657720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3053f0a-1d88-4dbd-ac7a-4ca89b76e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:47.658475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3053f0a-1d88-4dbd-ac7a-4ca89b76e2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.658830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3053f0a-1d88-4dbd-ac7a-4ca89b76e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.659160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3053f0a-1d88-4dbd-ac7a-4ca89b76e2b2 admin admin] PATH_INFO: `/v3/users/44a9dac5d09041e2a593cede9c48998e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.660516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3053f0a-1d88-4dbd-ac7a-4ca89b76e2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a9dac5d09041e2a593cede9c48998e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:47.662498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3053f0a-1d88-4dbd-ac7a-4ca89b76e2b2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:47.673029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b898de-79ca-4f88-bc81-9247a3a41a80 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:47.679199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:47.684505 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.684795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.685071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] PATH_INFO: `/v3/projects/3abe2d7dc6484d11aabe2c33ce6607a5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.686525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abe2d7dc6484d11aabe2c33ce6607a5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:47.688876 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:47.721049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a3053f0a-1d88-4dbd-ac7a-4ca89b76e2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a9dac5d09041e2a593cede9c48998e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.731132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a3053f0a-1d88-4dbd-ac7a-4ca89b76e2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a9dac5d09041e2a593cede9c48998e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.731990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a3053f0a-1d88-4dbd-ac7a-4ca89b76e2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a9dac5d09041e2a593cede9c48998e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.732868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a3053f0a-1d88-4dbd-ac7a-4ca89b76e2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a9dac5d09041e2a593cede9c48998e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.747671 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a3053f0a-1d88-4dbd-ac7a-4ca89b76e2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a9dac5d09041e2a593cede9c48998e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.749476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abe2d7dc6484d11aabe2c33ce6607a5', 'request_id': 'req-67dd21e2-d4f4-486d-b108-0f6ce2932976'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.756506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abe2d7dc6484d11aabe2c33ce6607a5', 'request_id': 'req-67dd21e2-d4f4-486d-b108-0f6ce2932976'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.762129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1040/2045] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:47 2022] DELETE /identity/v3/users/44a9dac5d09041e2a593cede9c48998e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:47.767146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abe2d7dc6484d11aabe2c33ce6607a5', 'request_id': 'req-67dd21e2-d4f4-486d-b108-0f6ce2932976'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.767315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275334-6890-4998-abe5-9979bd8b5687 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.767618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275334-6890-4998-abe5-9979bd8b5687 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.767974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275334-6890-4998-abe5-9979bd8b5687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.788283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] The token cache is being invalidate because project 3abe2d7dc6484d11aabe2c33ce6607a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:47.788576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.789332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67dd21e2-d4f4-486d-b108-0f6ce2932976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:47.795961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1006/2046] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:47 2022] DELETE /identity/v3/projects/3abe2d7dc6484d11aabe2c33ce6607a5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:47.797913 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414e9fc-7bef-453f-9f41-4ff026325cd7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.798032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-11275334-6890-4998-abe5-9979bd8b5687 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:47.798203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414e9fc-7bef-453f-9f41-4ff026325cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.798567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414e9fc-7bef-453f-9f41-4ff026325cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.800560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-11275334-6890-4998-abe5-9979bd8b5687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:47.841454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6414e9fc-7bef-453f-9f41-4ff026325cd7 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:47.843724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6414e9fc-7bef-453f-9f41-4ff026325cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:47.870618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1041/2047] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:47.874611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:47.881578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11275334-6890-4998-abe5-9979bd8b5687 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:47.883587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-11275334-6890-4998-abe5-9979bd8b5687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:47.927737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1007/2048] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:47.936800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a494d3-a863-483c-b211-de87ffe96269 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.937288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a494d3-a863-483c-b211-de87ffe96269 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.938519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a494d3-a863-483c-b211-de87ffe96269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.966729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11275334-6890-4998-abe5-9979bd8b5687 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:47.967739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-81a494d3-a863-483c-b211-de87ffe96269 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:47.969164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-81a494d3-a863-483c-b211-de87ffe96269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:47.970770 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836af76-df45-48a0-b853-3eda363fc4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:47.971381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836af76-df45-48a0-b853-3eda363fc4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:47.971659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836af76-df45-48a0-b853-3eda363fc4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:47.971960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836af76-df45-48a0-b853-3eda363fc4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:47.980431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1008/2049] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:47.984678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a494d3-a863-483c-b211-de87ffe96269 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:47.989316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836af76-df45-48a0-b853-3eda363fc4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:47.990988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836af76-df45-48a0-b853-3eda363fc4f9 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:47.998391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a494d3-a863-483c-b211-de87ffe96269 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.003104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1042/2050] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:48.004784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7837044-66ce-4c17-b6ab-9fbc7395ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.005371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7837044-66ce-4c17-b6ab-9fbc7395ec32 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.005729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7837044-66ce-4c17-b6ab-9fbc7395ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.006077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7837044-66ce-4c17-b6ab-9fbc7395ec32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.006810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7837044-66ce-4c17-b6ab-9fbc7395ec32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:48.007185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7837044-66ce-4c17-b6ab-9fbc7395ec32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.008883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7837044-66ce-4c17-b6ab-9fbc7395ec32 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.023952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1009/2051] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:25:48.026960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836af76-df45-48a0-b853-3eda363fc4f9 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.037274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836af76-df45-48a0-b853-3eda363fc4f9 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.047023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cffa6a-a459-426b-9fd6-6fc4b78d6a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.047750 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cffa6a-a459-426b-9fd6-6fc4b78d6a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.048068 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cffa6a-a459-426b-9fd6-6fc4b78d6a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.048342 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cffa6a-a459-426b-9fd6-6fc4b78d6a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.048989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cffa6a-a459-426b-9fd6-6fc4b78d6a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.051639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cffa6a-a459-426b-9fd6-6fc4b78d6a51 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.058542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:48.096229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1043/2052] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:48 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:48.097857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7837044-66ce-4c17-b6ab-9fbc7395ec32 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.110018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7837044-66ce-4c17-b6ab-9fbc7395ec32 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.186617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932905e-5cdc-45db-ab09-190192995550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.187317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932905e-5cdc-45db-ab09-190192995550 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.187671 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932905e-5cdc-45db-ab09-190192995550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.188047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932905e-5cdc-45db-ab09-190192995550 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.188773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932905e-5cdc-45db-ab09-190192995550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.191052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932905e-5cdc-45db-ab09-190192995550 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.221542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1010/2053] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:48 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:48.222738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cffa6a-a459-426b-9fd6-6fc4b78d6a51 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.235620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cffa6a-a459-426b-9fd6-6fc4b78d6a51 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.242681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ad411-64b4-441a-b864-6e37c67f0380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.243386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ad411-64b4-441a-b864-6e37c67f0380 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.243697 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ad411-64b4-441a-b864-6e37c67f0380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.244061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ad411-64b4-441a-b864-6e37c67f0380 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.245348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ad411-64b4-441a-b864-6e37c67f0380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.246849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ad411-64b4-441a-b864-6e37c67f0380 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.263395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1044/2054] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:48.267354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932905e-5cdc-45db-ab09-190192995550 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.278529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932905e-5cdc-45db-ab09-190192995550 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.288877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08ecfc-59fc-4e9f-8058-be72ce4fb484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.290337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ecfc-59fc-4e9f-8058-be72ce4fb484 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.290822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ecfc-59fc-4e9f-8058-be72ce4fb484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.291337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ecfc-59fc-4e9f-8058-be72ce4fb484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.292612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08ecfc-59fc-4e9f-8058-be72ce4fb484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.294878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08ecfc-59fc-4e9f-8058-be72ce4fb484 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.309361 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1011/2055] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:48.313702 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ad411-64b4-441a-b864-6e37c67f0380 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.324602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ad411-64b4-441a-b864-6e37c67f0380 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.329390 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fada35-9c82-4c56-b158-2e4b574cb0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.330045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fada35-9c82-4c56-b158-2e4b574cb0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.330326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fada35-9c82-4c56-b158-2e4b574cb0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.330601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fada35-9c82-4c56-b158-2e4b574cb0d1 admin admin] PATH_INFO: `/v3/projects/e64175b395be44af9640e2c4b21ae357/users/72571b0f369f4f5e8fb1ec03ac98072a/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.348646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fada35-9c82-4c56-b158-2e4b574cb0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64175b395be44af9640e2c4b21ae357, user_id=72571b0f369f4f5e8fb1ec03ac98072a, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.351435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fada35-9c82-4c56-b158-2e4b574cb0d1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.365191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08ecfc-59fc-4e9f-8058-be72ce4fb484 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.366612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1045/2056] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:48 2022] PUT /identity/v3/projects/e64175b395be44af9640e2c4b21ae357/users/72571b0f369f4f5e8fb1ec03ac98072a/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:48.367134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bb08ecfc-59fc-4e9f-8058-be72ce4fb484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:48.379498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30636dc-8fa7-4779-a7e8-8d47567f017a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.380124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30636dc-8fa7-4779-a7e8-8d47567f017a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.380307 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30636dc-8fa7-4779-a7e8-8d47567f017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.392902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08ecfc-59fc-4e9f-8058-be72ce4fb484 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.411317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b30636dc-8fa7-4779-a7e8-8d47567f017a None None] MFA Rules not processed for user `72571b0f369f4f5e8fb1ec03ac98072a`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:48.412596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b30636dc-8fa7-4779-a7e8-8d47567f017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:48.457303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.457860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.458141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.458423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] PATH_INFO: `/v3/projects/cd1a046dfdb54377a87fabd09e405e6f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.459610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1a046dfdb54377a87fabd09e405e6f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.461568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.482299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1046/2057] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:48.487074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30636dc-8fa7-4779-a7e8-8d47567f017a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.498607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:48.500139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30636dc-8fa7-4779-a7e8-8d47567f017a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.519003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1a046dfdb54377a87fabd09e405e6f', 'request_id': 'req-893141b7-9531-4f2f-bf41-1e83c67ebadd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:48.527713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1a046dfdb54377a87fabd09e405e6f', 'request_id': 'req-893141b7-9531-4f2f-bf41-1e83c67ebadd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:48.537018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1a046dfdb54377a87fabd09e405e6f', 'request_id': 'req-893141b7-9531-4f2f-bf41-1e83c67ebadd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:48.556156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] The token cache is being invalidate because project cd1a046dfdb54377a87fabd09e405e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:48.556443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:48.557207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-893141b7-9531-4f2f-bf41-1e83c67ebadd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:48.559294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1012/2058] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:48 2022] DELETE /identity/v3/projects/cd1a046dfdb54377a87fabd09e405e6f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:48.564089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921a2ca-d4f6-4522-bbc6-abd267057b0f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.564383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921a2ca-d4f6-4522-bbc6-abd267057b0f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.564662 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921a2ca-d4f6-4522-bbc6-abd267057b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.565722 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ed667-9ef0-49fe-b564-bfc53a4e2355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.566403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ed667-9ef0-49fe-b564-bfc53a4e2355 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.566752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ed667-9ef0-49fe-b564-bfc53a4e2355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.567280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ed667-9ef0-49fe-b564-bfc53a4e2355 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.567927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ed667-9ef0-49fe-b564-bfc53a4e2355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.572764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ed667-9ef0-49fe-b564-bfc53a4e2355 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.585860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d921a2ca-d4f6-4522-bbc6-abd267057b0f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:48.586891 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d921a2ca-d4f6-4522-bbc6-abd267057b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:48.600052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1013/2059] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:48.603786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1047/2060] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:48 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:48.608729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ed667-9ef0-49fe-b564-bfc53a4e2355 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.610797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ab8ed667-9ef0-49fe-b564-bfc53a4e2355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:48.611978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e995-c537-4c60-8b20-23dc52bfa64e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.611978 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e995-c537-4c60-8b20-23dc52bfa64e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.612351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083e995-c537-4c60-8b20-23dc52bfa64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.650573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1083e995-c537-4c60-8b20-23dc52bfa64e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:48.651670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1083e995-c537-4c60-8b20-23dc52bfa64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:48.664211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:48.711640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ed667-9ef0-49fe-b564-bfc53a4e2355 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.717751 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0afddc-6af6-4f8f-8d8a-cd43e1fbad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.718355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0afddc-6af6-4f8f-8d8a-cd43e1fbad19 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.719070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0afddc-6af6-4f8f-8d8a-cd43e1fbad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.719070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0afddc-6af6-4f8f-8d8a-cd43e1fbad19 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.719583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0afddc-6af6-4f8f-8d8a-cd43e1fbad19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.721552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0afddc-6af6-4f8f-8d8a-cd43e1fbad19 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.731456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1014/2061] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:48.735657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083e995-c537-4c60-8b20-23dc52bfa64e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.744071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1048/2062] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:48 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:48.745002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083e995-c537-4c60-8b20-23dc52bfa64e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.749014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0afddc-6af6-4f8f-8d8a-cd43e1fbad19 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.750327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338d1f2-6cb7-4312-b08a-d0ce7af1826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.750890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338d1f2-6cb7-4312-b08a-d0ce7af1826c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.751167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338d1f2-6cb7-4312-b08a-d0ce7af1826c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.751438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338d1f2-6cb7-4312-b08a-d0ce7af1826c admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.752105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338d1f2-6cb7-4312-b08a-d0ce7af1826c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:48.752405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338d1f2-6cb7-4312-b08a-d0ce7af1826c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.754105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338d1f2-6cb7-4312-b08a-d0ce7af1826c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.761278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0afddc-6af6-4f8f-8d8a-cd43e1fbad19 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.766070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986094e-36eb-4b9f-ab1d-e6163a643632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.766717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986094e-36eb-4b9f-ab1d-e6163a643632 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.766882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1015/2063] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:25:48.767000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986094e-36eb-4b9f-ab1d-e6163a643632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.767270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986094e-36eb-4b9f-ab1d-e6163a643632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.767933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986094e-36eb-4b9f-ab1d-e6163a643632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.769535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986094e-36eb-4b9f-ab1d-e6163a643632 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.771035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338d1f2-6cb7-4312-b08a-d0ce7af1826c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.784200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1049/2064] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:48.784373 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338d1f2-6cb7-4312-b08a-d0ce7af1826c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.785528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986094e-36eb-4b9f-ab1d-e6163a643632 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.788150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27119-9f74-4c5d-82e2-e6df572d64e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.789028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27119-9f74-4c5d-82e2-e6df572d64e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.789333 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27119-9f74-4c5d-82e2-e6df572d64e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.789734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe27119-9f74-4c5d-82e2-e6df572d64e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.790372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe27119-9f74-4c5d-82e2-e6df572d64e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.792905 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe27119-9f74-4c5d-82e2-e6df572d64e1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.796957 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986094e-36eb-4b9f-ab1d-e6163a643632 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.801949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81251267-3945-4030-b498-c2f93de0aa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.802604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251267-3945-4030-b498-c2f93de0aa34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.802886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251267-3945-4030-b498-c2f93de0aa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.803162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251267-3945-4030-b498-c2f93de0aa34 admin admin] PATH_INFO: `/v3/projects/5608dcd879b6478aa16905cb85c0cde3/users/52c0bab224314cdcb609ce5187a63041/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.821683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81251267-3945-4030-b498-c2f93de0aa34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5608dcd879b6478aa16905cb85c0cde3, user_id=52c0bab224314cdcb609ce5187a63041, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.828652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1016/2065] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:48 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:48.828821 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81251267-3945-4030-b498-c2f93de0aa34 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.834053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27119-9f74-4c5d-82e2-e6df572d64e1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.844373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1050/2066] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:48 2022] PUT /identity/v3/projects/5608dcd879b6478aa16905cb85c0cde3/users/52c0bab224314cdcb609ce5187a63041/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:48.848529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81251267-3945-4030-b498-c2f93de0aa34 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.903615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe27119-9f74-4c5d-82e2-e6df572d64e1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.921859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81251267-3945-4030-b498-c2f93de0aa34 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.925187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:48.926622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7142b-10bd-4b89-963a-f13bee29caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.927346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7142b-10bd-4b89-963a-f13bee29caae admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.927630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7142b-10bd-4b89-963a-f13bee29caae admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.927916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7142b-10bd-4b89-963a-f13bee29caae admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.928559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7142b-10bd-4b89-963a-f13bee29caae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.930276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7142b-10bd-4b89-963a-f13bee29caae admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.941115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1051/2067] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:48.945192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7142b-10bd-4b89-963a-f13bee29caae admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:48.955264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7142b-10bd-4b89-963a-f13bee29caae admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:48.960131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c9c79-0a71-4970-a9d0-04e9e2c3846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.960759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c9c79-0a71-4970-a9d0-04e9e2c3846c admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.961038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c9c79-0a71-4970-a9d0-04e9e2c3846c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.961316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c9c79-0a71-4970-a9d0-04e9e2c3846c admin admin] PATH_INFO: `/v3/projects/5608dcd879b6478aa16905cb85c0cde3/users/52c0bab224314cdcb609ce5187a63041/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.963282 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c9c79-0a71-4970-a9d0-04e9e2c3846c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5608dcd879b6478aa16905cb85c0cde3, user_id=52c0bab224314cdcb609ce5187a63041, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.965894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c9c79-0a71-4970-a9d0-04e9e2c3846c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.966245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95159743-8747-49db-8322-b0c75a5b9ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:48.966848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159743-8747-49db-8322-b0c75a5b9ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.967125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159743-8747-49db-8322-b0c75a5b9ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.967507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95159743-8747-49db-8322-b0c75a5b9ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.968158 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95159743-8747-49db-8322-b0c75a5b9ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:48.970035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95159743-8747-49db-8322-b0c75a5b9ca5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:48.976157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1052/2068] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:48 2022] PUT /identity/v3/projects/5608dcd879b6478aa16905cb85c0cde3/users/52c0bab224314cdcb609ce5187a63041/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:48.986928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e8ac-6095-45ef-afb5-eb1b97bab9d1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:48.987213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e8ac-6095-45ef-afb5-eb1b97bab9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:48.987572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e8ac-6095-45ef-afb5-eb1b97bab9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:48.998836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1017/2069] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:48 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:49.000104 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95159743-8747-49db-8322-b0c75a5b9ca5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:49.014595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95159743-8747-49db-8322-b0c75a5b9ca5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:49.027335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e4f3e8ac-6095-45ef-afb5-eb1b97bab9d1 None None] MFA Rules not processed for user `52c0bab224314cdcb609ce5187a63041`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:49.028075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e4f3e8ac-6095-45ef-afb5-eb1b97bab9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:49.080499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a52a4d-542c-45b5-8900-497cd45d3045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:49.081240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a52a4d-542c-45b5-8900-497cd45d3045 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:49.081588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a52a4d-542c-45b5-8900-497cd45d3045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:49.081939 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a52a4d-542c-45b5-8900-497cd45d3045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:49.082210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:49.082736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a52a4d-542c-45b5-8900-497cd45d3045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:49.084908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a52a4d-542c-45b5-8900-497cd45d3045 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:49.098042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1018/2070] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:49.101855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a52a4d-542c-45b5-8900-497cd45d3045 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:49.107725 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1053/2071] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:49.115949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a52a4d-542c-45b5-8900-497cd45d3045 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:49.119015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3e8ac-6095-45ef-afb5-eb1b97bab9d1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:49.121513 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f428def-b987-4681-a313-bb24e1a8fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:49.121658 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e4f3e8ac-6095-45ef-afb5-eb1b97bab9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:49.122151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428def-b987-4681-a313-bb24e1a8fa23 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:49.122433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428def-b987-4681-a313-bb24e1a8fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:49.122709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428def-b987-4681-a313-bb24e1a8fa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:49.123357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f428def-b987-4681-a313-bb24e1a8fa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:49.125117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f428def-b987-4681-a313-bb24e1a8fa23 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:49.142855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1019/2072] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:49.147479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f428def-b987-4681-a313-bb24e1a8fa23 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:49.160429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f428def-b987-4681-a313-bb24e1a8fa23 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:49.165852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36654789-05d8-471d-903b-b4d7a4ed4878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:49.167860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36654789-05d8-471d-903b-b4d7a4ed4878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:49.168244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36654789-05d8-471d-903b-b4d7a4ed4878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:49.168529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36654789-05d8-471d-903b-b4d7a4ed4878 admin admin] PATH_INFO: `/v3/projects/523eab75e6904cc8bf86148f997d896c/users/8e4e84914fc643689aa6516f3f24e66c/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:49.186921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3e8ac-6095-45ef-afb5-eb1b97bab9d1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:49.191245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36654789-05d8-471d-903b-b4d7a4ed4878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523eab75e6904cc8bf86148f997d896c, user_id=8e4e84914fc643689aa6516f3f24e66c, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:49.191714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6ac1d-b5b9-40a6-bea6-7b61cc7a9cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:49.192298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6ac1d-b5b9-40a6-bea6-7b61cc7a9cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:49.192625 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6ac1d-b5b9-40a6-bea6-7b61cc7a9cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:49.192930 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6ac1d-b5b9-40a6-bea6-7b61cc7a9cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:49.194246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36654789-05d8-471d-903b-b4d7a4ed4878 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:49.194927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-68d6ac1d-b5b9-40a6-bea6-7b61cc7a9cb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:49.208067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1020/2073] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:49 2022] PUT /identity/v3/projects/523eab75e6904cc8bf86148f997d896c/users/8e4e84914fc643689aa6516f3f24e66c/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:49.212659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956444e4-9fc3-4d1b-9987-7f5072cd2399 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:49.212949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956444e4-9fc3-4d1b-9987-7f5072cd2399 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:49.213233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956444e4-9fc3-4d1b-9987-7f5072cd2399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:49.233415 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-956444e4-9fc3-4d1b-9987-7f5072cd2399 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:49.234556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-956444e4-9fc3-4d1b-9987-7f5072cd2399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:49.259660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6ac1d-b5b9-40a6-bea6-7b61cc7a9cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:49.261789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6ac1d-b5b9-40a6-bea6-7b61cc7a9cb5 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:49.270782 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1054/2074] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:25:49.296479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1021/2075] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:49.306192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6ac1d-b5b9-40a6-bea6-7b61cc7a9cb5 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:49.307676 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-68d6ac1d-b5b9-40a6-bea6-7b61cc7a9cb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:49.367675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6ac1d-b5b9-40a6-bea6-7b61cc7a9cb5 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:49.420341 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7579efc-442f-4e8f-8ac7-4f7140e6379d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:49.421007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579efc-442f-4e8f-8ac7-4f7140e6379d service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:49.421290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579efc-442f-4e8f-8ac7-4f7140e6379d service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:49.421787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579efc-442f-4e8f-8ac7-4f7140e6379d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:49.434395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7579efc-442f-4e8f-8ac7-4f7140e6379d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:49.436262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7579efc-442f-4e8f-8ac7-4f7140e6379d service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:49.442031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:49.448665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1055/2076] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:50.493247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2a131-493d-4e89-bc40-01e91d5283ff None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:50.493733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2a131-493d-4e89-bc40-01e91d5283ff None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:50.493852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2a131-493d-4e89-bc40-01e91d5283ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:50.521904 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-dfb2a131-493d-4e89-bc40-01e91d5283ff None None] MFA Rules not processed for user `8e4e84914fc643689aa6516f3f24e66c`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:50.523214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dfb2a131-493d-4e89-bc40-01e91d5283ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:50.529081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:50.592757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1022/2077] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:50.603617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7579efc-442f-4e8f-8ac7-4f7140e6379d service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:50.676191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7579efc-442f-4e8f-8ac7-4f7140e6379d service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:50.680393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddefed-6234-4e57-9a4b-cba08c43d830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:50.680928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddefed-6234-4e57-9a4b-cba08c43d830 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:50.681201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddefed-6234-4e57-9a4b-cba08c43d830 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:50.681518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddefed-6234-4e57-9a4b-cba08c43d830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:50.690619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddefed-6234-4e57-9a4b-cba08c43d830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:50.692078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddefed-6234-4e57-9a4b-cba08c43d830 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:50.703135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1056/2078] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:52.917799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2a131-493d-4e89-bc40-01e91d5283ff None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:52.929051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2a131-493d-4e89-bc40-01e91d5283ff None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:52.933863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:52.934556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:52.934906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:52.935250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] PATH_INFO: `/v3/users/72571b0f369f4f5e8fb1ec03ac98072a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:52.936532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] RBAC: Authorizing `identity:delete_user(user_id=72571b0f369f4f5e8fb1ec03ac98072a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:52.938525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:52.988049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72571b0f369f4f5e8fb1ec03ac98072a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:52.995760 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72571b0f369f4f5e8fb1ec03ac98072a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:52.996418 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72571b0f369f4f5e8fb1ec03ac98072a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:52.997028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72571b0f369f4f5e8fb1ec03ac98072a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:53.004264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72571b0f369f4f5e8fb1ec03ac98072a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:53.022139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1023/2079] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:52 2022] DELETE /identity/v3/users/72571b0f369f4f5e8fb1ec03ac98072a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:53.026932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbaf45-47c4-46c3-a1ca-dec30a5abc59 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:53.027433 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbaf45-47c4-46c3-a1ca-dec30a5abc59 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:53.027621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbaf45-47c4-46c3-a1ca-dec30a5abc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:53.047237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0adbaf45-47c4-46c3-a1ca-dec30a5abc59 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:53.048543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0adbaf45-47c4-46c3-a1ca-dec30a5abc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:53.118204 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1057/2080] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:53.131828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:53.134113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:53.176118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca005a-de56-4f71-8610-52b6e5c35d49 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:53.176587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca005a-de56-4f71-8610-52b6e5c35d49 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:53.177295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca005a-de56-4f71-8610-52b6e5c35d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:53.202032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a5ca005a-de56-4f71-8610-52b6e5c35d49 None None] MFA Rules not processed for user `8e4e84914fc643689aa6516f3f24e66c`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:53.204171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a5ca005a-de56-4f71-8610-52b6e5c35d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:53.237722 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507618b-2b8e-4116-9bc3-0df8f913839b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:53.243496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41279f-87c2-4f47-960b-3678d448407a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:53.244148 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41279f-87c2-4f47-960b-3678d448407a service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:53.244963 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41279f-87c2-4f47-960b-3678d448407a service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:53.245236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41279f-87c2-4f47-960b-3678d448407a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:53.257102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41279f-87c2-4f47-960b-3678d448407a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:53.258638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41279f-87c2-4f47-960b-3678d448407a service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:53.270408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1024/2081] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:25:53.301286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1058/2082] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:53.809375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41279f-87c2-4f47-960b-3678d448407a service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:53.810967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ee41279f-87c2-4f47-960b-3678d448407a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:53.833651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41279f-87c2-4f47-960b-3678d448407a service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:53.842658 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:53.843306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:53.843585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:53.843861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] PATH_INFO: `/v3/projects/e64175b395be44af9640e2c4b21ae357` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:53.845386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64175b395be44af9640e2c4b21ae357)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:53.847422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:53.872163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:53.939821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64175b395be44af9640e2c4b21ae357', 'request_id': 'req-5134fe1d-ee2d-468d-8058-d019bf572db8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:53.947155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64175b395be44af9640e2c4b21ae357', 'request_id': 'req-5134fe1d-ee2d-468d-8058-d019bf572db8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:53.960590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64175b395be44af9640e2c4b21ae357', 'request_id': 'req-5134fe1d-ee2d-468d-8058-d019bf572db8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:53.980587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] The token cache is being invalidate because project e64175b395be44af9640e2c4b21ae357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:53.980888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:53.981570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:53.983440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1025/2083] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:53 2022] DELETE /identity/v3/projects/e64175b395be44af9640e2c4b21ae357 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:53.987304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca005a-de56-4f71-8610-52b6e5c35d49 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:54.000612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca005a-de56-4f71-8610-52b6e5c35d49 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:54.055978 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:54.074022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf021b3-c0c3-4151-a7a0-b22bced1e505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:54.074666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf021b3-c0c3-4151-a7a0-b22bced1e505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:54.074948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf021b3-c0c3-4151-a7a0-b22bced1e505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:54.075227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf021b3-c0c3-4151-a7a0-b22bced1e505 admin admin] PATH_INFO: `/v3/users/52c0bab224314cdcb609ce5187a63041` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:54.076448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf021b3-c0c3-4151-a7a0-b22bced1e505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c0bab224314cdcb609ce5187a63041)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:54.078403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf021b3-c0c3-4151-a7a0-b22bced1e505 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:54.137597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fbf021b3-c0c3-4151-a7a0-b22bced1e505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c0bab224314cdcb609ce5187a63041'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:54.145276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fbf021b3-c0c3-4151-a7a0-b22bced1e505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c0bab224314cdcb609ce5187a63041'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:54.145905 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fbf021b3-c0c3-4151-a7a0-b22bced1e505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c0bab224314cdcb609ce5187a63041'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:54.146512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fbf021b3-c0c3-4151-a7a0-b22bced1e505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c0bab224314cdcb609ce5187a63041'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:54.159986 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fbf021b3-c0c3-4151-a7a0-b22bced1e505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c0bab224314cdcb609ce5187a63041'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:54.172526 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1059/2084] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:25:53 2022] DELETE /identity/v3/users/52c0bab224314cdcb609ce5187a63041 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:54.490392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:54.492069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:54.514598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134fe1d-ee2d-468d-8058-d019bf572db8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:54.583009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:54.583646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:54.584017 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:54.584222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] PATH_INFO: `/v3/projects/5608dcd879b6478aa16905cb85c0cde3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:54.585540 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5608dcd879b6478aa16905cb85c0cde3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:54.588061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:54.640316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5608dcd879b6478aa16905cb85c0cde3', 'request_id': 'req-c88bfb89-5664-4547-a485-d597c76ee7cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:54.647323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5608dcd879b6478aa16905cb85c0cde3', 'request_id': 'req-c88bfb89-5664-4547-a485-d597c76ee7cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:54.654736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5608dcd879b6478aa16905cb85c0cde3', 'request_id': 'req-c88bfb89-5664-4547-a485-d597c76ee7cb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:54.665404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] The token cache is being invalidate because project 5608dcd879b6478aa16905cb85c0cde3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:25:54.665712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:54.666970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c88bfb89-5664-4547-a485-d597c76ee7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:25:54.668562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1026/2085] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:25:54 2022] DELETE /identity/v3/projects/5608dcd879b6478aa16905cb85c0cde3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:54.673541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce275a-416b-4ab2-8ead-e8fd06b28555 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:54.673863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce275a-416b-4ab2-8ead-e8fd06b28555 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:54.674104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce275a-416b-4ab2-8ead-e8fd06b28555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:54.695150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d4ce275a-416b-4ab2-8ead-e8fd06b28555 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:54.696465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d4ce275a-416b-4ab2-8ead-e8fd06b28555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:54.757220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1060/2086] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:54.765822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbee8c1-9172-4e47-a9ae-126714eb8e1d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:54.766210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbee8c1-9172-4e47-a9ae-126714eb8e1d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:54.766500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbee8c1-9172-4e47-a9ae-126714eb8e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:54.786870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ecbee8c1-9172-4e47-a9ae-126714eb8e1d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:54.788243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ecbee8c1-9172-4e47-a9ae-126714eb8e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:54.796584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1027/2087] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:25:54.801305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce275a-416b-4ab2-8ead-e8fd06b28555 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:54.811578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce275a-416b-4ab2-8ead-e8fd06b28555 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:54.816448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95aff5-65c6-4180-b4af-c55996a9cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:54.817051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95aff5-65c6-4180-b4af-c55996a9cff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:54.817332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95aff5-65c6-4180-b4af-c55996a9cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:54.817608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95aff5-65c6-4180-b4af-c55996a9cff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:54.818255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95aff5-65c6-4180-b4af-c55996a9cff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:25:54.818555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95aff5-65c6-4180-b4af-c55996a9cff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:54.820180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95aff5-65c6-4180-b4af-c55996a9cff6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:54.835205 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1061/2088] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:25:54.838114 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbee8c1-9172-4e47-a9ae-126714eb8e1d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:54.848519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbee8c1-9172-4e47-a9ae-126714eb8e1d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:54.856844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62375b69-1079-450d-b818-573b133b037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:54.858462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62375b69-1079-450d-b818-573b133b037b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:54.858958 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62375b69-1079-450d-b818-573b133b037b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:54.859313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62375b69-1079-450d-b818-573b133b037b admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:54.859987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62375b69-1079-450d-b818-573b133b037b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:54.861934 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62375b69-1079-450d-b818-573b133b037b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:54.896723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1028/2089] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:54 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:54.898306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95aff5-65c6-4180-b4af-c55996a9cff6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:54.909368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95aff5-65c6-4180-b4af-c55996a9cff6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:54.959598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:54.968103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5fb0c-5537-41ae-9735-481aa6e5558b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:54.969112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5fb0c-5537-41ae-9735-481aa6e5558b admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:54.969644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5fb0c-5537-41ae-9735-481aa6e5558b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:54.969927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5fb0c-5537-41ae-9735-481aa6e5558b admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:54.970759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5fb0c-5537-41ae-9735-481aa6e5558b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:54.972868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5fb0c-5537-41ae-9735-481aa6e5558b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:54.998118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1062/2090] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:54 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:54.999439 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62375b69-1079-450d-b818-573b133b037b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.006816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:55.011606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62375b69-1079-450d-b818-573b133b037b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.017443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7c1a2-692a-4fb9-8d77-f3b32bdfd666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.018035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7c1a2-692a-4fb9-8d77-f3b32bdfd666 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.018355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7c1a2-692a-4fb9-8d77-f3b32bdfd666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.019054 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7c1a2-692a-4fb9-8d77-f3b32bdfd666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.020233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7c1a2-692a-4fb9-8d77-f3b32bdfd666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.022192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7c1a2-692a-4fb9-8d77-f3b32bdfd666 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.033191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1029/2091] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:55.036777 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5fb0c-5537-41ae-9735-481aa6e5558b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.047062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5fb0c-5537-41ae-9735-481aa6e5558b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.051713 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd4aa-f960-4ff1-b0b2-61c8018dc8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.052334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd4aa-f960-4ff1-b0b2-61c8018dc8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.052610 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd4aa-f960-4ff1-b0b2-61c8018dc8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.052884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd4aa-f960-4ff1-b0b2-61c8018dc8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.053516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cd4aa-f960-4ff1-b0b2-61c8018dc8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.055103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cd4aa-f960-4ff1-b0b2-61c8018dc8e3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.066101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1063/2092] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:55.070130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7c1a2-692a-4fb9-8d77-f3b32bdfd666 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.080171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7c1a2-692a-4fb9-8d77-f3b32bdfd666 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.084792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e9c5-58d6-4f55-9ab1-d9151c270cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.085422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e9c5-58d6-4f55-9ab1-d9151c270cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.085702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e9c5-58d6-4f55-9ab1-d9151c270cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.085977 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e9c5-58d6-4f55-9ab1-d9151c270cb3 admin admin] PATH_INFO: `/v3/projects/e09116bfd50040a085f8a79a67d7b1bb/users/0542e1517c1b491c81a65dbc25821729/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.101438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737e9c5-58d6-4f55-9ab1-d9151c270cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09116bfd50040a085f8a79a67d7b1bb, user_id=0542e1517c1b491c81a65dbc25821729, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.104965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737e9c5-58d6-4f55-9ab1-d9151c270cb3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.119338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1030/2093] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:55 2022] PUT /identity/v3/projects/e09116bfd50040a085f8a79a67d7b1bb/users/0542e1517c1b491c81a65dbc25821729/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:55.129212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0527df-5d63-4e9f-bdda-8ce8abc17093 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.129509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0527df-5d63-4e9f-bdda-8ce8abc17093 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.129806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0527df-5d63-4e9f-bdda-8ce8abc17093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.159496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7a0527df-5d63-4e9f-bdda-8ce8abc17093 None None] MFA Rules not processed for user `0542e1517c1b491c81a65dbc25821729`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:55.160727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7a0527df-5d63-4e9f-bdda-8ce8abc17093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:55.228323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1064/2094] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:55.232974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e9c5-58d6-4f55-9ab1-d9151c270cb3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.299982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e9c5-58d6-4f55-9ab1-d9151c270cb3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.304691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc7d60-903d-4127-aa30-7eb9f2d8030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.305286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7d60-903d-4127-aa30-7eb9f2d8030f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.305557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7d60-903d-4127-aa30-7eb9f2d8030f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.307357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7d60-903d-4127-aa30-7eb9f2d8030f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.307357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc7d60-903d-4127-aa30-7eb9f2d8030f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.308442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc7d60-903d-4127-aa30-7eb9f2d8030f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.346733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1031/2095] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:55 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:55.348741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0527df-5d63-4e9f-bdda-8ce8abc17093 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.360911 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0527df-5d63-4e9f-bdda-8ce8abc17093 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.423532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7233-3c1b-4f4a-ba7f-2289257f5c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.424312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7233-3c1b-4f4a-ba7f-2289257f5c14 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.424686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7233-3c1b-4f4a-ba7f-2289257f5c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.425056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7233-3c1b-4f4a-ba7f-2289257f5c14 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.425937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb7233-3c1b-4f4a-ba7f-2289257f5c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.429226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb7233-3c1b-4f4a-ba7f-2289257f5c14 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.455074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1065/2096] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:55 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:55.459403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc7d60-903d-4127-aa30-7eb9f2d8030f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.471370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc7d60-903d-4127-aa30-7eb9f2d8030f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.476112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20805346-26dc-4e33-9eaf-f0bcd938ecfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.476714 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20805346-26dc-4e33-9eaf-f0bcd938ecfe admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.476988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20805346-26dc-4e33-9eaf-f0bcd938ecfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.477636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20805346-26dc-4e33-9eaf-f0bcd938ecfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.478152 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20805346-26dc-4e33-9eaf-f0bcd938ecfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.480396 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20805346-26dc-4e33-9eaf-f0bcd938ecfe admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.492483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1032/2097] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:25:55.499811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7233-3c1b-4f4a-ba7f-2289257f5c14 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.510246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7233-3c1b-4f4a-ba7f-2289257f5c14 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.515007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb48ce6-ac28-4296-b313-9add23aae560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.515596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb48ce6-ac28-4296-b313-9add23aae560 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.515875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb48ce6-ac28-4296-b313-9add23aae560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.516179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb48ce6-ac28-4296-b313-9add23aae560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.516813 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb48ce6-ac28-4296-b313-9add23aae560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.518404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb48ce6-ac28-4296-b313-9add23aae560 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.529115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1066/2098] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:55.533298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20805346-26dc-4e33-9eaf-f0bcd938ecfe admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.544041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20805346-26dc-4e33-9eaf-f0bcd938ecfe admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.548825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d02d6-0ae6-4425-b829-6a75a6f97c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.549460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d02d6-0ae6-4425-b829-6a75a6f97c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.549735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d02d6-0ae6-4425-b829-6a75a6f97c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.550029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d02d6-0ae6-4425-b829-6a75a6f97c5d admin admin] PATH_INFO: `/v3/projects/9995c6c1461e43d0b37641757b64c38e/users/2c8cccbaf7234215b3ba671609e52aac/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.564857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d02d6-0ae6-4425-b829-6a75a6f97c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9995c6c1461e43d0b37641757b64c38e, user_id=2c8cccbaf7234215b3ba671609e52aac, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.567469 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d02d6-0ae6-4425-b829-6a75a6f97c5d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.580296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1033/2099] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:55 2022] PUT /identity/v3/projects/9995c6c1461e43d0b37641757b64c38e/users/2c8cccbaf7234215b3ba671609e52aac/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:55.591598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907cdae-5cb0-406e-b44a-d50526b4e917 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.591958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907cdae-5cb0-406e-b44a-d50526b4e917 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.592363 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907cdae-5cb0-406e-b44a-d50526b4e917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.621006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c907cdae-5cb0-406e-b44a-d50526b4e917 None None] MFA Rules not processed for user `2c8cccbaf7234215b3ba671609e52aac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:55.622211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c907cdae-5cb0-406e-b44a-d50526b4e917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:55.651539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:55.685775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1067/2100] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:55.690462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d02d6-0ae6-4425-b829-6a75a6f97c5d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.753812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d02d6-0ae6-4425-b829-6a75a6f97c5d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.758591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1149114-82a2-4980-a9bb-15d3540ceabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.759188 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1149114-82a2-4980-a9bb-15d3540ceabb admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.759468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1149114-82a2-4980-a9bb-15d3540ceabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.760405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1149114-82a2-4980-a9bb-15d3540ceabb admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.761186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1149114-82a2-4980-a9bb-15d3540ceabb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.763095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1149114-82a2-4980-a9bb-15d3540ceabb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.792326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1034/2101] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:25:55 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:25:55.796318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907cdae-5cb0-406e-b44a-d50526b4e917 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.808427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907cdae-5cb0-406e-b44a-d50526b4e917 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.871587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412066-131f-4420-affc-1d73a9851e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.872296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412066-131f-4420-affc-1d73a9851e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.872577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412066-131f-4420-affc-1d73a9851e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.872850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412066-131f-4420-affc-1d73a9851e37 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.873487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28412066-131f-4420-affc-1d73a9851e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.875399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28412066-131f-4420-affc-1d73a9851e37 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.896825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1068/2102] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:25:55 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:25:55.901140 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1149114-82a2-4980-a9bb-15d3540ceabb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.909816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:55.916490 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1149114-82a2-4980-a9bb-15d3540ceabb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.924214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe6be4-14a8-40fe-a474-98208ddec336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.924745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe6be4-14a8-40fe-a474-98208ddec336 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.925020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe6be4-14a8-40fe-a474-98208ddec336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.925294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe6be4-14a8-40fe-a474-98208ddec336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.925949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe6be4-14a8-40fe-a474-98208ddec336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.927537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe6be4-14a8-40fe-a474-98208ddec336 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.939164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1035/2103] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:55.943537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412066-131f-4420-affc-1d73a9851e37 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:55.954057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412066-131f-4420-affc-1d73a9851e37 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:55.958978 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97083b04-ccef-4541-9246-74c2a598ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:55.959719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97083b04-ccef-4541-9246-74c2a598ec26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:55.960166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97083b04-ccef-4541-9246-74c2a598ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:55.960498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97083b04-ccef-4541-9246-74c2a598ec26 admin admin] PATH_INFO: `/v3/projects/54310d5d3064417fba6e068b81e96571/users/f3ba0f207e714856889f5003802e00cd/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:55.976370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97083b04-ccef-4541-9246-74c2a598ec26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54310d5d3064417fba6e068b81e96571, user_id=f3ba0f207e714856889f5003802e00cd, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:55.980008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97083b04-ccef-4541-9246-74c2a598ec26 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:55.995547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1069/2104] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:55 2022] PUT /identity/v3/projects/54310d5d3064417fba6e068b81e96571/users/f3ba0f207e714856889f5003802e00cd/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:25:56.000669 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe6be4-14a8-40fe-a474-98208ddec336 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:56.013314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe6be4-14a8-40fe-a474-98208ddec336 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:56.078899 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e97e15-2bed-4d19-9b76-d154f6c78152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:56.079525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e97e15-2bed-4d19-9b76-d154f6c78152 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:56.079803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e97e15-2bed-4d19-9b76-d154f6c78152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:56.080111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e97e15-2bed-4d19-9b76-d154f6c78152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:56.080758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e97e15-2bed-4d19-9b76-d154f6c78152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:56.082349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e97e15-2bed-4d19-9b76-d154f6c78152 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:56.095959 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1036/2105] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:25:56.098633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97083b04-ccef-4541-9246-74c2a598ec26 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:56.111085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97083b04-ccef-4541-9246-74c2a598ec26 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:56.122320 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8877b5-b688-4a72-b7b3-71b9ed2afae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:56.123075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8877b5-b688-4a72-b7b3-71b9ed2afae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:56.123478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8877b5-b688-4a72-b7b3-71b9ed2afae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:56.123841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8877b5-b688-4a72-b7b3-71b9ed2afae3 admin admin] PATH_INFO: `/v3/projects/54310d5d3064417fba6e068b81e96571/users/f3ba0f207e714856889f5003802e00cd/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:56.126000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8877b5-b688-4a72-b7b3-71b9ed2afae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54310d5d3064417fba6e068b81e96571, user_id=f3ba0f207e714856889f5003802e00cd, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:56.128919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8877b5-b688-4a72-b7b3-71b9ed2afae3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:56.142679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1070/2106] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:25:56 2022] PUT /identity/v3/projects/54310d5d3064417fba6e068b81e96571/users/f3ba0f207e714856889f5003802e00cd/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:25:56.157119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d35c12-e892-4d29-a73c-0f407792b63e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:56.157529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d35c12-e892-4d29-a73c-0f407792b63e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:56.157906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d35c12-e892-4d29-a73c-0f407792b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:56.190291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-75d35c12-e892-4d29-a73c-0f407792b63e None None] MFA Rules not processed for user `f3ba0f207e714856889f5003802e00cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:25:56.191543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-75d35c12-e892-4d29-a73c-0f407792b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:56.280535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1037/2107] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:25:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:25:56.293253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8877b5-b688-4a72-b7b3-71b9ed2afae3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:56.295037 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8e8877b5-b688-4a72-b7b3-71b9ed2afae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:56.356865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8877b5-b688-4a72-b7b3-71b9ed2afae3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:56.360843 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5d44-31a2-4eaf-80cf-e115d117ca29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:56.361458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5d44-31a2-4eaf-80cf-e115d117ca29 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:56.361728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5d44-31a2-4eaf-80cf-e115d117ca29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:56.361999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5d44-31a2-4eaf-80cf-e115d117ca29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:56.411125 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:25:56.433709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe5d44-31a2-4eaf-80cf-e115d117ca29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:56.435692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe5d44-31a2-4eaf-80cf-e115d117ca29 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:56.444835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1071/2108] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:59.233934 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d35c12-e892-4d29-a73c-0f407792b63e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:59.235502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-75d35c12-e892-4d29-a73c-0f407792b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:59.250241 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d35c12-e892-4d29-a73c-0f407792b63e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:59.255244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917177-b62f-496b-a8be-83abfd14daa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:59.256195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917177-b62f-496b-a8be-83abfd14daa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:59.256664 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917177-b62f-496b-a8be-83abfd14daa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:59.257125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917177-b62f-496b-a8be-83abfd14daa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:59.267528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5d44-31a2-4eaf-80cf-e115d117ca29 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:25:59.278180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5d44-31a2-4eaf-80cf-e115d117ca29 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:25:59.284134 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e445e-6bb2-4c7c-9e9a-a68f161f8f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:25:59.285395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e445e-6bb2-4c7c-9e9a-a68f161f8f68 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:25:59.285904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e445e-6bb2-4c7c-9e9a-a68f161f8f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:25:59.286516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e445e-6bb2-4c7c-9e9a-a68f161f8f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:25:59.288800 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-da3e445e-6bb2-4c7c-9e9a-a68f161f8f68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:25:59.357633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d917177-b62f-496b-a8be-83abfd14daa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:59.360297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d917177-b62f-496b-a8be-83abfd14daa7 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:59.386757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1038/2109] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:25:59.416808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e445e-6bb2-4c7c-9e9a-a68f161f8f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:25:59.419220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e445e-6bb2-4c7c-9e9a-a68f161f8f68 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:25:59.442091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1072/2110] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:25:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:00.300792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917177-b62f-496b-a8be-83abfd14daa7 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:00.315761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917177-b62f-496b-a8be-83abfd14daa7 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:00.319568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042a79a-3246-4ae3-a5f9-20fe66f17c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:00.320264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a79a-3246-4ae3-a5f9-20fe66f17c87 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:00.320545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a79a-3246-4ae3-a5f9-20fe66f17c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:00.320824 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a79a-3246-4ae3-a5f9-20fe66f17c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:00.341924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042a79a-3246-4ae3-a5f9-20fe66f17c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:00.344323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042a79a-3246-4ae3-a5f9-20fe66f17c87 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:00.353294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:00.359198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1039/2111] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:03.214732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e445e-6bb2-4c7c-9e9a-a68f161f8f68 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:03.216796 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-da3e445e-6bb2-4c7c-9e9a-a68f161f8f68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:03.317118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e445e-6bb2-4c7c-9e9a-a68f161f8f68 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:03.327166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab8c6b-531a-4dbf-bfbf-559bd20a277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:03.327785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab8c6b-531a-4dbf-bfbf-559bd20a277f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:03.328234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab8c6b-531a-4dbf-bfbf-559bd20a277f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:03.328522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab8c6b-531a-4dbf-bfbf-559bd20a277f admin admin] PATH_INFO: `/v3/users/da02b9579a5640ed9c4c8aed9807052c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:03.329845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab8c6b-531a-4dbf-bfbf-559bd20a277f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da02b9579a5640ed9c4c8aed9807052c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:03.332053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab8c6b-531a-4dbf-bfbf-559bd20a277f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:03.393547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-07ab8c6b-531a-4dbf-bfbf-559bd20a277f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da02b9579a5640ed9c4c8aed9807052c'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:03.402806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-07ab8c6b-531a-4dbf-bfbf-559bd20a277f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da02b9579a5640ed9c4c8aed9807052c'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:03.403628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-07ab8c6b-531a-4dbf-bfbf-559bd20a277f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da02b9579a5640ed9c4c8aed9807052c'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:03.404354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-07ab8c6b-531a-4dbf-bfbf-559bd20a277f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da02b9579a5640ed9c4c8aed9807052c'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:03.417938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-07ab8c6b-531a-4dbf-bfbf-559bd20a277f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da02b9579a5640ed9c4c8aed9807052c'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:03.420257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:03.433653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1073/2112] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:03 2022] DELETE /identity/v3/users/da02b9579a5640ed9c4c8aed9807052c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:03.616856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042a79a-3246-4ae3-a5f9-20fe66f17c87 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:03.631085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042a79a-3246-4ae3-a5f9-20fe66f17c87 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:03.691584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:03.692273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:03.692556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:03.692833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] PATH_INFO: `/v3/projects/4a1f1d29a7384dd59cbd042c52b7d5db` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:03.693987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1f1d29a7384dd59cbd042c52b7d5db)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:03.696221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:03.743387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1f1d29a7384dd59cbd042c52b7d5db', 'request_id': 'req-c6cb5027-d72f-4304-a3d0-e545d8276dbe'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:03.750115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1f1d29a7384dd59cbd042c52b7d5db', 'request_id': 'req-c6cb5027-d72f-4304-a3d0-e545d8276dbe'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:03.757207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1f1d29a7384dd59cbd042c52b7d5db', 'request_id': 'req-c6cb5027-d72f-4304-a3d0-e545d8276dbe'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:03.767685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] The token cache is being invalidate because project 4a1f1d29a7384dd59cbd042c52b7d5db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:03.768014 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:03.768648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-c6cb5027-d72f-4304-a3d0-e545d8276dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:03.770118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1040/2113] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:03 2022] DELETE /identity/v3/projects/4a1f1d29a7384dd59cbd042c52b7d5db => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:03.781863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851702f5-d95d-4f94-952c-959a8487a042 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:03.782113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851702f5-d95d-4f94-952c-959a8487a042 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:03.782393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851702f5-d95d-4f94-952c-959a8487a042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:03.803539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-851702f5-d95d-4f94-952c-959a8487a042 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:03.804835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-851702f5-d95d-4f94-952c-959a8487a042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:03.868409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1074/2114] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:03.876320 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f6fd-39c0-42dc-b53a-a0e6922f63e5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:03.876607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f6fd-39c0-42dc-b53a-a0e6922f63e5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:03.876885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f6fd-39c0-42dc-b53a-a0e6922f63e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:03.897473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5ee2f6fd-39c0-42dc-b53a-a0e6922f63e5 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:03.899037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5ee2f6fd-39c0-42dc-b53a-a0e6922f63e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:03.908161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1041/2115] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:03.912543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851702f5-d95d-4f94-952c-959a8487a042 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:03.923066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851702f5-d95d-4f94-952c-959a8487a042 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:03.927866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b530a5-285e-495e-a2c9-457619e46a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:03.928657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b530a5-285e-495e-a2c9-457619e46a13 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:03.929246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b530a5-285e-495e-a2c9-457619e46a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:03.929246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b530a5-285e-495e-a2c9-457619e46a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:03.930053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b530a5-285e-495e-a2c9-457619e46a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:03.930416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b530a5-285e-495e-a2c9-457619e46a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:03.932881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b530a5-285e-495e-a2c9-457619e46a13 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:03.948110 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1075/2116] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:26:03.949614 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2f6fd-39c0-42dc-b53a-a0e6922f63e5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:03.959024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2f6fd-39c0-42dc-b53a-a0e6922f63e5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:03.964431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda586c9-d27b-43de-beae-ab38030c93c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:03.965021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda586c9-d27b-43de-beae-ab38030c93c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:03.965298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda586c9-d27b-43de-beae-ab38030c93c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:03.965571 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda586c9-d27b-43de-beae-ab38030c93c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:03.966203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda586c9-d27b-43de-beae-ab38030c93c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:03.968157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda586c9-d27b-43de-beae-ab38030c93c9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:03.997000 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1042/2117] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:03 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:26:04.001267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b530a5-285e-495e-a2c9-457619e46a13 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.011497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b530a5-285e-495e-a2c9-457619e46a13 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.067708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ec2d8-1eef-4171-9d51-f3999770b096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:04.068344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ec2d8-1eef-4171-9d51-f3999770b096 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.068620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ec2d8-1eef-4171-9d51-f3999770b096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.068887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ec2d8-1eef-4171-9d51-f3999770b096 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.069512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ec2d8-1eef-4171-9d51-f3999770b096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:04.071422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ec2d8-1eef-4171-9d51-f3999770b096 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:04.096508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1076/2118] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:04 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:04.100544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda586c9-d27b-43de-beae-ab38030c93c9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.111748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda586c9-d27b-43de-beae-ab38030c93c9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.116627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0a5d3-a90c-41b7-844c-da0b93389a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:04.117253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0a5d3-a90c-41b7-844c-da0b93389a23 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.117532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0a5d3-a90c-41b7-844c-da0b93389a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.117805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0a5d3-a90c-41b7-844c-da0b93389a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.118479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0a5d3-a90c-41b7-844c-da0b93389a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:04.120487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0a5d3-a90c-41b7-844c-da0b93389a23 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:04.130537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1043/2119] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:04.135058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ec2d8-1eef-4171-9d51-f3999770b096 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.145161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ec2d8-1eef-4171-9d51-f3999770b096 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.149962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab5e9c-d44c-44f6-90ad-90f1816451c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:04.150603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5e9c-d44c-44f6-90ad-90f1816451c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.150871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5e9c-d44c-44f6-90ad-90f1816451c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.151144 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5e9c-d44c-44f6-90ad-90f1816451c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.151788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab5e9c-d44c-44f6-90ad-90f1816451c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:04.153425 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab5e9c-d44c-44f6-90ad-90f1816451c3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:04.164774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1077/2120] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:04.169756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0a5d3-a90c-41b7-844c-da0b93389a23 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.179491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0a5d3-a90c-41b7-844c-da0b93389a23 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.185345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11c234-9da6-4e4c-8f1a-d77975a88099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:04.186016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c234-9da6-4e4c-8f1a-d77975a88099 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.186299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c234-9da6-4e4c-8f1a-d77975a88099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.186579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c234-9da6-4e4c-8f1a-d77975a88099 admin admin] PATH_INFO: `/v3/projects/2fb9d851ff9749b18616941d995106a5/users/c6f83dd10d9c477ebf1b8aa742f9dcc7/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.201561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11c234-9da6-4e4c-8f1a-d77975a88099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb9d851ff9749b18616941d995106a5, user_id=c6f83dd10d9c477ebf1b8aa742f9dcc7, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:04.204220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11c234-9da6-4e4c-8f1a-d77975a88099 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:04.218594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1044/2121] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:04 2022] PUT /identity/v3/projects/2fb9d851ff9749b18616941d995106a5/users/c6f83dd10d9c477ebf1b8aa742f9dcc7/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:04.231314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d7e8-5686-4486-b789-c1289a18cac5 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.231776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d7e8-5686-4486-b789-c1289a18cac5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.231868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d7e8-5686-4486-b789-c1289a18cac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.261660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5069d7e8-5686-4486-b789-c1289a18cac5 None None] MFA Rules not processed for user `c6f83dd10d9c477ebf1b8aa742f9dcc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:04.262878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5069d7e8-5686-4486-b789-c1289a18cac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:04.313545 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:04.338592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1078/2122] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:04.343189 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11c234-9da6-4e4c-8f1a-d77975a88099 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.398136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:04.443355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11c234-9da6-4e4c-8f1a-d77975a88099 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.449275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867bb9d-929e-41a0-8f60-de6829cb11a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:04.449924 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867bb9d-929e-41a0-8f60-de6829cb11a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.450199 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867bb9d-929e-41a0-8f60-de6829cb11a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.450475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867bb9d-929e-41a0-8f60-de6829cb11a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.451132 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867bb9d-929e-41a0-8f60-de6829cb11a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:04.453403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867bb9d-929e-41a0-8f60-de6829cb11a9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:04.484053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1045/2123] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:04 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:04.488340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069d7e8-5686-4486-b789-c1289a18cac5 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.502254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069d7e8-5686-4486-b789-c1289a18cac5 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.572514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867bb9d-929e-41a0-8f60-de6829cb11a9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.574474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4867bb9d-929e-41a0-8f60-de6829cb11a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:04.593503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351a6b5-638d-406c-8498-aaa17b7d4e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:04.594306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a6b5-638d-406c-8498-aaa17b7d4e99 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.594588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a6b5-638d-406c-8498-aaa17b7d4e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.594860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a6b5-638d-406c-8498-aaa17b7d4e99 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.595499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351a6b5-638d-406c-8498-aaa17b7d4e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:04.597533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351a6b5-638d-406c-8498-aaa17b7d4e99 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:04.628366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1079/2124] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:04 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:26:04.632295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351a6b5-638d-406c-8498-aaa17b7d4e99 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.644244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351a6b5-638d-406c-8498-aaa17b7d4e99 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.650608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb184b-a333-4ce3-b7a8-7a36cb8a164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:04.651481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb184b-a333-4ce3-b7a8-7a36cb8a164b admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.651934 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb184b-a333-4ce3-b7a8-7a36cb8a164b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.652355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb184b-a333-4ce3-b7a8-7a36cb8a164b admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.653191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb184b-a333-4ce3-b7a8-7a36cb8a164b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:04.656701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb184b-a333-4ce3-b7a8-7a36cb8a164b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:04.657672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867bb9d-929e-41a0-8f60-de6829cb11a9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.664208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefdb1a-dd70-49de-a0d1-7e821eaa7220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:04.664739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefdb1a-dd70-49de-a0d1-7e821eaa7220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.665171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefdb1a-dd70-49de-a0d1-7e821eaa7220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.665700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefdb1a-dd70-49de-a0d1-7e821eaa7220 admin admin] PATH_INFO: `/v3/users/0542e1517c1b491c81a65dbc25821729` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.666946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefdb1a-dd70-49de-a0d1-7e821eaa7220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0542e1517c1b491c81a65dbc25821729)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:04.669639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1080/2125] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:26:04.669802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefdb1a-dd70-49de-a0d1-7e821eaa7220 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:04.674180 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb184b-a333-4ce3-b7a8-7a36cb8a164b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.686316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb184b-a333-4ce3-b7a8-7a36cb8a164b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.691563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9c90e-8abb-4604-9193-8229be87b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:04.692250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9c90e-8abb-4604-9193-8229be87b1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.692526 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9c90e-8abb-4604-9193-8229be87b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.692848 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9c90e-8abb-4604-9193-8229be87b1bf admin admin] PATH_INFO: `/v3/projects/358a07239769499098a332bb11127343/users/872303ed72c54d54b949adc92d3c001a/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.711189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9c90e-8abb-4604-9193-8229be87b1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=358a07239769499098a332bb11127343, user_id=872303ed72c54d54b949adc92d3c001a, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:04.715134 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9c90e-8abb-4604-9193-8229be87b1bf admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:04.725884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ffefdb1a-dd70-49de-a0d1-7e821eaa7220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0542e1517c1b491c81a65dbc25821729'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:04.729374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1081/2126] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:04 2022] PUT /identity/v3/projects/358a07239769499098a332bb11127343/users/872303ed72c54d54b949adc92d3c001a/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:04.733264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9c90e-8abb-4604-9193-8229be87b1bf admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.737693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ffefdb1a-dd70-49de-a0d1-7e821eaa7220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0542e1517c1b491c81a65dbc25821729'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:04.738420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ffefdb1a-dd70-49de-a0d1-7e821eaa7220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0542e1517c1b491c81a65dbc25821729'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:04.739048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ffefdb1a-dd70-49de-a0d1-7e821eaa7220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0542e1517c1b491c81a65dbc25821729'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:04.747207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ffefdb1a-dd70-49de-a0d1-7e821eaa7220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0542e1517c1b491c81a65dbc25821729'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:04.767067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1046/2127] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:04 2022] DELETE /identity/v3/users/0542e1517c1b491c81a65dbc25821729 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:04.771454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fbc67-ca0e-4149-9302-6beed509c893 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.771733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fbc67-ca0e-4149-9302-6beed509c893 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.772031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fbc67-ca0e-4149-9302-6beed509c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.794221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-326fbc67-ca0e-4149-9302-6beed509c893 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:04.795493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-326fbc67-ca0e-4149-9302-6beed509c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:04.799519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9c90e-8abb-4604-9193-8229be87b1bf admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.821715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:04.856215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:04.867861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1047/2128] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:04.870065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b91b5-3eac-431d-b960-e0d5bfeb389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:04.870698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b91b5-3eac-431d-b960-e0d5bfeb389c admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.871038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b91b5-3eac-431d-b960-e0d5bfeb389c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.871314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b91b5-3eac-431d-b960-e0d5bfeb389c admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.871984 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b91b5-3eac-431d-b960-e0d5bfeb389c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:04.873608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b91b5-3eac-431d-b960-e0d5bfeb389c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:04.877922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fbc67-ca0e-4149-9302-6beed509c893 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.879414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-326fbc67-ca0e-4149-9302-6beed509c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:04.884727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1082/2129] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:26:04.888672 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b91b5-3eac-431d-b960-e0d5bfeb389c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:04.890541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5e8b91b5-3eac-431d-b960-e0d5bfeb389c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:04.904492 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b91b5-3eac-431d-b960-e0d5bfeb389c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.909422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6bb9e-4557-454c-b9fb-1e7ee93f71df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:04.910076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6bb9e-4557-454c-b9fb-1e7ee93f71df admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.910349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6bb9e-4557-454c-b9fb-1e7ee93f71df admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.910851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6bb9e-4557-454c-b9fb-1e7ee93f71df admin admin] PATH_INFO: `/v3/projects/358a07239769499098a332bb11127343/users/872303ed72c54d54b949adc92d3c001a/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.912660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6bb9e-4557-454c-b9fb-1e7ee93f71df admin admin] RBAC: Authorizing `identity:create_grant(project_id=358a07239769499098a332bb11127343, user_id=872303ed72c54d54b949adc92d3c001a, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:04.915328 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6bb9e-4557-454c-b9fb-1e7ee93f71df admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:04.925861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1083/2130] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:04 2022] PUT /identity/v3/projects/358a07239769499098a332bb11127343/users/872303ed72c54d54b949adc92d3c001a/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:04.937223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fbc67-ca0e-4149-9302-6beed509c893 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:04.937497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572d6e-098a-4a02-aa8e-433207d5ae79 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:04.937779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572d6e-098a-4a02-aa8e-433207d5ae79 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:04.938052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572d6e-098a-4a02-aa8e-433207d5ae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:04.969900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-08572d6e-098a-4a02-aa8e-433207d5ae79 None None] MFA Rules not processed for user `872303ed72c54d54b949adc92d3c001a`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:04.971192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-08572d6e-098a-4a02-aa8e-433207d5ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:05.009376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ebef1-7ba9-4354-90ea-b9705bb8f8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:05.010219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ebef1-7ba9-4354-90ea-b9705bb8f8bb service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:05.010385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ebef1-7ba9-4354-90ea-b9705bb8f8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:05.010541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ebef1-7ba9-4354-90ea-b9705bb8f8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:05.066317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1084/2131] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:05.080330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08572d6e-098a-4a02-aa8e-433207d5ae79 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:05.081806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-08572d6e-098a-4a02-aa8e-433207d5ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:05.086921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ebef1-7ba9-4354-90ea-b9705bb8f8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:05.088896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ebef1-7ba9-4354-90ea-b9705bb8f8bb service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:05.099388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1048/2132] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:26:05.159561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08572d6e-098a-4a02-aa8e-433207d5ae79 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:05.185689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5fb71-f1a3-4dc0-885c-514b725febd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:05.188081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5fb71-f1a3-4dc0-885c-514b725febd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:05.188081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5fb71-f1a3-4dc0-885c-514b725febd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:05.188081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5fb71-f1a3-4dc0-885c-514b725febd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:05.213052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5fb71-f1a3-4dc0-885c-514b725febd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:05.216734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5fb71-f1a3-4dc0-885c-514b725febd1 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:05.245878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1085/2133] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:05.655583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ebef1-7ba9-4354-90ea-b9705bb8f8bb service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:05.657274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f52ebef1-7ba9-4354-90ea-b9705bb8f8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:05.691175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ebef1-7ba9-4354-90ea-b9705bb8f8bb service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:05.719805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:05.720574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:05.721670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:05.721670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] PATH_INFO: `/v3/projects/e09116bfd50040a085f8a79a67d7b1bb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:05.722288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09116bfd50040a085f8a79a67d7b1bb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:05.724312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:05.773566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:05.793013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09116bfd50040a085f8a79a67d7b1bb', 'request_id': 'req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:05.801214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09116bfd50040a085f8a79a67d7b1bb', 'request_id': 'req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:05.810255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09116bfd50040a085f8a79a67d7b1bb', 'request_id': 'req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:05.840093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] The token cache is being invalidate because project e09116bfd50040a085f8a79a67d7b1bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:05.840694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:05.841494 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:05.843588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1049/2134] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:05 2022] DELETE /identity/v3/projects/e09116bfd50040a085f8a79a67d7b1bb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:05.847185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5fb71-f1a3-4dc0-885c-514b725febd1 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:05.866148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5fb71-f1a3-4dc0-885c-514b725febd1 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:05.896420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:05.897987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:05.935794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32562572-9850-43bb-92f0-c214a7cf5203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:05.936570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32562572-9850-43bb-92f0-c214a7cf5203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:05.936858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32562572-9850-43bb-92f0-c214a7cf5203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:05.937132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32562572-9850-43bb-92f0-c214a7cf5203 admin admin] PATH_INFO: `/v3/users/2c8cccbaf7234215b3ba671609e52aac` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:05.938271 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32562572-9850-43bb-92f0-c214a7cf5203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c8cccbaf7234215b3ba671609e52aac)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:05.940360 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32562572-9850-43bb-92f0-c214a7cf5203 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:05.942270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:05.997674 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa955c-b14e-4ce4-a4c0-a3cc9df52dae admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:06.004566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:06.005390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:06.006543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:06.006822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] PATH_INFO: `/v3/users/c6f83dd10d9c477ebf1b8aa742f9dcc7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:06.008764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f83dd10d9c477ebf1b8aa742f9dcc7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:06.011308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:06.032143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-32562572-9850-43bb-92f0-c214a7cf5203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c8cccbaf7234215b3ba671609e52aac'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.042533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-32562572-9850-43bb-92f0-c214a7cf5203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c8cccbaf7234215b3ba671609e52aac'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.043279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-32562572-9850-43bb-92f0-c214a7cf5203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c8cccbaf7234215b3ba671609e52aac'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.044568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-32562572-9850-43bb-92f0-c214a7cf5203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c8cccbaf7234215b3ba671609e52aac'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.063971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-32562572-9850-43bb-92f0-c214a7cf5203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c8cccbaf7234215b3ba671609e52aac'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.070719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f83dd10d9c477ebf1b8aa742f9dcc7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.082656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f83dd10d9c477ebf1b8aa742f9dcc7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.083457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f83dd10d9c477ebf1b8aa742f9dcc7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.084252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f83dd10d9c477ebf1b8aa742f9dcc7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.092956 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1086/2135] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:05 2022] DELETE /identity/v3/users/2c8cccbaf7234215b3ba671609e52aac => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:06.094828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f83dd10d9c477ebf1b8aa742f9dcc7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.117804 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1050/2136] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:05 2022] DELETE /identity/v3/users/c6f83dd10d9c477ebf1b8aa742f9dcc7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:06.123128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5d1d0-3f3b-4661-b640-db5f5f0bed1f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:06.123414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5d1d0-3f3b-4661-b640-db5f5f0bed1f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:06.123740 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5d1d0-3f3b-4661-b640-db5f5f0bed1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:06.145570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-66d5d1d0-3f3b-4661-b640-db5f5f0bed1f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:06.146958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-66d5d1d0-3f3b-4661-b640-db5f5f0bed1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:06.238974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1087/2137] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:06.255489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:06.257022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:06.334345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:06.357458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60ecc4-266b-4b4e-9649-766ceb4a207a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:06.363201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85281456-b00d-4e9a-bcb7-22f2aee9210f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:06.363974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85281456-b00d-4e9a-bcb7-22f2aee9210f service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:06.364416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85281456-b00d-4e9a-bcb7-22f2aee9210f service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:06.364974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85281456-b00d-4e9a-bcb7-22f2aee9210f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:06.379885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85281456-b00d-4e9a-bcb7-22f2aee9210f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:06.381630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85281456-b00d-4e9a-bcb7-22f2aee9210f service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:06.394676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1051/2138] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:06.560484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5d1d0-3f3b-4661-b640-db5f5f0bed1f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:06.562415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-66d5d1d0-3f3b-4661-b640-db5f5f0bed1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:06.576517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5d1d0-3f3b-4661-b640-db5f5f0bed1f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:06.588174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:06.594715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:06.595251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:06.595553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] PATH_INFO: `/v3/projects/9995c6c1461e43d0b37641757b64c38e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:06.596953 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9995c6c1461e43d0b37641757b64c38e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:06.598799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:06.675250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9995c6c1461e43d0b37641757b64c38e', 'request_id': 'req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.682253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9995c6c1461e43d0b37641757b64c38e', 'request_id': 'req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.690435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9995c6c1461e43d0b37641757b64c38e', 'request_id': 'req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.701924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] The token cache is being invalidate because project 9995c6c1461e43d0b37641757b64c38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:06.702214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.704281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.705861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1088/2139] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:06 2022] DELETE /identity/v3/projects/9995c6c1461e43d0b37641757b64c38e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:06.709955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85281456-b00d-4e9a-bcb7-22f2aee9210f service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:06.721481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85281456-b00d-4e9a-bcb7-22f2aee9210f service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:06.762446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:06.764260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:06.769761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:06.797098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:06.798160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:06.798654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:06.799472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] PATH_INFO: `/v3/users/f3ba0f207e714856889f5003802e00cd` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:06.801040 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ba0f207e714856889f5003802e00cd)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:06.803233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:06.855435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371d4f2-cc2d-4fff-b809-2acb8fa7423f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:06.860907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:06.861195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ba0f207e714856889f5003802e00cd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.861744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:06.862116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:06.862483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] PATH_INFO: `/v3/projects/2fb9d851ff9749b18616941d995106a5` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:06.865816 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb9d851ff9749b18616941d995106a5)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:06.868053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:06.870667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ba0f207e714856889f5003802e00cd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.872308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ba0f207e714856889f5003802e00cd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.873508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ba0f207e714856889f5003802e00cd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.885058 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ba0f207e714856889f5003802e00cd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.904283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1052/2140] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:06 2022] DELETE /identity/v3/users/f3ba0f207e714856889f5003802e00cd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:06.939203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb9d851ff9749b18616941d995106a5', 'request_id': 'req-d3af6aed-0736-4dfb-b27d-705ff089feae'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.947382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb9d851ff9749b18616941d995106a5', 'request_id': 'req-d3af6aed-0736-4dfb-b27d-705ff089feae'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.956887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb9d851ff9749b18616941d995106a5', 'request_id': 'req-d3af6aed-0736-4dfb-b27d-705ff089feae'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.972030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] The token cache is being invalidate because project 2fb9d851ff9749b18616941d995106a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:06.972325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.973009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:06.974682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1089/2141] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:06 2022] DELETE /identity/v3/projects/2fb9d851ff9749b18616941d995106a5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:06.980857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:06.982423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:07.076986 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9af8-6e8a-47c3-a84f-c526cb8e173b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:07.091164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:07.173485 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5225a-4ceb-4625-a8b2-bd6c2585a62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:07.174141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5225a-4ceb-4625-a8b2-bd6c2585a62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.174420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5225a-4ceb-4625-a8b2-bd6c2585a62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.174698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5225a-4ceb-4625-a8b2-bd6c2585a62b admin admin] PATH_INFO: `/v3/users/872303ed72c54d54b949adc92d3c001a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.176009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5225a-4ceb-4625-a8b2-bd6c2585a62b admin admin] RBAC: Authorizing `identity:delete_user(user_id=872303ed72c54d54b949adc92d3c001a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:07.177984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5225a-4ceb-4625-a8b2-bd6c2585a62b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:07.229419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:07.230703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a2a5225a-4ceb-4625-a8b2-bd6c2585a62b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872303ed72c54d54b949adc92d3c001a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.231061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:07.242381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a2a5225a-4ceb-4625-a8b2-bd6c2585a62b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872303ed72c54d54b949adc92d3c001a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.244223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a2a5225a-4ceb-4625-a8b2-bd6c2585a62b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872303ed72c54d54b949adc92d3c001a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.245145 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a2a5225a-4ceb-4625-a8b2-bd6c2585a62b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872303ed72c54d54b949adc92d3c001a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.249581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af6aed-0736-4dfb-b27d-705ff089feae admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:07.253134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a2a5225a-4ceb-4625-a8b2-bd6c2585a62b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872303ed72c54d54b949adc92d3c001a'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.255113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:07.255744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.256123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.256415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] PATH_INFO: `/v3/projects/54310d5d3064417fba6e068b81e96571` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.257682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54310d5d3064417fba6e068b81e96571)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:07.260543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:07.280920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1053/2142] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:06 2022] DELETE /identity/v3/users/872303ed72c54d54b949adc92d3c001a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:07.313096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54310d5d3064417fba6e068b81e96571', 'request_id': 'req-fda49947-2b55-4f36-87e3-dcac0e7f6848'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.319322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54310d5d3064417fba6e068b81e96571', 'request_id': 'req-fda49947-2b55-4f36-87e3-dcac0e7f6848'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.328172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54310d5d3064417fba6e068b81e96571', 'request_id': 'req-fda49947-2b55-4f36-87e3-dcac0e7f6848'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.340832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] The token cache is being invalidate because project 54310d5d3064417fba6e068b81e96571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:07.341121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.341794 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fda49947-2b55-4f36-87e3-dcac0e7f6848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.343973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1090/2143] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:07 2022] DELETE /identity/v3/projects/54310d5d3064417fba6e068b81e96571 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:07.348809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a8e39-8757-4ddd-9812-3a44d08cddb3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.348990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a8e39-8757-4ddd-9812-3a44d08cddb3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.349345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a8e39-8757-4ddd-9812-3a44d08cddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.371165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fd2a8e39-8757-4ddd-9812-3a44d08cddb3 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:07.372418 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fd2a8e39-8757-4ddd-9812-3a44d08cddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:07.451471 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1054/2144] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:07.459271 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a057c3-0dd0-499b-b190-8b2b7fce14fb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.459612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a057c3-0dd0-499b-b190-8b2b7fce14fb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.459959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a057c3-0dd0-499b-b190-8b2b7fce14fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.488372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f6a057c3-0dd0-499b-b190-8b2b7fce14fb None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:07.489619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f6a057c3-0dd0-499b-b190-8b2b7fce14fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:07.498788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1091/2145] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:07.503297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a8e39-8757-4ddd-9812-3a44d08cddb3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:07.514392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a8e39-8757-4ddd-9812-3a44d08cddb3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:07.519569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d21e32-8db8-4d39-9638-cbd67700181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:07.520833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d21e32-8db8-4d39-9638-cbd67700181c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.521260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d21e32-8db8-4d39-9638-cbd67700181c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.521711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d21e32-8db8-4d39-9638-cbd67700181c admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.522519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d21e32-8db8-4d39-9638-cbd67700181c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:07.522968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d21e32-8db8-4d39-9638-cbd67700181c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:07.525488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d21e32-8db8-4d39-9638-cbd67700181c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:07.539255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1055/2146] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:26:07.544831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a057c3-0dd0-499b-b190-8b2b7fce14fb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:07.557244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a057c3-0dd0-499b-b190-8b2b7fce14fb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:07.563353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6444b4-bc8f-4e33-9661-bde5a63dd0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:07.564898 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6444b4-bc8f-4e33-9661-bde5a63dd0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.565348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6444b4-bc8f-4e33-9661-bde5a63dd0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.565773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6444b4-bc8f-4e33-9661-bde5a63dd0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.566681 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6444b4-bc8f-4e33-9661-bde5a63dd0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:07.568878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6444b4-bc8f-4e33-9661-bde5a63dd0a1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:07.581193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:07.608211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1092/2147] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:07 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:26:07.612289 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d21e32-8db8-4d39-9638-cbd67700181c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:07.626114 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d21e32-8db8-4d39-9638-cbd67700181c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:07.641622 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:07.724551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446f2c4-bc72-4ed4-bb1d-913674559f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:07.725326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f2c4-bc72-4ed4-bb1d-913674559f4a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.725710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f2c4-bc72-4ed4-bb1d-913674559f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.726095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446f2c4-bc72-4ed4-bb1d-913674559f4a admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.727087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446f2c4-bc72-4ed4-bb1d-913674559f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:07.740232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446f2c4-bc72-4ed4-bb1d-913674559f4a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:07.755700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6444b4-bc8f-4e33-9661-bde5a63dd0a1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:07.757629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5b6444b4-bc8f-4e33-9661-bde5a63dd0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:07.771890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1056/2148] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:07 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:07.782743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6444b4-bc8f-4e33-9661-bde5a63dd0a1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:07.788754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:07.789556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.789841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.790171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] PATH_INFO: `/v3/projects/358a07239769499098a332bb11127343` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.792760 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=358a07239769499098a332bb11127343)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:07.795744 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:07.801153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446f2c4-bc72-4ed4-bb1d-913674559f4a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:07.819183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446f2c4-bc72-4ed4-bb1d-913674559f4a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:07.827176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230e59-83c3-4d59-8bd6-a752c7fcf235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:07.827798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230e59-83c3-4d59-8bd6-a752c7fcf235 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.828112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230e59-83c3-4d59-8bd6-a752c7fcf235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.828388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230e59-83c3-4d59-8bd6-a752c7fcf235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.829045 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27230e59-83c3-4d59-8bd6-a752c7fcf235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:07.830662 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27230e59-83c3-4d59-8bd6-a752c7fcf235 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:07.842819 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1057/2149] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:07.846592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230e59-83c3-4d59-8bd6-a752c7fcf235 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:07.861194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230e59-83c3-4d59-8bd6-a752c7fcf235 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:07.867964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eca43-99c5-4e4e-8142-f800bc6c87be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:07.869703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eca43-99c5-4e4e-8142-f800bc6c87be admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.870131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eca43-99c5-4e4e-8142-f800bc6c87be admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.870413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eca43-99c5-4e4e-8142-f800bc6c87be admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.871821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eca43-99c5-4e4e-8142-f800bc6c87be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:07.873612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eca43-99c5-4e4e-8142-f800bc6c87be admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:07.887955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1058/2150] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:26:07.890783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358a07239769499098a332bb11127343', 'request_id': 'req-e851113f-0c86-4530-ab20-2090302656cc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.891340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eca43-99c5-4e4e-8142-f800bc6c87be admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:07.899300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358a07239769499098a332bb11127343', 'request_id': 'req-e851113f-0c86-4530-ab20-2090302656cc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.906154 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eca43-99c5-4e4e-8142-f800bc6c87be admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:07.909778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358a07239769499098a332bb11127343', 'request_id': 'req-e851113f-0c86-4530-ab20-2090302656cc'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.922976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] The token cache is being invalidate because project 358a07239769499098a332bb11127343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:07.923266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.924118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e851113f-0c86-4530-ab20-2090302656cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:07.929314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1093/2151] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:07 2022] DELETE /identity/v3/projects/358a07239769499098a332bb11127343 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:07.930642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad925a-73d9-413b-b437-7cdc27b93877 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.931600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad925a-73d9-413b-b437-7cdc27b93877 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.932098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad925a-73d9-413b-b437-7cdc27b93877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.968932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8aad925a-73d9-413b-b437-7cdc27b93877 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:07.987477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8aad925a-73d9-413b-b437-7cdc27b93877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:07.987594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea36d9-89b1-480e-8a53-502530af880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:07.987594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea36d9-89b1-480e-8a53-502530af880c admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:07.987594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea36d9-89b1-480e-8a53-502530af880c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:07.987594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea36d9-89b1-480e-8a53-502530af880c admin admin] PATH_INFO: `/v3/projects/e6f49630255c4c469b653fc788d29ffa/users/1b1a871cb10a45a6bda0f00321e4ce82/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:07.995345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1094/2152] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:08.001531 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea36d9-89b1-480e-8a53-502530af880c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f49630255c4c469b653fc788d29ffa, user_id=1b1a871cb10a45a6bda0f00321e4ce82, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.002977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bdc4a-2825-46df-b414-9f922348b3d2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.003559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bdc4a-2825-46df-b414-9f922348b3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.004130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bdc4a-2825-46df-b414-9f922348b3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.004872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea36d9-89b1-480e-8a53-502530af880c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.023021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1059/2153] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:07 2022] PUT /identity/v3/projects/e6f49630255c4c469b653fc788d29ffa/users/1b1a871cb10a45a6bda0f00321e4ce82/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:08.034630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b011207-4d67-47a8-b001-41e2cf195f7c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.034918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b011207-4d67-47a8-b001-41e2cf195f7c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.035253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b011207-4d67-47a8-b001-41e2cf195f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.049211 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-740bdc4a-2825-46df-b414-9f922348b3d2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:08.050729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-740bdc4a-2825-46df-b414-9f922348b3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:08.067586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6b011207-4d67-47a8-b001-41e2cf195f7c None None] MFA Rules not processed for user `1b1a871cb10a45a6bda0f00321e4ce82`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:08.069021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6b011207-4d67-47a8-b001-41e2cf195f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:08.135493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1095/2154] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:08.139328 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bdc4a-2825-46df-b414-9f922348b3d2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:08.146670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:08.151847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bdc4a-2825-46df-b414-9f922348b3d2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:08.159048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3aa38-aae4-4dd5-8d7b-9d496584d296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:08.159713 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3aa38-aae4-4dd5-8d7b-9d496584d296 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.160033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3aa38-aae4-4dd5-8d7b-9d496584d296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.160410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3aa38-aae4-4dd5-8d7b-9d496584d296 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.160489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1060/2155] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:08.161256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3aa38-aae4-4dd5-8d7b-9d496584d296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:08.161986 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3aa38-aae4-4dd5-8d7b-9d496584d296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.163221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3aa38-aae4-4dd5-8d7b-9d496584d296 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.173837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b011207-4d67-47a8-b001-41e2cf195f7c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:08.175864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6b011207-4d67-47a8-b001-41e2cf195f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:08.183440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1096/2156] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:26:08.184463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3aa38-aae4-4dd5-8d7b-9d496584d296 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:08.196817 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3aa38-aae4-4dd5-8d7b-9d496584d296 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:08.206989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33aaf4-dc4a-4dcb-b468-45d7e853f227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:08.207828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33aaf4-dc4a-4dcb-b468-45d7e853f227 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.207828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33aaf4-dc4a-4dcb-b468-45d7e853f227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.208121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33aaf4-dc4a-4dcb-b468-45d7e853f227 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.208766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33aaf4-dc4a-4dcb-b468-45d7e853f227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.210646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33aaf4-dc4a-4dcb-b468-45d7e853f227 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.240743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1097/2157] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:08 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:26:08.245493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33aaf4-dc4a-4dcb-b468-45d7e853f227 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:08.250105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b011207-4d67-47a8-b001-41e2cf195f7c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:08.286109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:08.309292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3701434-f87d-4e89-8a56-dd40e5c1b477 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c498b5857f42f2ab84423f8f4ea11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:08.309905 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3701434-f87d-4e89-8a56-dd40e5c1b477 service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.310365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3701434-f87d-4e89-8a56-dd40e5c1b477 service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.310638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3701434-f87d-4e89-8a56-dd40e5c1b477 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.325698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33aaf4-dc4a-4dcb-b468-45d7e853f227 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:08.332306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f75637-c5f8-4c41-91ba-6136d9047035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:08.333101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f75637-c5f8-4c41-91ba-6136d9047035 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.333256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f75637-c5f8-4c41-91ba-6136d9047035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.333528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f75637-c5f8-4c41-91ba-6136d9047035 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.334153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f75637-c5f8-4c41-91ba-6136d9047035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.336115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f75637-c5f8-4c41-91ba-6136d9047035 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.362590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1098/2158] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:08 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:08.366945 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f75637-c5f8-4c41-91ba-6136d9047035 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:08.379634 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f75637-c5f8-4c41-91ba-6136d9047035 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:08.382840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3701434-f87d-4e89-8a56-dd40e5c1b477 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.385035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3701434-f87d-4e89-8a56-dd40e5c1b477 service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.386208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467d208-58f1-4d2e-a73e-512da51a6136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:08.386763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467d208-58f1-4d2e-a73e-512da51a6136 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.387125 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467d208-58f1-4d2e-a73e-512da51a6136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.387435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467d208-58f1-4d2e-a73e-512da51a6136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.388106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467d208-58f1-4d2e-a73e-512da51a6136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.390013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467d208-58f1-4d2e-a73e-512da51a6136 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.395366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1061/2159] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:26:08.403117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1099/2160] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:08.407477 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3701434-f87d-4e89-8a56-dd40e5c1b477 service glance] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:08.419287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3701434-f87d-4e89-8a56-dd40e5c1b477 service glance] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:08.425617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dd591-a94a-4bc0-b442-c5a19a2625ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:08.426651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dd591-a94a-4bc0-b442-c5a19a2625ca admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.426968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dd591-a94a-4bc0-b442-c5a19a2625ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.427210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dd591-a94a-4bc0-b442-c5a19a2625ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.427967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399dd591-a94a-4bc0-b442-c5a19a2625ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.430631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399dd591-a94a-4bc0-b442-c5a19a2625ca admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.442366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1062/2161] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:08.446879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467d208-58f1-4d2e-a73e-512da51a6136 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:08.459421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467d208-58f1-4d2e-a73e-512da51a6136 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:08.465109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e30f4-150a-4b18-a80c-7e8d280d96a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:08.465776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e30f4-150a-4b18-a80c-7e8d280d96a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.466056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e30f4-150a-4b18-a80c-7e8d280d96a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.466344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e30f4-150a-4b18-a80c-7e8d280d96a0 admin admin] PATH_INFO: `/v3/projects/b8eafbb324ca4f3386bf20b83df34747/users/36cb0448e18d4893a076b5932a8e1350/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.484415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e30f4-150a-4b18-a80c-7e8d280d96a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8eafbb324ca4f3386bf20b83df34747, user_id=36cb0448e18d4893a076b5932a8e1350, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.487080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e30f4-150a-4b18-a80c-7e8d280d96a0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.512203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1100/2162] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:08 2022] PUT /identity/v3/projects/b8eafbb324ca4f3386bf20b83df34747/users/36cb0448e18d4893a076b5932a8e1350/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:08.519262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386559-803e-4e5b-900f-7c2926349573 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.519797 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386559-803e-4e5b-900f-7c2926349573 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.520115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386559-803e-4e5b-900f-7c2926349573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.559758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-20386559-803e-4e5b-900f-7c2926349573 None None] MFA Rules not processed for user `36cb0448e18d4893a076b5932a8e1350`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:08.561033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-20386559-803e-4e5b-900f-7c2926349573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:08.615219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:08.639534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1063/2163] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:08.644104 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e30f4-150a-4b18-a80c-7e8d280d96a0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:08.707524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e30f4-150a-4b18-a80c-7e8d280d96a0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:08.713022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd404dd-461f-43e5-a161-0b4f97d077e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:08.713630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd404dd-461f-43e5-a161-0b4f97d077e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.713908 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd404dd-461f-43e5-a161-0b4f97d077e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.714185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd404dd-461f-43e5-a161-0b4f97d077e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.714937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd404dd-461f-43e5-a161-0b4f97d077e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.716887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd404dd-461f-43e5-a161-0b4f97d077e4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.744734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1101/2164] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:08 2022] POST /identity/v3/projects => generated 401 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:08.749048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20386559-803e-4e5b-900f-7c2926349573 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:08.762861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20386559-803e-4e5b-900f-7c2926349573 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:08.839968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f21f-2a40-4316-a5c1-350e070603c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:08.841663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f21f-2a40-4316-a5c1-350e070603c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.842169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f21f-2a40-4316-a5c1-350e070603c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.842591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f21f-2a40-4316-a5c1-350e070603c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.843431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36f21f-2a40-4316-a5c1-350e070603c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.845609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36f21f-2a40-4316-a5c1-350e070603c5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.878882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1064/2165] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:08 2022] POST /identity/v3/users => generated 307 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:08.882757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd404dd-461f-43e5-a161-0b4f97d077e4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:08.894984 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd404dd-461f-43e5-a161-0b4f97d077e4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:08.900717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32bbcc-0007-4c04-9cca-abc807ec1502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:08.901860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32bbcc-0007-4c04-9cca-abc807ec1502 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.902137 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32bbcc-0007-4c04-9cca-abc807ec1502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.903949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32bbcc-0007-4c04-9cca-abc807ec1502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.904621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32bbcc-0007-4c04-9cca-abc807ec1502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.906308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32bbcc-0007-4c04-9cca-abc807ec1502 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.919344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1102/2166] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:08.923364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f21f-2a40-4316-a5c1-350e070603c5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:08.935590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f21f-2a40-4316-a5c1-350e070603c5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:08.953269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44e2c5-45d6-4562-abac-f1176fb9f983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:08.954003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44e2c5-45d6-4562-abac-f1176fb9f983 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:08.954280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44e2c5-45d6-4562-abac-f1176fb9f983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:08.954554 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44e2c5-45d6-4562-abac-f1176fb9f983 admin admin] PATH_INFO: `/v3/projects/beeb93b9fbf5451792c377342551f1e8/users/435140522a4f4275abc7489a60bbde5c/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:08.974283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44e2c5-45d6-4562-abac-f1176fb9f983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beeb93b9fbf5451792c377342551f1e8, user_id=435140522a4f4275abc7489a60bbde5c, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:08.977266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44e2c5-45d6-4562-abac-f1176fb9f983 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:08.991678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1065/2167] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:08 2022] PUT /identity/v3/projects/beeb93b9fbf5451792c377342551f1e8/users/435140522a4f4275abc7489a60bbde5c/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:08.996470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32bbcc-0007-4c04-9cca-abc807ec1502 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:09.006335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32bbcc-0007-4c04-9cca-abc807ec1502 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:09.065030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:09.072951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22d635-bc24-4a24-8597-688726f6e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:09.073582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22d635-bc24-4a24-8597-688726f6e6ab admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:09.074098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22d635-bc24-4a24-8597-688726f6e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:09.074376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22d635-bc24-4a24-8597-688726f6e6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:09.075024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22d635-bc24-4a24-8597-688726f6e6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:09.076676 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22d635-bc24-4a24-8597-688726f6e6ab admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:09.087701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1103/2168] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:09.092006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44e2c5-45d6-4562-abac-f1176fb9f983 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:09.104316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44e2c5-45d6-4562-abac-f1176fb9f983 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:09.110478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1458fbc-742a-4743-a414-fc1dcd05776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:09.111272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1458fbc-742a-4743-a414-fc1dcd05776f admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:09.111605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1458fbc-742a-4743-a414-fc1dcd05776f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:09.111976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1458fbc-742a-4743-a414-fc1dcd05776f admin admin] PATH_INFO: `/v3/projects/beeb93b9fbf5451792c377342551f1e8/users/435140522a4f4275abc7489a60bbde5c/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:09.114596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1458fbc-742a-4743-a414-fc1dcd05776f admin admin] RBAC: Authorizing `identity:create_grant(project_id=beeb93b9fbf5451792c377342551f1e8, user_id=435140522a4f4275abc7489a60bbde5c, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:09.117364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1458fbc-742a-4743-a414-fc1dcd05776f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:09.126268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22d635-bc24-4a24-8597-688726f6e6ab admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:09.128664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7a22d635-bc24-4a24-8597-688726f6e6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:09.132538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1066/2169] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:09 2022] PUT /identity/v3/projects/beeb93b9fbf5451792c377342551f1e8/users/435140522a4f4275abc7489a60bbde5c/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:09.143868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a369a6a-e051-47c4-a121-2a8514568ce9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:09.144191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a369a6a-e051-47c4-a121-2a8514568ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:09.144591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a369a6a-e051-47c4-a121-2a8514568ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:09.151192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22d635-bc24-4a24-8597-688726f6e6ab admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:09.179923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6a369a6a-e051-47c4-a121-2a8514568ce9 None None] MFA Rules not processed for user `435140522a4f4275abc7489a60bbde5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:09.181409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6a369a6a-e051-47c4-a121-2a8514568ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:09.226235 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc85b6-6a2e-4129-baa0-dc36799ce231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:09.227285 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc85b6-6a2e-4129-baa0-dc36799ce231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:09.227638 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc85b6-6a2e-4129-baa0-dc36799ce231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:09.228378 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc85b6-6a2e-4129-baa0-dc36799ce231 admin admin] PATH_INFO: `/v3/users/381b817147ce4e30991b961a95578af0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:09.229538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc85b6-6a2e-4129-baa0-dc36799ce231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381b817147ce4e30991b961a95578af0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:09.231500 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc85b6-6a2e-4129-baa0-dc36799ce231 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:09.256926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1067/2170] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:09 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:09.270455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a369a6a-e051-47c4-a121-2a8514568ce9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:09.271867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6a369a6a-e051-47c4-a121-2a8514568ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:09.285673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-efdc85b6-6a2e-4129-baa0-dc36799ce231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381b817147ce4e30991b961a95578af0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:09.293313 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-efdc85b6-6a2e-4129-baa0-dc36799ce231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381b817147ce4e30991b961a95578af0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:09.293962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-efdc85b6-6a2e-4129-baa0-dc36799ce231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381b817147ce4e30991b961a95578af0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:09.294604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-efdc85b6-6a2e-4129-baa0-dc36799ce231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381b817147ce4e30991b961a95578af0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:09.304096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:09.312303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-efdc85b6-6a2e-4129-baa0-dc36799ce231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381b817147ce4e30991b961a95578af0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:09.327082 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1104/2171] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:09 2022] DELETE /identity/v3/users/381b817147ce4e30991b961a95578af0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:09.331680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391108a-685a-46e5-b95a-4ccc8533e1a1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:09.332044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391108a-685a-46e5-b95a-4ccc8533e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:09.332324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391108a-685a-46e5-b95a-4ccc8533e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:09.347433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a369a6a-e051-47c4-a121-2a8514568ce9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:09.351646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d391108a-685a-46e5-b95a-4ccc8533e1a1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:09.353900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d391108a-685a-46e5-b95a-4ccc8533e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:09.398635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21292b6-384b-4d90-a44b-06c3cf6c0279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:09.399278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21292b6-384b-4d90-a44b-06c3cf6c0279 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:09.399590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21292b6-384b-4d90-a44b-06c3cf6c0279 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:09.399865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21292b6-384b-4d90-a44b-06c3cf6c0279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:09.401851 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c21292b6-384b-4d90-a44b-06c3cf6c0279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:09.417291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1105/2172] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:09.427329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391108a-685a-46e5-b95a-4ccc8533e1a1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:09.428863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d391108a-685a-46e5-b95a-4ccc8533e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:09.448244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:09.472627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21292b6-384b-4d90-a44b-06c3cf6c0279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:09.474122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21292b6-384b-4d90-a44b-06c3cf6c0279 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:09.485228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1068/2173] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:09 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:26:09.500614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391108a-685a-46e5-b95a-4ccc8533e1a1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:09.504737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66270889-2311-46e3-84f6-996b0839af7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:09.505437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66270889-2311-46e3-84f6-996b0839af7a service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:09.505764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66270889-2311-46e3-84f6-996b0839af7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:09.506026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66270889-2311-46e3-84f6-996b0839af7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:09.516396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66270889-2311-46e3-84f6-996b0839af7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:09.517828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66270889-2311-46e3-84f6-996b0839af7a service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:09.528295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1106/2174] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:26:09.573102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21292b6-384b-4d90-a44b-06c3cf6c0279 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:09.574963 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c21292b6-384b-4d90-a44b-06c3cf6c0279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:09.593329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21292b6-384b-4d90-a44b-06c3cf6c0279 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:09.597507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ac5df-f545-4b12-967f-2fd1987ef9cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:09.598221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ac5df-f545-4b12-967f-2fd1987ef9cd service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:09.598570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ac5df-f545-4b12-967f-2fd1987ef9cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:09.599069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ac5df-f545-4b12-967f-2fd1987ef9cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:09.601327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-816ac5df-f545-4b12-967f-2fd1987ef9cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:09.695574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ac5df-f545-4b12-967f-2fd1987ef9cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:09.697775 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ac5df-f545-4b12-967f-2fd1987ef9cd service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:09.713064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1069/2175] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:09.846741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66270889-2311-46e3-84f6-996b0839af7a service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:09.848337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-66270889-2311-46e3-84f6-996b0839af7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:09.887603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66270889-2311-46e3-84f6-996b0839af7a service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:09.894551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:09.895101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:09.895393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:09.895655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] PATH_INFO: `/v3/projects/62c7ecbbc2b04fa1a1994301b5b7dbe5` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:09.896851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c7ecbbc2b04fa1a1994301b5b7dbe5)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:09.900625 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:09.960061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c7ecbbc2b04fa1a1994301b5b7dbe5', 'request_id': 'req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:09.968024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c7ecbbc2b04fa1a1994301b5b7dbe5', 'request_id': 'req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:09.979066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c7ecbbc2b04fa1a1994301b5b7dbe5', 'request_id': 'req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:10.000969 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] The token cache is being invalidate because project 62c7ecbbc2b04fa1a1994301b5b7dbe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:10.001263 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:10.002031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-65a894cb-52b6-4cdd-ab42-54bae6aba7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:10.003808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1107/2176] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:09 2022] DELETE /identity/v3/projects/62c7ecbbc2b04fa1a1994301b5b7dbe5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:10.008679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fd186-5302-4f14-82b3-5a0e13a75781 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:10.010465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fd186-5302-4f14-82b3-5a0e13a75781 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:10.010991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fd186-5302-4f14-82b3-5a0e13a75781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:10.035463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-595fd186-5302-4f14-82b3-5a0e13a75781 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:10.036719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-595fd186-5302-4f14-82b3-5a0e13a75781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:10.070330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:10.148579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1070/2177] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:10.148674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bfe55-8c0a-4b4b-992f-46012c42294d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:10.148674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bfe55-8c0a-4b4b-992f-46012c42294d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:10.148674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bfe55-8c0a-4b4b-992f-46012c42294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:10.174742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c82bfe55-8c0a-4b4b-992f-46012c42294d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:10.176164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c82bfe55-8c0a-4b4b-992f-46012c42294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:10.186686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1108/2178] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:10.190737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fd186-5302-4f14-82b3-5a0e13a75781 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:10.220044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fd186-5302-4f14-82b3-5a0e13a75781 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:10.227254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bb803-1348-42f2-8163-f44976f55db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:10.228292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bb803-1348-42f2-8163-f44976f55db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:10.228795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bb803-1348-42f2-8163-f44976f55db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:10.229185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bb803-1348-42f2-8163-f44976f55db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:10.229844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bb803-1348-42f2-8163-f44976f55db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:10.230150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bb803-1348-42f2-8163-f44976f55db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:10.231751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bb803-1348-42f2-8163-f44976f55db9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:10.245756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1071/2179] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:26:10.250321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bfe55-8c0a-4b4b-992f-46012c42294d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:10.260660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bfe55-8c0a-4b4b-992f-46012c42294d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:10.265613 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a2924-a016-4960-90b4-cd2314536fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:10.266216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2924-a016-4960-90b4-cd2314536fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:10.266501 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2924-a016-4960-90b4-cd2314536fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:10.266773 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a2924-a016-4960-90b4-cd2314536fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:10.267401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a2924-a016-4960-90b4-cd2314536fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:10.269328 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a2924-a016-4960-90b4-cd2314536fd6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:10.301832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1109/2180] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:10 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:10.303034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bb803-1348-42f2-8163-f44976f55db9 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:10.313974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bb803-1348-42f2-8163-f44976f55db9 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:10.383403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3c02c-baa0-4dd2-b631-17109650fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:10.384542 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3c02c-baa0-4dd2-b631-17109650fd6e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:10.384863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3c02c-baa0-4dd2-b631-17109650fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:10.385140 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3c02c-baa0-4dd2-b631-17109650fd6e admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:10.385839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3c02c-baa0-4dd2-b631-17109650fd6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:10.388669 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3c02c-baa0-4dd2-b631-17109650fd6e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:10.414195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1072/2181] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:10 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:10.419547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a2924-a016-4960-90b4-cd2314536fd6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:10.434586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a2924-a016-4960-90b4-cd2314536fd6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:10.440045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a117a-e194-4333-a11d-43b19f29e601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:10.440651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a117a-e194-4333-a11d-43b19f29e601 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:10.440928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a117a-e194-4333-a11d-43b19f29e601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:10.441619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a117a-e194-4333-a11d-43b19f29e601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:10.442263 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a117a-e194-4333-a11d-43b19f29e601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:10.444118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a117a-e194-4333-a11d-43b19f29e601 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:10.458994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1110/2182] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:10.464029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3c02c-baa0-4dd2-b631-17109650fd6e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:10.477500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3c02c-baa0-4dd2-b631-17109650fd6e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:10.483774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a4e03-c929-493a-a3a4-e218f166b76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:10.484523 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a4e03-c929-493a-a3a4-e218f166b76d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:10.484800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a4e03-c929-493a-a3a4-e218f166b76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:10.485073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a4e03-c929-493a-a3a4-e218f166b76d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:10.485711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a4e03-c929-493a-a3a4-e218f166b76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:10.487341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a4e03-c929-493a-a3a4-e218f166b76d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:10.499661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1073/2183] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:10.505119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a117a-e194-4333-a11d-43b19f29e601 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:10.517502 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a117a-e194-4333-a11d-43b19f29e601 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:10.522519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f6c4c-9d52-497b-911d-158bc986ee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:10.523641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6c4c-9d52-497b-911d-158bc986ee96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:10.524159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6c4c-9d52-497b-911d-158bc986ee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:10.525237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6c4c-9d52-497b-911d-158bc986ee96 admin admin] PATH_INFO: `/v3/projects/adf6f83a434b4adba022089163f05191/users/a8478d170eb04a6bb158c0aab6e6ea1c/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:10.543490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f6c4c-9d52-497b-911d-158bc986ee96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf6f83a434b4adba022089163f05191, user_id=a8478d170eb04a6bb158c0aab6e6ea1c, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:10.546357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f6c4c-9d52-497b-911d-158bc986ee96 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:10.560779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1111/2184] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:10 2022] PUT /identity/v3/projects/adf6f83a434b4adba022089163f05191/users/a8478d170eb04a6bb158c0aab6e6ea1c/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:10.571419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1b77f-a9f3-4d09-bdfc-604d17820d89 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:10.571825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1b77f-a9f3-4d09-bdfc-604d17820d89 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:10.572347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1b77f-a9f3-4d09-bdfc-604d17820d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:10.606241 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2da1b77f-a9f3-4d09-bdfc-604d17820d89 None None] MFA Rules not processed for user `a8478d170eb04a6bb158c0aab6e6ea1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:10.607473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2da1b77f-a9f3-4d09-bdfc-604d17820d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:10.682480 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1074/2185] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:10.694975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f6c4c-9d52-497b-911d-158bc986ee96 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:10.699131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dd9f6c4c-9d52-497b-911d-158bc986ee96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:10.747710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:10.768036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f6c4c-9d52-497b-911d-158bc986ee96 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:10.772133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f248f2-14cb-44b6-baf0-689191354ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:10.772762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f248f2-14cb-44b6-baf0-689191354ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:10.773038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f248f2-14cb-44b6-baf0-689191354ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:10.773305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f248f2-14cb-44b6-baf0-689191354ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:10.784739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f248f2-14cb-44b6-baf0-689191354ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:10.787587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f248f2-14cb-44b6-baf0-689191354ce4 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:10.799234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1112/2186] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:13.475664 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1b77f-a9f3-4d09-bdfc-604d17820d89 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:13.502763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:13.544644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1b77f-a9f3-4d09-bdfc-604d17820d89 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:13.549165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:13.549792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:13.550072 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:13.550347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] PATH_INFO: `/v3/users/a8478d170eb04a6bb158c0aab6e6ea1c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:13.551467 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8478d170eb04a6bb158c0aab6e6ea1c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:13.553428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:13.601845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8478d170eb04a6bb158c0aab6e6ea1c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:13.609540 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8478d170eb04a6bb158c0aab6e6ea1c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:13.610271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8478d170eb04a6bb158c0aab6e6ea1c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:13.610886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8478d170eb04a6bb158c0aab6e6ea1c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:13.620487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8478d170eb04a6bb158c0aab6e6ea1c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:13.638366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1075/2187] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:13 2022] DELETE /identity/v3/users/a8478d170eb04a6bb158c0aab6e6ea1c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:13.643091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2e71-fe95-415f-8aac-4ce0727ac22d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:13.643572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2e71-fe95-415f-8aac-4ce0727ac22d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:13.643694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2e71-fe95-415f-8aac-4ce0727ac22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:13.668606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-014b2e71-fe95-415f-8aac-4ce0727ac22d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:13.669854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-014b2e71-fe95-415f-8aac-4ce0727ac22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:13.736328 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1113/2188] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:13.746421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:13.748030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:13.814525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b3c4f-9b6c-4edb-a86b-7fd866801773 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:13.818204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06ad92-84e1-4520-bd6c-cc785a05d394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:13.818805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ad92-84e1-4520-bd6c-cc785a05d394 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:13.819085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ad92-84e1-4520-bd6c-cc785a05d394 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:13.819360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ad92-84e1-4520-bd6c-cc785a05d394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:13.835545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06ad92-84e1-4520-bd6c-cc785a05d394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:13.837724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06ad92-84e1-4520-bd6c-cc785a05d394 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:13.848379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1076/2189] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:14.233197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b2e71-fe95-415f-8aac-4ce0727ac22d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:14.234691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-014b2e71-fe95-415f-8aac-4ce0727ac22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:14.270096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b2e71-fe95-415f-8aac-4ce0727ac22d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:14.280046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:14.280703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:14.280981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:14.281303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] PATH_INFO: `/v3/users/36cb0448e18d4893a076b5932a8e1350` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:14.284458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36cb0448e18d4893a076b5932a8e1350)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:14.286483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:14.385105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36cb0448e18d4893a076b5932a8e1350'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:14.398732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36cb0448e18d4893a076b5932a8e1350'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:14.400215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36cb0448e18d4893a076b5932a8e1350'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:14.401049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36cb0448e18d4893a076b5932a8e1350'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:14.427564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36cb0448e18d4893a076b5932a8e1350'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:14.447199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1114/2190] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:14 2022] DELETE /identity/v3/users/36cb0448e18d4893a076b5932a8e1350 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:14.448751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6534-696a-4fff-ab7a-7306ef41c76e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:14.449591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6534-696a-4fff-ab7a-7306ef41c76e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:14.449970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6534-696a-4fff-ab7a-7306ef41c76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:14.474616 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d9ab6534-696a-4fff-ab7a-7306ef41c76e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:14.475936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d9ab6534-696a-4fff-ab7a-7306ef41c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:14.500085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:14.501946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:14.538610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:14.571834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1077/2191] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:14.586202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab6534-696a-4fff-ab7a-7306ef41c76e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:14.587274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:14.588126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d9ab6534-696a-4fff-ab7a-7306ef41c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:14.607971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ba517-2d7a-4c50-a183-e64c55f961d4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:14.621485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:14.622359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:14.622798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:14.623065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] PATH_INFO: `/v3/projects/adf6f83a434b4adba022089163f05191` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:14.624339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf6f83a434b4adba022089163f05191)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:14.626435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:14.686493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf6f83a434b4adba022089163f05191', 'request_id': 'req-46aa88c2-28fb-454e-9209-db99911c6206'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:14.693170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf6f83a434b4adba022089163f05191', 'request_id': 'req-46aa88c2-28fb-454e-9209-db99911c6206'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:14.698135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab6534-696a-4fff-ab7a-7306ef41c76e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:14.701641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf6f83a434b4adba022089163f05191', 'request_id': 'req-46aa88c2-28fb-454e-9209-db99911c6206'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:14.720244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] The token cache is being invalidate because project adf6f83a434b4adba022089163f05191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:14.720583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:14.721170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-46aa88c2-28fb-454e-9209-db99911c6206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:14.723932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1115/2192] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:14 2022] DELETE /identity/v3/projects/adf6f83a434b4adba022089163f05191 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:14.729448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c91430-6567-44e0-923b-471367221977 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:14.729748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c91430-6567-44e0-923b-471367221977 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:14.730035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c91430-6567-44e0-923b-471367221977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:14.749907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-53c91430-6567-44e0-923b-471367221977 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:14.751295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-53c91430-6567-44e0-923b-471367221977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:14.756644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9157c-005c-4cbc-bc09-0951b8c60a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:14.757867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9157c-005c-4cbc-bc09-0951b8c60a34 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:14.758134 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9157c-005c-4cbc-bc09-0951b8c60a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:14.758942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9157c-005c-4cbc-bc09-0951b8c60a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:14.760842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-78a9157c-005c-4cbc-bc09-0951b8c60a34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:14.823422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1116/2193] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:14.832801 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb315d26-a857-4ac0-bd56-733e23ce25fd None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:14.833221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb315d26-a857-4ac0-bd56-733e23ce25fd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:14.833614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb315d26-a857-4ac0-bd56-733e23ce25fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:14.849264 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9157c-005c-4cbc-bc09-0951b8c60a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:14.850785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9157c-005c-4cbc-bc09-0951b8c60a34 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:14.856040 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-eb315d26-a857-4ac0-bd56-733e23ce25fd None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:14.858326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-eb315d26-a857-4ac0-bd56-733e23ce25fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:14.861596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1078/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:14.875866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1117/2195] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:14.880768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9157c-005c-4cbc-bc09-0951b8c60a34 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:14.892202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9157c-005c-4cbc-bc09-0951b8c60a34 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:14.897137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd53c96-a1c2-46b6-be83-f0563df3dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:14.897738 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53c96-a1c2-46b6-be83-f0563df3dbea admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:14.898020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53c96-a1c2-46b6-be83-f0563df3dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:14.898297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd53c96-a1c2-46b6-be83-f0563df3dbea admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:14.900094 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd53c96-a1c2-46b6-be83-f0563df3dbea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:14.900439 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd53c96-a1c2-46b6-be83-f0563df3dbea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:14.902507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd53c96-a1c2-46b6-be83-f0563df3dbea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:14.918549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1079/2196] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:26:14.922506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb315d26-a857-4ac0-bd56-733e23ce25fd None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:14.932640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb315d26-a857-4ac0-bd56-733e23ce25fd None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:14.939174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49a5dd-e029-4a50-aa73-99b4f85b6185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:14.939930 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49a5dd-e029-4a50-aa73-99b4f85b6185 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:14.940316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49a5dd-e029-4a50-aa73-99b4f85b6185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:14.940635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49a5dd-e029-4a50-aa73-99b4f85b6185 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:14.941290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49a5dd-e029-4a50-aa73-99b4f85b6185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:14.943307 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49a5dd-e029-4a50-aa73-99b4f85b6185 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:14.976325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1118/2197] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:14 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:26:14.980844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd53c96-a1c2-46b6-be83-f0563df3dbea admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:14.995873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd53c96-a1c2-46b6-be83-f0563df3dbea admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:15.069361 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:15.117525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa07df1-f874-4137-b53f-48e23cd0ecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:15.118194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa07df1-f874-4137-b53f-48e23cd0ecb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:15.118491 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa07df1-f874-4137-b53f-48e23cd0ecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:15.118741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa07df1-f874-4137-b53f-48e23cd0ecb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:15.119744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa07df1-f874-4137-b53f-48e23cd0ecb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:15.121829 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa07df1-f874-4137-b53f-48e23cd0ecb1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:15.147834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1080/2198] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:14 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:15.154872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49a5dd-e029-4a50-aa73-99b4f85b6185 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:15.168489 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49a5dd-e029-4a50-aa73-99b4f85b6185 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:15.173636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617ec72-dc38-4eb8-a893-a2d300f21474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:15.174275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617ec72-dc38-4eb8-a893-a2d300f21474 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:15.174560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617ec72-dc38-4eb8-a893-a2d300f21474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:15.174830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617ec72-dc38-4eb8-a893-a2d300f21474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:15.175499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617ec72-dc38-4eb8-a893-a2d300f21474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:15.177364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617ec72-dc38-4eb8-a893-a2d300f21474 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:15.191878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1119/2199] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:15.200307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa07df1-f874-4137-b53f-48e23cd0ecb1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:15.210250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa07df1-f874-4137-b53f-48e23cd0ecb1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:15.215615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bbe4f-1e0f-4c05-8d6d-5d8bddbaa44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:15.216256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bbe4f-1e0f-4c05-8d6d-5d8bddbaa44c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:15.216541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bbe4f-1e0f-4c05-8d6d-5d8bddbaa44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:15.216816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bbe4f-1e0f-4c05-8d6d-5d8bddbaa44c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:15.217567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bbe4f-1e0f-4c05-8d6d-5d8bddbaa44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:15.219293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bbe4f-1e0f-4c05-8d6d-5d8bddbaa44c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:15.231385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1081/2200] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:15.238123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bbe4f-1e0f-4c05-8d6d-5d8bddbaa44c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:15.238508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617ec72-dc38-4eb8-a893-a2d300f21474 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:15.246382 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c19bbe4f-1e0f-4c05-8d6d-5d8bddbaa44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:15.251292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617ec72-dc38-4eb8-a893-a2d300f21474 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:15.259791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c3869-dc5d-4d88-ab7d-2fa2ec04eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:15.260635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bbe4f-1e0f-4c05-8d6d-5d8bddbaa44c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:15.261339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c3869-dc5d-4d88-ab7d-2fa2ec04eb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:15.261720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c3869-dc5d-4d88-ab7d-2fa2ec04eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:15.261993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c3869-dc5d-4d88-ab7d-2fa2ec04eb26 admin admin] PATH_INFO: `/v3/projects/eebac51b53ec489a8319ca468d377c3a/users/e69057fbb55a467783154e6a4090e751/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:15.265884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:15.266595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:15.266875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:15.267837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] PATH_INFO: `/v3/projects/b8eafbb324ca4f3386bf20b83df34747` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:15.270274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8eafbb324ca4f3386bf20b83df34747)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:15.272251 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:15.286554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c3869-dc5d-4d88-ab7d-2fa2ec04eb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eebac51b53ec489a8319ca468d377c3a, user_id=e69057fbb55a467783154e6a4090e751, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:15.289392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c3869-dc5d-4d88-ab7d-2fa2ec04eb26 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:15.303297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1120/2201] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:15 2022] PUT /identity/v3/projects/eebac51b53ec489a8319ca468d377c3a/users/e69057fbb55a467783154e6a4090e751/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:15.315570 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689467a-59be-43b0-aefa-512dcdc7d7f4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:15.315866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689467a-59be-43b0-aefa-512dcdc7d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:15.316168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689467a-59be-43b0-aefa-512dcdc7d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:15.334984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8eafbb324ca4f3386bf20b83df34747', 'request_id': 'req-ab9dfe95-997d-4a5f-9f9b-abab49dee024'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:15.364340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8eafbb324ca4f3386bf20b83df34747', 'request_id': 'req-ab9dfe95-997d-4a5f-9f9b-abab49dee024'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:15.375846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8eafbb324ca4f3386bf20b83df34747', 'request_id': 'req-ab9dfe95-997d-4a5f-9f9b-abab49dee024'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:15.378966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1689467a-59be-43b0-aefa-512dcdc7d7f4 None None] MFA Rules not processed for user `e69057fbb55a467783154e6a4090e751`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:15.381100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1689467a-59be-43b0-aefa-512dcdc7d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:15.391815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:15.394505 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] The token cache is being invalidate because project b8eafbb324ca4f3386bf20b83df34747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:15.394690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:15.395800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:15.398338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1082/2202] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:15 2022] DELETE /identity/v3/projects/b8eafbb324ca4f3386bf20b83df34747 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:15.404811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:15.406468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:15.542176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dfe95-997d-4a5f-9f9b-abab49dee024 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:15.545581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1121/2203] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:15.548081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:15.548881 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:15.549160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:15.549484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] PATH_INFO: `/v3/users/435140522a4f4275abc7489a60bbde5c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:15.550612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435140522a4f4275abc7489a60bbde5c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:15.552733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:15.559660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689467a-59be-43b0-aefa-512dcdc7d7f4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:15.562266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1689467a-59be-43b0-aefa-512dcdc7d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:15.627222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:15.642378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435140522a4f4275abc7489a60bbde5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:15.656056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435140522a4f4275abc7489a60bbde5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:15.657755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435140522a4f4275abc7489a60bbde5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:15.664800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435140522a4f4275abc7489a60bbde5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:15.672404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689467a-59be-43b0-aefa-512dcdc7d7f4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:15.675589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435140522a4f4275abc7489a60bbde5c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:15.687948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435243f7-a81b-4b05-a64a-cf991352af21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:15.689764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435243f7-a81b-4b05-a64a-cf991352af21 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:15.691042 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435243f7-a81b-4b05-a64a-cf991352af21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:15.691930 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435243f7-a81b-4b05-a64a-cf991352af21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:15.695226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-435243f7-a81b-4b05-a64a-cf991352af21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:15.708872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1083/2204] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:15 2022] DELETE /identity/v3/users/435140522a4f4275abc7489a60bbde5c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:15.721284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435243f7-a81b-4b05-a64a-cf991352af21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:15.723316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435243f7-a81b-4b05-a64a-cf991352af21 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:15.752129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1122/2205] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:26:16.068654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:16.070493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:16.154559 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eeae5b-cdc5-47ee-9649-4928f1893414 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:16.159245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:16.159877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:16.160196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:16.160475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] PATH_INFO: `/v3/projects/beeb93b9fbf5451792c377342551f1e8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:16.161604 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=beeb93b9fbf5451792c377342551f1e8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:16.163514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:16.217053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beeb93b9fbf5451792c377342551f1e8', 'request_id': 'req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:16.223454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beeb93b9fbf5451792c377342551f1e8', 'request_id': 'req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:16.232831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beeb93b9fbf5451792c377342551f1e8', 'request_id': 'req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:16.244483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] The token cache is being invalidate because project beeb93b9fbf5451792c377342551f1e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:16.244771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:16.245422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e6bd78b2-7fd1-4e02-851b-e2480574b9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:16.247015 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1084/2206] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:16 2022] DELETE /identity/v3/projects/beeb93b9fbf5451792c377342551f1e8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:16.251804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094b6d-0992-4cde-be53-00ff308dbde8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:16.252128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094b6d-0992-4cde-be53-00ff308dbde8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:16.252408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce094b6d-0992-4cde-be53-00ff308dbde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:16.272567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ce094b6d-0992-4cde-be53-00ff308dbde8 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:16.273786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ce094b6d-0992-4cde-be53-00ff308dbde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:16.337288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1123/2207] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:16.344906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd1d0-9f99-45da-baa6-6f59bd303d70 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:16.345279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd1d0-9f99-45da-baa6-6f59bd303d70 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:16.345573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd1d0-9f99-45da-baa6-6f59bd303d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:16.368696 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-668cd1d0-9f99-45da-baa6-6f59bd303d70 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:16.370460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-668cd1d0-9f99-45da-baa6-6f59bd303d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:16.380027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1085/2208] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:16.384351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce094b6d-0992-4cde-be53-00ff308dbde8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:16.394135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce094b6d-0992-4cde-be53-00ff308dbde8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:16.398706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb2d5f-6194-4b5a-bf9b-87668bc17bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:16.399341 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb2d5f-6194-4b5a-bf9b-87668bc17bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:16.399649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb2d5f-6194-4b5a-bf9b-87668bc17bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:16.399943 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb2d5f-6194-4b5a-bf9b-87668bc17bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:16.400587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb2d5f-6194-4b5a-bf9b-87668bc17bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:16.400887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb2d5f-6194-4b5a-bf9b-87668bc17bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:16.402629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb2d5f-6194-4b5a-bf9b-87668bc17bdc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:16.414143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1124/2209] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:26:16.419150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cd1d0-9f99-45da-baa6-6f59bd303d70 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:16.428350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cd1d0-9f99-45da-baa6-6f59bd303d70 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:16.434325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c5d4b-d288-4c08-9b5c-8917e4b3426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:16.434957 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c5d4b-d288-4c08-9b5c-8917e4b3426f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:16.435233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c5d4b-d288-4c08-9b5c-8917e4b3426f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:16.435529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c5d4b-d288-4c08-9b5c-8917e4b3426f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:16.436187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c5d4b-d288-4c08-9b5c-8917e4b3426f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:16.438074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c5d4b-d288-4c08-9b5c-8917e4b3426f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:16.465605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1086/2210] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:16 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:16.473853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb2d5f-6194-4b5a-bf9b-87668bc17bdc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:16.484935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb2d5f-6194-4b5a-bf9b-87668bc17bdc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:16.520406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:16.545077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905920c-3b07-42fc-bd9a-627b0e47bfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:16.545700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905920c-3b07-42fc-bd9a-627b0e47bfdf admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:16.546128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905920c-3b07-42fc-bd9a-627b0e47bfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:16.546405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905920c-3b07-42fc-bd9a-627b0e47bfdf admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:16.547044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905920c-3b07-42fc-bd9a-627b0e47bfdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:16.549081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905920c-3b07-42fc-bd9a-627b0e47bfdf admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:16.571676 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1125/2211] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:16 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:16.575777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c5d4b-d288-4c08-9b5c-8917e4b3426f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:16.586100 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c5d4b-d288-4c08-9b5c-8917e4b3426f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:16.591612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a9bec-892f-481b-9307-fa85cdc017e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:16.592235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a9bec-892f-481b-9307-fa85cdc017e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:16.592513 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a9bec-892f-481b-9307-fa85cdc017e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:16.592785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a9bec-892f-481b-9307-fa85cdc017e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:16.593424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a9bec-892f-481b-9307-fa85cdc017e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:16.595027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a9bec-892f-481b-9307-fa85cdc017e5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:16.605975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1087/2212] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:16.610511 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905920c-3b07-42fc-bd9a-627b0e47bfdf admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:16.621728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905920c-3b07-42fc-bd9a-627b0e47bfdf admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:16.626375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3ef99-4bee-4890-9345-90a47c549082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:16.626973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3ef99-4bee-4890-9345-90a47c549082 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:16.627251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3ef99-4bee-4890-9345-90a47c549082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:16.627555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3ef99-4bee-4890-9345-90a47c549082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:16.628264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3ef99-4bee-4890-9345-90a47c549082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:16.629874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3ef99-4bee-4890-9345-90a47c549082 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:16.640742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1126/2213] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:26:16.644861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a9bec-892f-481b-9307-fa85cdc017e5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:16.655243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a9bec-892f-481b-9307-fa85cdc017e5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:16.660073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b1584-30e3-4ec5-9241-a6efae358bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:16.660709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b1584-30e3-4ec5-9241-a6efae358bed admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:16.660988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b1584-30e3-4ec5-9241-a6efae358bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:16.661262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b1584-30e3-4ec5-9241-a6efae358bed admin admin] PATH_INFO: `/v3/projects/8cc0cc5a0c0a44fb83421a03401dc346/users/51e5f78879df4c40ac180b08dfd8f0b7/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:16.664439 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:16.678654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b1584-30e3-4ec5-9241-a6efae358bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc0cc5a0c0a44fb83421a03401dc346, user_id=51e5f78879df4c40ac180b08dfd8f0b7, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:16.684740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b1584-30e3-4ec5-9241-a6efae358bed admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:16.698627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1088/2214] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:16 2022] PUT /identity/v3/projects/8cc0cc5a0c0a44fb83421a03401dc346/users/51e5f78879df4c40ac180b08dfd8f0b7/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:16.709971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb14b-f388-416e-b464-c956fc5c3a52 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:16.710434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb14b-f388-416e-b464-c956fc5c3a52 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:16.710525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb14b-f388-416e-b464-c956fc5c3a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:16.739424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-538cb14b-f388-416e-b464-c956fc5c3a52 None None] MFA Rules not processed for user `51e5f78879df4c40ac180b08dfd8f0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:16.740673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-538cb14b-f388-416e-b464-c956fc5c3a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:16.804214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1127/2215] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:16.809550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b1584-30e3-4ec5-9241-a6efae358bed admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:16.896686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b1584-30e3-4ec5-9241-a6efae358bed admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:16.902667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f02d5-235b-4472-8b66-11f35b8976bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:16.903385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f02d5-235b-4472-8b66-11f35b8976bb admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:16.903728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f02d5-235b-4472-8b66-11f35b8976bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:16.906427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f02d5-235b-4472-8b66-11f35b8976bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:16.906427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f02d5-235b-4472-8b66-11f35b8976bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:16.906785 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f02d5-235b-4472-8b66-11f35b8976bb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:16.943245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1089/2216] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:16 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:16.945485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb14b-f388-416e-b464-c956fc5c3a52 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:16.967376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb14b-f388-416e-b464-c956fc5c3a52 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:17.037021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c713ba-eb58-4e37-b310-491990964dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:17.037921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c713ba-eb58-4e37-b310-491990964dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:17.038304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c713ba-eb58-4e37-b310-491990964dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:17.038727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c713ba-eb58-4e37-b310-491990964dbb admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:17.039374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c713ba-eb58-4e37-b310-491990964dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:17.041579 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c713ba-eb58-4e37-b310-491990964dbb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:17.074660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1128/2217] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:16 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:17.075706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f02d5-235b-4472-8b66-11f35b8976bb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:17.089170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f02d5-235b-4472-8b66-11f35b8976bb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:17.094561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011cc77-7ca3-47dc-ac75-fe4b72d30c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:17.095171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011cc77-7ca3-47dc-ac75-fe4b72d30c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:17.095456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011cc77-7ca3-47dc-ac75-fe4b72d30c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:17.095733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011cc77-7ca3-47dc-ac75-fe4b72d30c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:17.096416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011cc77-7ca3-47dc-ac75-fe4b72d30c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:17.098016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011cc77-7ca3-47dc-ac75-fe4b72d30c2a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:17.110706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1090/2218] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:17.114907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c713ba-eb58-4e37-b310-491990964dbb admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:17.126729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c713ba-eb58-4e37-b310-491990964dbb admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:17.146799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2735181-6472-4ae3-ade6-2d4bfd46f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:17.147716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2735181-6472-4ae3-ade6-2d4bfd46f2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:17.151287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2735181-6472-4ae3-ade6-2d4bfd46f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:17.151287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2735181-6472-4ae3-ade6-2d4bfd46f2e8 admin admin] PATH_INFO: `/v3/projects/2c08018bd2534d2393e75dee7de3d0e4/users/f413b58d514e4f95aa6d53a3e015459b/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:17.185359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2735181-6472-4ae3-ade6-2d4bfd46f2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c08018bd2534d2393e75dee7de3d0e4, user_id=f413b58d514e4f95aa6d53a3e015459b, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:17.189722 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2735181-6472-4ae3-ade6-2d4bfd46f2e8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:17.235983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1129/2219] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:17 2022] PUT /identity/v3/projects/2c08018bd2534d2393e75dee7de3d0e4/users/f413b58d514e4f95aa6d53a3e015459b/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:17.240005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011cc77-7ca3-47dc-ac75-fe4b72d30c2a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:17.252332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011cc77-7ca3-47dc-ac75-fe4b72d30c2a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:17.336006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc57292-31d2-4d5e-ac4f-8f9d9b4d4f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:17.337886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc57292-31d2-4d5e-ac4f-8f9d9b4d4f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:17.338690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc57292-31d2-4d5e-ac4f-8f9d9b4d4f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:17.338690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc57292-31d2-4d5e-ac4f-8f9d9b4d4f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:17.339195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc57292-31d2-4d5e-ac4f-8f9d9b4d4f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:17.340939 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc57292-31d2-4d5e-ac4f-8f9d9b4d4f78 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:17.351281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1091/2220] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:26:17.356076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2735181-6472-4ae3-ade6-2d4bfd46f2e8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:17.368327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2735181-6472-4ae3-ade6-2d4bfd46f2e8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:17.373688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b392e89-649c-48b1-90ff-f55bd337a171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:17.374374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b392e89-649c-48b1-90ff-f55bd337a171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:17.374649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b392e89-649c-48b1-90ff-f55bd337a171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:17.375052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b392e89-649c-48b1-90ff-f55bd337a171 admin admin] PATH_INFO: `/v3/projects/2c08018bd2534d2393e75dee7de3d0e4/users/f413b58d514e4f95aa6d53a3e015459b/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:17.378140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b392e89-649c-48b1-90ff-f55bd337a171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c08018bd2534d2393e75dee7de3d0e4, user_id=f413b58d514e4f95aa6d53a3e015459b, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:17.380850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b392e89-649c-48b1-90ff-f55bd337a171 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:17.389944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:17.394762 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1130/2221] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:17 2022] PUT /identity/v3/projects/2c08018bd2534d2393e75dee7de3d0e4/users/f413b58d514e4f95aa6d53a3e015459b/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:17.405799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92f4af-da6f-4553-9518-8713e2ad63cf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:17.406148 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92f4af-da6f-4553-9518-8713e2ad63cf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:17.406355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92f4af-da6f-4553-9518-8713e2ad63cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:17.443855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ba92f4af-da6f-4553-9518-8713e2ad63cf None None] MFA Rules not processed for user `f413b58d514e4f95aa6d53a3e015459b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:17.445240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ba92f4af-da6f-4553-9518-8713e2ad63cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:17.518407 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:17.549642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1092/2222] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:17.563159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b392e89-649c-48b1-90ff-f55bd337a171 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:17.564349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2b392e89-649c-48b1-90ff-f55bd337a171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:17.635970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b392e89-649c-48b1-90ff-f55bd337a171 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:17.639997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4820db9-6d6e-401f-ab4c-fee12bfb94fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:17.640616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820db9-6d6e-401f-ab4c-fee12bfb94fd service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:17.640923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820db9-6d6e-401f-ab4c-fee12bfb94fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:17.641332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820db9-6d6e-401f-ab4c-fee12bfb94fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:17.652758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4820db9-6d6e-401f-ab4c-fee12bfb94fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:17.654538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4820db9-6d6e-401f-ab4c-fee12bfb94fd service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:17.666447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1131/2223] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:17.838357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92f4af-da6f-4553-9518-8713e2ad63cf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:17.839863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ba92f4af-da6f-4553-9518-8713e2ad63cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:17.854197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92f4af-da6f-4553-9518-8713e2ad63cf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:17.857886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898ead0-4e25-4a5e-b20a-8b1cca346421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:17.858514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ead0-4e25-4a5e-b20a-8b1cca346421 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:17.858791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ead0-4e25-4a5e-b20a-8b1cca346421 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:17.859064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ead0-4e25-4a5e-b20a-8b1cca346421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:17.916104 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898ead0-4e25-4a5e-b20a-8b1cca346421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:17.917530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898ead0-4e25-4a5e-b20a-8b1cca346421 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:17.926578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1093/2224] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:26:18.005852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467cd8d-c2e5-43c0-8514-17fbfe508065 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:18.006405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467cd8d-c2e5-43c0-8514-17fbfe508065 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:18.006498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467cd8d-c2e5-43c0-8514-17fbfe508065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:18.026979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b467cd8d-c2e5-43c0-8514-17fbfe508065 None None] MFA Rules not processed for user `8e4e84914fc643689aa6516f3f24e66c`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:18.028335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b467cd8d-c2e5-43c0-8514-17fbfe508065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:18.089396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1132/2225] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:20.561699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898ead0-4e25-4a5e-b20a-8b1cca346421 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:20.630716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898ead0-4e25-4a5e-b20a-8b1cca346421 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:20.636254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:20.636883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:20.637157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:20.637428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] PATH_INFO: `/v3/users/51e5f78879df4c40ac180b08dfd8f0b7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:20.638580 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e5f78879df4c40ac180b08dfd8f0b7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:20.640568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:20.691890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e5f78879df4c40ac180b08dfd8f0b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:20.700017 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e5f78879df4c40ac180b08dfd8f0b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:20.700629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e5f78879df4c40ac180b08dfd8f0b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:20.701231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e5f78879df4c40ac180b08dfd8f0b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:20.708082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e5f78879df4c40ac180b08dfd8f0b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:20.721310 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:20.726846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1094/2226] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:20 2022] DELETE /identity/v3/users/51e5f78879df4c40ac180b08dfd8f0b7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:20.731806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6406c0d-37b4-4269-8dcd-52dbd13848a9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:20.732329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6406c0d-37b4-4269-8dcd-52dbd13848a9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:20.732507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6406c0d-37b4-4269-8dcd-52dbd13848a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:20.753946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a6406c0d-37b4-4269-8dcd-52dbd13848a9 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:20.755161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a6406c0d-37b4-4269-8dcd-52dbd13848a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:20.815517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1133/2227] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:20.828231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:20.828231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:20.895672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e979f-245b-4272-957f-ac42b09aa38b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:20.900489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250027a9-969d-46f0-8c89-80b1a167c0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:20.901098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250027a9-969d-46f0-8c89-80b1a167c0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:20.901374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250027a9-969d-46f0-8c89-80b1a167c0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:20.901651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250027a9-969d-46f0-8c89-80b1a167c0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:20.911229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250027a9-969d-46f0-8c89-80b1a167c0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:20.912683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250027a9-969d-46f0-8c89-80b1a167c0d1 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:20.924637 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1095/2228] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:21.556665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6406c0d-37b4-4269-8dcd-52dbd13848a9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:21.559954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a6406c0d-37b4-4269-8dcd-52dbd13848a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:21.590166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6406c0d-37b4-4269-8dcd-52dbd13848a9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:21.600852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:21.602658 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:21.603112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:21.603479 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] PATH_INFO: `/v3/projects/8cc0cc5a0c0a44fb83421a03401dc346` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:21.604791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc0cc5a0c0a44fb83421a03401dc346)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:21.607826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:21.686354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:21.704619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc0cc5a0c0a44fb83421a03401dc346', 'request_id': 'req-7b6097c2-ca3f-412e-acc5-86f72891997d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:21.719052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc0cc5a0c0a44fb83421a03401dc346', 'request_id': 'req-7b6097c2-ca3f-412e-acc5-86f72891997d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:21.735498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc0cc5a0c0a44fb83421a03401dc346', 'request_id': 'req-7b6097c2-ca3f-412e-acc5-86f72891997d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:21.753382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] The token cache is being invalidate because project 8cc0cc5a0c0a44fb83421a03401dc346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:21.753678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:21.757693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:21.766924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1134/2229] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:21 2022] DELETE /identity/v3/projects/8cc0cc5a0c0a44fb83421a03401dc346 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:21.768240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250027a9-969d-46f0-8c89-80b1a167c0d1 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:21.781132 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250027a9-969d-46f0-8c89-80b1a167c0d1 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:21.864177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a469b15-5a31-4fe7-a1f7-a5db20ea8768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:21.865106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a469b15-5a31-4fe7-a1f7-a5db20ea8768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:21.865452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a469b15-5a31-4fe7-a1f7-a5db20ea8768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:21.865798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a469b15-5a31-4fe7-a1f7-a5db20ea8768 admin admin] PATH_INFO: `/v3/users/f413b58d514e4f95aa6d53a3e015459b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:21.868379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a469b15-5a31-4fe7-a1f7-a5db20ea8768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f413b58d514e4f95aa6d53a3e015459b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:21.870863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a469b15-5a31-4fe7-a1f7-a5db20ea8768 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:21.936203 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0a469b15-5a31-4fe7-a1f7-a5db20ea8768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f413b58d514e4f95aa6d53a3e015459b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:21.944757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0a469b15-5a31-4fe7-a1f7-a5db20ea8768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f413b58d514e4f95aa6d53a3e015459b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:21.946533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0a469b15-5a31-4fe7-a1f7-a5db20ea8768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f413b58d514e4f95aa6d53a3e015459b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:21.947379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0a469b15-5a31-4fe7-a1f7-a5db20ea8768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f413b58d514e4f95aa6d53a3e015459b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:21.954745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0a469b15-5a31-4fe7-a1f7-a5db20ea8768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f413b58d514e4f95aa6d53a3e015459b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:21.975818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1096/2230] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:21 2022] DELETE /identity/v3/users/f413b58d514e4f95aa6d53a3e015459b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:22.313305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:22.314813 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:22.342540 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6097c2-ca3f-412e-acc5-86f72891997d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:22.417659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:22.418297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:22.418573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:22.418875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] PATH_INFO: `/v3/projects/2c08018bd2534d2393e75dee7de3d0e4` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:22.420028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c08018bd2534d2393e75dee7de3d0e4)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:22.422061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:22.481511 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c08018bd2534d2393e75dee7de3d0e4', 'request_id': 'req-99fc0f54-609a-4029-a761-526c4a603367'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:22.487728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c08018bd2534d2393e75dee7de3d0e4', 'request_id': 'req-99fc0f54-609a-4029-a761-526c4a603367'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:22.496952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c08018bd2534d2393e75dee7de3d0e4', 'request_id': 'req-99fc0f54-609a-4029-a761-526c4a603367'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:22.509967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] The token cache is being invalidate because project 2c08018bd2534d2393e75dee7de3d0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:22.510259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:22.510921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-99fc0f54-609a-4029-a761-526c4a603367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:22.512468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1135/2231] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:22 2022] DELETE /identity/v3/projects/2c08018bd2534d2393e75dee7de3d0e4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:22.517548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc53e2-73db-4def-8595-940b9e2e9e3a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:22.517936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc53e2-73db-4def-8595-940b9e2e9e3a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:22.518282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc53e2-73db-4def-8595-940b9e2e9e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:22.550815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-37dc53e2-73db-4def-8595-940b9e2e9e3a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:22.552288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-37dc53e2-73db-4def-8595-940b9e2e9e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:22.573811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:22.634238 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1097/2232] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:22.642077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d9d7-22de-49cb-9a7b-fbd2d54252f1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:22.642347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d9d7-22de-49cb-9a7b-fbd2d54252f1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:22.642622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d9d7-22de-49cb-9a7b-fbd2d54252f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:22.667141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-db39d9d7-22de-49cb-9a7b-fbd2d54252f1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:22.668692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-db39d9d7-22de-49cb-9a7b-fbd2d54252f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:22.676664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1136/2233] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:22.681490 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc53e2-73db-4def-8595-940b9e2e9e3a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:22.691668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc53e2-73db-4def-8595-940b9e2e9e3a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:22.696863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d2510-0697-4af8-a935-27c53d138cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:22.697534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d2510-0697-4af8-a935-27c53d138cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:22.697816 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d2510-0697-4af8-a935-27c53d138cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:22.698086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d2510-0697-4af8-a935-27c53d138cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:22.698731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d2510-0697-4af8-a935-27c53d138cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:22.699032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d2510-0697-4af8-a935-27c53d138cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:22.700664 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d2510-0697-4af8-a935-27c53d138cc7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:22.714327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1098/2234] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:26:22.718528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39d9d7-22de-49cb-9a7b-fbd2d54252f1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:22.729875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39d9d7-22de-49cb-9a7b-fbd2d54252f1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:22.737595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524f4f7-4b4c-4ed3-a5e8-31762c8213fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:22.738497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524f4f7-4b4c-4ed3-a5e8-31762c8213fc admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:22.738876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524f4f7-4b4c-4ed3-a5e8-31762c8213fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:22.739254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524f4f7-4b4c-4ed3-a5e8-31762c8213fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:22.740022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524f4f7-4b4c-4ed3-a5e8-31762c8213fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:22.743934 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524f4f7-4b4c-4ed3-a5e8-31762c8213fc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:22.795730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d2510-0697-4af8-a935-27c53d138cc7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:22.797014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1137/2235] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:22 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:22.810148 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d2510-0697-4af8-a935-27c53d138cc7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:22.912733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58843543-7e62-4aa8-8cf7-6e341021bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:22.914474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58843543-7e62-4aa8-8cf7-6e341021bf58 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:22.915022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58843543-7e62-4aa8-8cf7-6e341021bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:22.915544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58843543-7e62-4aa8-8cf7-6e341021bf58 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:22.916630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58843543-7e62-4aa8-8cf7-6e341021bf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:22.919806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58843543-7e62-4aa8-8cf7-6e341021bf58 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:22.958239 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1099/2236] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:22 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:26:22.963563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524f4f7-4b4c-4ed3-a5e8-31762c8213fc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:22.978859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524f4f7-4b4c-4ed3-a5e8-31762c8213fc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:22.985879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b472b-149b-4a4b-aaf7-97d65740ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:22.986829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b472b-149b-4a4b-aaf7-97d65740ba05 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:22.988353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b472b-149b-4a4b-aaf7-97d65740ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:22.989992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b472b-149b-4a4b-aaf7-97d65740ba05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:22.991207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b472b-149b-4a4b-aaf7-97d65740ba05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:22.993994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b472b-149b-4a4b-aaf7-97d65740ba05 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:23.013590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1138/2237] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:23.028538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58843543-7e62-4aa8-8cf7-6e341021bf58 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:23.032874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58843543-7e62-4aa8-8cf7-6e341021bf58 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:23.042776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f4690-fb6b-4684-bda6-ffcdf0140fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:23.044162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4690-fb6b-4684-bda6-ffcdf0140fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:23.044448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4690-fb6b-4684-bda6-ffcdf0140fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:23.044728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4690-fb6b-4684-bda6-ffcdf0140fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:23.045387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f4690-fb6b-4684-bda6-ffcdf0140fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:23.048012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f4690-fb6b-4684-bda6-ffcdf0140fe4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:23.066880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1100/2238] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:26:23.067596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b472b-149b-4a4b-aaf7-97d65740ba05 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:23.078688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b472b-149b-4a4b-aaf7-97d65740ba05 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:23.084888 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0c580-3fe4-4a4d-95e2-28a32398bdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:23.086673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0c580-3fe4-4a4d-95e2-28a32398bdbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:23.086962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0c580-3fe4-4a4d-95e2-28a32398bdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:23.087240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0c580-3fe4-4a4d-95e2-28a32398bdbe admin admin] PATH_INFO: `/v3/projects/5ab6bae972974a1abebfef49b31580e6/users/0360fc9a5bcf4197b0f09b5c84ea0117/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:23.108217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0c580-3fe4-4a4d-95e2-28a32398bdbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab6bae972974a1abebfef49b31580e6, user_id=0360fc9a5bcf4197b0f09b5c84ea0117, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:23.111453 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0c580-3fe4-4a4d-95e2-28a32398bdbe admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:23.115992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:23.135111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1139/2239] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:23 2022] PUT /identity/v3/projects/5ab6bae972974a1abebfef49b31580e6/users/0360fc9a5bcf4197b0f09b5c84ea0117/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:23.150370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264a9ef-9749-4af5-bf9f-067a9d66977d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:23.150370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264a9ef-9749-4af5-bf9f-067a9d66977d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:23.150370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264a9ef-9749-4af5-bf9f-067a9d66977d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:23.201092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7264a9ef-9749-4af5-bf9f-067a9d66977d None None] MFA Rules not processed for user `0360fc9a5bcf4197b0f09b5c84ea0117`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:23.202519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7264a9ef-9749-4af5-bf9f-067a9d66977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:23.374314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1101/2240] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:23.378516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0c580-3fe4-4a4d-95e2-28a32398bdbe admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:23.453619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0c580-3fe4-4a4d-95e2-28a32398bdbe admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:23.458495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa33080-98da-445d-b7e5-44a7e8f33f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:23.459107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33080-98da-445d-b7e5-44a7e8f33f73 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:23.459389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33080-98da-445d-b7e5-44a7e8f33f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:23.459664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33080-98da-445d-b7e5-44a7e8f33f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:23.460327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa33080-98da-445d-b7e5-44a7e8f33f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:23.463161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa33080-98da-445d-b7e5-44a7e8f33f73 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:23.496909 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1140/2241] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:23 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:26:23.498347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264a9ef-9749-4af5-bf9f-067a9d66977d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:23.510166 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264a9ef-9749-4af5-bf9f-067a9d66977d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:23.521441 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:23.568673 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde52df-720d-49c6-b6d1-33de6c33db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:23.569286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde52df-720d-49c6-b6d1-33de6c33db0b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:23.569564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde52df-720d-49c6-b6d1-33de6c33db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:23.569839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde52df-720d-49c6-b6d1-33de6c33db0b admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:23.570510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde52df-720d-49c6-b6d1-33de6c33db0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:23.572451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde52df-720d-49c6-b6d1-33de6c33db0b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:23.594032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1102/2242] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:23 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:23.598155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa33080-98da-445d-b7e5-44a7e8f33f73 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:23.609641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa33080-98da-445d-b7e5-44a7e8f33f73 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:23.614173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32342d8-9651-4e8f-bc6c-ecab63a502cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:23.614802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32342d8-9651-4e8f-bc6c-ecab63a502cc admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:23.615128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32342d8-9651-4e8f-bc6c-ecab63a502cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:23.615406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32342d8-9651-4e8f-bc6c-ecab63a502cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:23.616347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32342d8-9651-4e8f-bc6c-ecab63a502cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:23.618255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32342d8-9651-4e8f-bc6c-ecab63a502cc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:23.629025 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1141/2243] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:23.633539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde52df-720d-49c6-b6d1-33de6c33db0b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:23.643531 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde52df-720d-49c6-b6d1-33de6c33db0b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:23.648201 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5175fc3-3c94-4685-8b81-3cb52898312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:23.649399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5175fc3-3c94-4685-8b81-3cb52898312f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:23.649678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5175fc3-3c94-4685-8b81-3cb52898312f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:23.649953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5175fc3-3c94-4685-8b81-3cb52898312f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:23.650591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5175fc3-3c94-4685-8b81-3cb52898312f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:23.652211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5175fc3-3c94-4685-8b81-3cb52898312f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:23.662069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1103/2244] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:23.666166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32342d8-9651-4e8f-bc6c-ecab63a502cc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:23.676168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32342d8-9651-4e8f-bc6c-ecab63a502cc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:23.680875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422795c-657a-4c37-b956-79dcfca841c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:23.681508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422795c-657a-4c37-b956-79dcfca841c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:23.681785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422795c-657a-4c37-b956-79dcfca841c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:23.682058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422795c-657a-4c37-b956-79dcfca841c2 admin admin] PATH_INFO: `/v3/projects/9061a433e8d947568b727173ef830310/users/f763c6b699674f94b8cae63254cce8ba/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:23.698069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422795c-657a-4c37-b956-79dcfca841c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9061a433e8d947568b727173ef830310, user_id=f763c6b699674f94b8cae63254cce8ba, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:23.700755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422795c-657a-4c37-b956-79dcfca841c2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:23.714022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1142/2245] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:23 2022] PUT /identity/v3/projects/9061a433e8d947568b727173ef830310/users/f763c6b699674f94b8cae63254cce8ba/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:23.724677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be732d0-3bbf-4303-b4c4-82960367a28d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:23.724897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be732d0-3bbf-4303-b4c4-82960367a28d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:23.725168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be732d0-3bbf-4303-b4c4-82960367a28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:23.753642 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9be732d0-3bbf-4303-b4c4-82960367a28d None None] MFA Rules not processed for user `f763c6b699674f94b8cae63254cce8ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:23.754906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9be732d0-3bbf-4303-b4c4-82960367a28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:23.820741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1104/2246] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:23.825411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422795c-657a-4c37-b956-79dcfca841c2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:23.887555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422795c-657a-4c37-b956-79dcfca841c2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:23.892173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7eca1-4a97-4e5e-a6e9-aac6ebf1daeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:23.892763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7eca1-4a97-4e5e-a6e9-aac6ebf1daeb admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:23.893062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7eca1-4a97-4e5e-a6e9-aac6ebf1daeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:23.893333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7eca1-4a97-4e5e-a6e9-aac6ebf1daeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:23.893952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7eca1-4a97-4e5e-a6e9-aac6ebf1daeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:23.895836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7eca1-4a97-4e5e-a6e9-aac6ebf1daeb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:23.922846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1143/2247] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:23 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:23.926902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be732d0-3bbf-4303-b4c4-82960367a28d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:23.937972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be732d0-3bbf-4303-b4c4-82960367a28d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:24.000902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc235835-5d7f-445c-a1ae-b386442ef032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:24.001400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235835-5d7f-445c-a1ae-b386442ef032 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:24.001815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235835-5d7f-445c-a1ae-b386442ef032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:24.002091 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235835-5d7f-445c-a1ae-b386442ef032 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:24.002824 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc235835-5d7f-445c-a1ae-b386442ef032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:24.005716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc235835-5d7f-445c-a1ae-b386442ef032 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:24.030992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1105/2248] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:23 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:24.032251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7eca1-4a97-4e5e-a6e9-aac6ebf1daeb admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:24.043302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7eca1-4a97-4e5e-a6e9-aac6ebf1daeb admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:24.048161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f98f2-bd23-4437-87c1-7276f4eb4dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:24.048752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f98f2-bd23-4437-87c1-7276f4eb4dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:24.049029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f98f2-bd23-4437-87c1-7276f4eb4dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:24.049327 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f98f2-bd23-4437-87c1-7276f4eb4dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:24.049981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f98f2-bd23-4437-87c1-7276f4eb4dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:24.051566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f98f2-bd23-4437-87c1-7276f4eb4dc3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:24.064096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1144/2249] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:24.067962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc235835-5d7f-445c-a1ae-b386442ef032 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:24.079087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc235835-5d7f-445c-a1ae-b386442ef032 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:24.084081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b7915-510a-4b63-b4b8-d3bbcff4e906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:24.084727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7915-510a-4b63-b4b8-d3bbcff4e906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:24.085000 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7915-510a-4b63-b4b8-d3bbcff4e906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:24.085280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7915-510a-4b63-b4b8-d3bbcff4e906 admin admin] PATH_INFO: `/v3/projects/f831828100a84dd69ccd3144e2b2c057/users/084da32ee6e44de0bd26002cfb87f432/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:24.097049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:24.102270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b7915-510a-4b63-b4b8-d3bbcff4e906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f831828100a84dd69ccd3144e2b2c057, user_id=084da32ee6e44de0bd26002cfb87f432, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:24.105001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b7915-510a-4b63-b4b8-d3bbcff4e906 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:24.119890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1106/2250] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:24 2022] PUT /identity/v3/projects/f831828100a84dd69ccd3144e2b2c057/users/084da32ee6e44de0bd26002cfb87f432/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:24.123628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f98f2-bd23-4437-87c1-7276f4eb4dc3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:24.138095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f98f2-bd23-4437-87c1-7276f4eb4dc3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:24.154617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:24.215891 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe0a0f-3cb7-45a5-954d-0d56ade3f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:24.215891 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe0a0f-3cb7-45a5-954d-0d56ade3f0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:24.215891 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe0a0f-3cb7-45a5-954d-0d56ade3f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:24.215891 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe0a0f-3cb7-45a5-954d-0d56ade3f0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:24.216246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe0a0f-3cb7-45a5-954d-0d56ade3f0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:24.216246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe0a0f-3cb7-45a5-954d-0d56ade3f0c0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:24.230847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1145/2251] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:24.234801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b7915-510a-4b63-b4b8-d3bbcff4e906 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:24.246733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b7915-510a-4b63-b4b8-d3bbcff4e906 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:24.252108 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8d79d-2e0d-4ef1-a32c-a6226e8d8d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:24.252741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d79d-2e0d-4ef1-a32c-a6226e8d8d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:24.252969 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d79d-2e0d-4ef1-a32c-a6226e8d8d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:24.253239 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8d79d-2e0d-4ef1-a32c-a6226e8d8d32 admin admin] PATH_INFO: `/v3/projects/f831828100a84dd69ccd3144e2b2c057/users/084da32ee6e44de0bd26002cfb87f432/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:24.255162 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8d79d-2e0d-4ef1-a32c-a6226e8d8d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f831828100a84dd69ccd3144e2b2c057, user_id=084da32ee6e44de0bd26002cfb87f432, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:24.258608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8d79d-2e0d-4ef1-a32c-a6226e8d8d32 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:24.279415 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1107/2252] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:24 2022] PUT /identity/v3/projects/f831828100a84dd69ccd3144e2b2c057/users/084da32ee6e44de0bd26002cfb87f432/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:24.291416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23eb4ce-4d91-4544-931f-392d80a91ad8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:24.291753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23eb4ce-4d91-4544-931f-392d80a91ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:24.292075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23eb4ce-4d91-4544-931f-392d80a91ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:24.324392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f23eb4ce-4d91-4544-931f-392d80a91ad8 None None] MFA Rules not processed for user `084da32ee6e44de0bd26002cfb87f432`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:24.325629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f23eb4ce-4d91-4544-931f-392d80a91ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:24.433753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1146/2253] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:24.450810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8d79d-2e0d-4ef1-a32c-a6226e8d8d32 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:24.452695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7ac8d79d-2e0d-4ef1-a32c-a6226e8d8d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:24.551767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8d79d-2e0d-4ef1-a32c-a6226e8d8d32 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:24.559081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb78d5d-9d31-4a14-9a61-011674b9ba1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:24.560151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb78d5d-9d31-4a14-9a61-011674b9ba1e service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:24.560434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb78d5d-9d31-4a14-9a61-011674b9ba1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:24.560711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb78d5d-9d31-4a14-9a61-011674b9ba1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:24.668954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb78d5d-9d31-4a14-9a61-011674b9ba1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:24.670377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb78d5d-9d31-4a14-9a61-011674b9ba1e service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:24.688561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1108/2254] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:25.324606 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23eb4ce-4d91-4544-931f-392d80a91ad8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:25.326079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f23eb4ce-4d91-4544-931f-392d80a91ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:25.391531 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23eb4ce-4d91-4544-931f-392d80a91ad8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:25.396695 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:25.396989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:25.397267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:25.397541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] PATH_INFO: `/v3/users/19faecaff359400194490cb3ba255ab7` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:25.398809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19faecaff359400194490cb3ba255ab7)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:25.400805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:25.447981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:25.452634 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19faecaff359400194490cb3ba255ab7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:25.462055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19faecaff359400194490cb3ba255ab7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:25.462666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19faecaff359400194490cb3ba255ab7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:25.463280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19faecaff359400194490cb3ba255ab7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:25.476076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19faecaff359400194490cb3ba255ab7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:25.490913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1147/2255] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:25 2022] DELETE /identity/v3/users/19faecaff359400194490cb3ba255ab7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:25.699743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb78d5d-9d31-4a14-9a61-011674b9ba1e service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:25.718923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb78d5d-9d31-4a14-9a61-011674b9ba1e service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:25.777315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:25.777946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:25.778221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:25.778493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] PATH_INFO: `/v3/projects/1cd78c8daa9c43fe87067e267c755f3a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:25.779592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd78c8daa9c43fe87067e267c755f3a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:25.782051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:25.819480 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:25.840255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd78c8daa9c43fe87067e267c755f3a', 'request_id': 'req-51e542d2-fada-4e2c-9226-d002faaad5b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:25.851566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd78c8daa9c43fe87067e267c755f3a', 'request_id': 'req-51e542d2-fada-4e2c-9226-d002faaad5b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:25.857391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd78c8daa9c43fe87067e267c755f3a', 'request_id': 'req-51e542d2-fada-4e2c-9226-d002faaad5b7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:25.869245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] The token cache is being invalidate because project 1cd78c8daa9c43fe87067e267c755f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:25.869533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:25.870175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:25.871673 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1109/2256] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:25 2022] DELETE /identity/v3/projects/1cd78c8daa9c43fe87067e267c755f3a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:25.875878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:25.877411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:25.891652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133836e-a694-4499-bc3a-7e7dd2ef5117 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:25.954693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ee776-4cee-4c33-9d48-18abfd6081db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:25.955444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ee776-4cee-4c33-9d48-18abfd6081db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:25.955724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ee776-4cee-4c33-9d48-18abfd6081db admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:25.956028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ee776-4cee-4c33-9d48-18abfd6081db admin admin] PATH_INFO: `/v3/users/f51d754ba668485c9e06f6443b9f59f5` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:25.957160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ee776-4cee-4c33-9d48-18abfd6081db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51d754ba668485c9e06f6443b9f59f5)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:25.959101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ee776-4cee-4c33-9d48-18abfd6081db admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:26.007438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e13ee776-4cee-4c33-9d48-18abfd6081db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51d754ba668485c9e06f6443b9f59f5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:26.014492 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e13ee776-4cee-4c33-9d48-18abfd6081db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51d754ba668485c9e06f6443b9f59f5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:26.015101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e13ee776-4cee-4c33-9d48-18abfd6081db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51d754ba668485c9e06f6443b9f59f5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:26.015768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e13ee776-4cee-4c33-9d48-18abfd6081db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51d754ba668485c9e06f6443b9f59f5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:26.028723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e13ee776-4cee-4c33-9d48-18abfd6081db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51d754ba668485c9e06f6443b9f59f5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:26.041903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1148/2257] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:25 2022] DELETE /identity/v3/users/f51d754ba668485c9e06f6443b9f59f5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:26.230394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:26.232286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:26.247261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e542d2-fada-4e2c-9226-d002faaad5b7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:26.310470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:26.311183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:26.311647 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:26.312034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] PATH_INFO: `/v3/projects/5aae61e3ff3a4f62884779b429f3c891` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:26.313316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aae61e3ff3a4f62884779b429f3c891)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:26.315770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:26.368210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aae61e3ff3a4f62884779b429f3c891', 'request_id': 'req-56d087a0-6870-4aec-9180-5356d7f2b4af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:26.375811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aae61e3ff3a4f62884779b429f3c891', 'request_id': 'req-56d087a0-6870-4aec-9180-5356d7f2b4af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:26.387050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aae61e3ff3a4f62884779b429f3c891', 'request_id': 'req-56d087a0-6870-4aec-9180-5356d7f2b4af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:26.398712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] The token cache is being invalidate because project 5aae61e3ff3a4f62884779b429f3c891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:26.399299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:26.400076 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-56d087a0-6870-4aec-9180-5356d7f2b4af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:26.401576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1110/2258] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:26 2022] DELETE /identity/v3/projects/5aae61e3ff3a4f62884779b429f3c891 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:26.406717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2602c4c-7daa-4dde-9baf-96c5c7b7e6da None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:26.407213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2602c4c-7daa-4dde-9baf-96c5c7b7e6da None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:26.407335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2602c4c-7daa-4dde-9baf-96c5c7b7e6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:26.428496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d2602c4c-7daa-4dde-9baf-96c5c7b7e6da None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:26.430174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d2602c4c-7daa-4dde-9baf-96c5c7b7e6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:26.463771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:26.498938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1149/2259] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:26.507042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72c08-af4e-4f31-8014-9aadc894e3c6 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:26.507329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72c08-af4e-4f31-8014-9aadc894e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:26.507654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b72c08-af4e-4f31-8014-9aadc894e3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:26.528971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b8b72c08-af4e-4f31-8014-9aadc894e3c6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:26.530280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b8b72c08-af4e-4f31-8014-9aadc894e3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:26.538348 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1111/2260] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:26.543261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2602c4c-7daa-4dde-9baf-96c5c7b7e6da None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:26.553499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2602c4c-7daa-4dde-9baf-96c5c7b7e6da None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:26.558215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63df7e-fb01-4b80-aa0b-19743269d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:26.558815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63df7e-fb01-4b80-aa0b-19743269d3ea admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:26.559097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63df7e-fb01-4b80-aa0b-19743269d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:26.559375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63df7e-fb01-4b80-aa0b-19743269d3ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:26.560083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63df7e-fb01-4b80-aa0b-19743269d3ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:26.560387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63df7e-fb01-4b80-aa0b-19743269d3ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:26.562088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63df7e-fb01-4b80-aa0b-19743269d3ea admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:26.578293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1150/2261] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:26:26.579356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72c08-af4e-4f31-8014-9aadc894e3c6 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:26.589626 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b72c08-af4e-4f31-8014-9aadc894e3c6 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:26.594353 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591b6ca-ac0a-4655-9a76-ab11b0ba00b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:26.594950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591b6ca-ac0a-4655-9a76-ab11b0ba00b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:26.595230 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591b6ca-ac0a-4655-9a76-ab11b0ba00b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:26.595505 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591b6ca-ac0a-4655-9a76-ab11b0ba00b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:26.596176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591b6ca-ac0a-4655-9a76-ab11b0ba00b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:26.598088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591b6ca-ac0a-4655-9a76-ab11b0ba00b4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:26.636580 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1112/2262] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:26 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:26:26.640688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63df7e-fb01-4b80-aa0b-19743269d3ea admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:26.652234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63df7e-fb01-4b80-aa0b-19743269d3ea admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:26.725805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a8226-61c2-4f1c-b40c-e1a22eca6698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:26.727266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a8226-61c2-4f1c-b40c-e1a22eca6698 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:26.727711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a8226-61c2-4f1c-b40c-e1a22eca6698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:26.728015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a8226-61c2-4f1c-b40c-e1a22eca6698 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:26.728772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a8226-61c2-4f1c-b40c-e1a22eca6698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:26.730889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a8226-61c2-4f1c-b40c-e1a22eca6698 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:26.758482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1151/2263] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:26 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:26:26.759727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591b6ca-ac0a-4655-9a76-ab11b0ba00b4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:26.775598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591b6ca-ac0a-4655-9a76-ab11b0ba00b4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:26.780699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4438a1-b9e9-445a-979b-b5a35066b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:26.781511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4438a1-b9e9-445a-979b-b5a35066b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:26.781858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4438a1-b9e9-445a-979b-b5a35066b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:26.782704 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4438a1-b9e9-445a-979b-b5a35066b9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:26.783521 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4438a1-b9e9-445a-979b-b5a35066b9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:26.785286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4438a1-b9e9-445a-979b-b5a35066b9eb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:26.797276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1113/2264] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:26.801249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a8226-61c2-4f1c-b40c-e1a22eca6698 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:26.812312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a8226-61c2-4f1c-b40c-e1a22eca6698 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:26.818045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7d85f-3220-4399-99b5-2d4978f78b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:26.818637 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d85f-3220-4399-99b5-2d4978f78b35 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:26.819007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d85f-3220-4399-99b5-2d4978f78b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:26.819284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d85f-3220-4399-99b5-2d4978f78b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:26.820450 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7d85f-3220-4399-99b5-2d4978f78b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:26.822280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7d85f-3220-4399-99b5-2d4978f78b35 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:26.843420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1152/2265] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:26.844762 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4438a1-b9e9-445a-979b-b5a35066b9eb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:26.855281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4438a1-b9e9-445a-979b-b5a35066b9eb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:26.859980 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac911f-01cc-47e1-85f0-5b2b5fc329d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:26.860629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac911f-01cc-47e1-85f0-5b2b5fc329d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:26.860909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac911f-01cc-47e1-85f0-5b2b5fc329d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:26.861192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac911f-01cc-47e1-85f0-5b2b5fc329d7 admin admin] PATH_INFO: `/v3/projects/3632e057e1754741b8d7b11d998ed03a/users/47580c883d7744f2bb60ef147f71c234/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:26.870128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:26.878102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac911f-01cc-47e1-85f0-5b2b5fc329d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3632e057e1754741b8d7b11d998ed03a, user_id=47580c883d7744f2bb60ef147f71c234, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:26.881031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac911f-01cc-47e1-85f0-5b2b5fc329d7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:26.902607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1114/2266] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:26 2022] PUT /identity/v3/projects/3632e057e1754741b8d7b11d998ed03a/users/47580c883d7744f2bb60ef147f71c234/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:26.914769 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a85ea4-2d76-4a85-a13a-ac91a55d9010 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:26.915141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a85ea4-2d76-4a85-a13a-ac91a55d9010 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:26.915416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a85ea4-2d76-4a85-a13a-ac91a55d9010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:26.943438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-54a85ea4-2d76-4a85-a13a-ac91a55d9010 None None] MFA Rules not processed for user `47580c883d7744f2bb60ef147f71c234`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:26.944786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-54a85ea4-2d76-4a85-a13a-ac91a55d9010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:27.015837 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1153/2267] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:27.027554 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac911f-01cc-47e1-85f0-5b2b5fc329d7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:27.029281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-41ac911f-01cc-47e1-85f0-5b2b5fc329d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:27.096035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac911f-01cc-47e1-85f0-5b2b5fc329d7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:27.100226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb47dd-3015-43af-954f-e7fad922f260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:27.100832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb47dd-3015-43af-954f-e7fad922f260 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:27.101368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb47dd-3015-43af-954f-e7fad922f260 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:27.101646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb47dd-3015-43af-954f-e7fad922f260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:27.110795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb47dd-3015-43af-954f-e7fad922f260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:27.112294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb47dd-3015-43af-954f-e7fad922f260 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:27.122446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1115/2268] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:27.142252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a85ea4-2d76-4a85-a13a-ac91a55d9010 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:27.202321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:27.243518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a85ea4-2d76-4a85-a13a-ac91a55d9010 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:27.252405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:27.253047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:27.253323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:27.253652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] PATH_INFO: `/v3/users/47580c883d7744f2bb60ef147f71c234` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:27.254810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47580c883d7744f2bb60ef147f71c234)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:27.256869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:27.325022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47580c883d7744f2bb60ef147f71c234'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:27.334041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47580c883d7744f2bb60ef147f71c234'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:27.334873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47580c883d7744f2bb60ef147f71c234'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:27.337456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47580c883d7744f2bb60ef147f71c234'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:27.354931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47580c883d7744f2bb60ef147f71c234'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:27.376434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1154/2269] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:27 2022] DELETE /identity/v3/users/47580c883d7744f2bb60ef147f71c234 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:27.381064 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850295f-202f-4a83-a435-271ee773dc53 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:27.381495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850295f-202f-4a83-a435-271ee773dc53 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:27.381800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850295f-202f-4a83-a435-271ee773dc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:27.415686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0850295f-202f-4a83-a435-271ee773dc53 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:27.417159 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0850295f-202f-4a83-a435-271ee773dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:27.441568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:27.443034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:27.482124 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1116/2270] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:27.492692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850295f-202f-4a83-a435-271ee773dc53 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:27.494303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0850295f-202f-4a83-a435-271ee773dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:27.527071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194fbb-91b4-45d2-b86f-658a4a10daa1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:27.531553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f70034-a316-4900-9591-41d17d441a09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:27.532391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70034-a316-4900-9591-41d17d441a09 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:27.532733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70034-a316-4900-9591-41d17d441a09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:27.533011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f70034-a316-4900-9591-41d17d441a09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:27.535065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a5f70034-a316-4900-9591-41d17d441a09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:27.566818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850295f-202f-4a83-a435-271ee773dc53 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:27.571782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebda56-f618-4767-9392-f35bc2fb29d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:27.573620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebda56-f618-4767-9392-f35bc2fb29d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:27.573909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebda56-f618-4767-9392-f35bc2fb29d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:27.574194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebda56-f618-4767-9392-f35bc2fb29d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:27.585733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebda56-f618-4767-9392-f35bc2fb29d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:27.588150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebda56-f618-4767-9392-f35bc2fb29d7 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:27.600357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1117/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:27.606347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f70034-a316-4900-9591-41d17d441a09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:27.608049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f70034-a316-4900-9591-41d17d441a09 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:27.619698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1155/2272] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:26:27.922596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebda56-f618-4767-9392-f35bc2fb29d7 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:27.924192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-52ebda56-f618-4767-9392-f35bc2fb29d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:27.952195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebda56-f618-4767-9392-f35bc2fb29d7 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:27.957335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:27.958034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:27.958317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:27.958594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] PATH_INFO: `/v3/projects/3632e057e1754741b8d7b11d998ed03a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:27.959712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3632e057e1754741b8d7b11d998ed03a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:27.962391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:28.001936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:28.027873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3632e057e1754741b8d7b11d998ed03a', 'request_id': 'req-ac902c06-31e5-4eeb-ae28-3718409db78d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:28.044691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3632e057e1754741b8d7b11d998ed03a', 'request_id': 'req-ac902c06-31e5-4eeb-ae28-3718409db78d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:28.057096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3632e057e1754741b8d7b11d998ed03a', 'request_id': 'req-ac902c06-31e5-4eeb-ae28-3718409db78d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:28.069562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] The token cache is being invalidate because project 3632e057e1754741b8d7b11d998ed03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:28.069934 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:28.070752 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ac902c06-31e5-4eeb-ae28-3718409db78d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:28.072426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1118/2273] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:27 2022] DELETE /identity/v3/projects/3632e057e1754741b8d7b11d998ed03a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:28.077809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7da6cf-9e2e-4172-976a-3d8c2f54a99a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:28.078711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7da6cf-9e2e-4172-976a-3d8c2f54a99a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:28.079400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7da6cf-9e2e-4172-976a-3d8c2f54a99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:28.108926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ad7da6cf-9e2e-4172-976a-3d8c2f54a99a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:28.110072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ad7da6cf-9e2e-4172-976a-3d8c2f54a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:28.126335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:28.192843 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1156/2274] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:28.201307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c357d9b-b1a0-423c-8640-bcd5394173fe None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:28.201593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c357d9b-b1a0-423c-8640-bcd5394173fe None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:28.201898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c357d9b-b1a0-423c-8640-bcd5394173fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:28.228412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3c357d9b-b1a0-423c-8640-bcd5394173fe None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:28.229814 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3c357d9b-b1a0-423c-8640-bcd5394173fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:28.240877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1119/2275] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:28.245245 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7da6cf-9e2e-4172-976a-3d8c2f54a99a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:28.258803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7da6cf-9e2e-4172-976a-3d8c2f54a99a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:28.264411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c1bf5-9a97-46df-b63b-05bf97114a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:28.265239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c1bf5-9a97-46df-b63b-05bf97114a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:28.265612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c1bf5-9a97-46df-b63b-05bf97114a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:28.265976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c1bf5-9a97-46df-b63b-05bf97114a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:28.266733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c1bf5-9a97-46df-b63b-05bf97114a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:28.267123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c1bf5-9a97-46df-b63b-05bf97114a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:28.268864 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c1bf5-9a97-46df-b63b-05bf97114a00 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:28.270259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c357d9b-b1a0-423c-8640-bcd5394173fe None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:28.272303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3c357d9b-b1a0-423c-8640-bcd5394173fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:28.286962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1157/2276] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:26:28.291045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c1bf5-9a97-46df-b63b-05bf97114a00 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:28.301212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c1bf5-9a97-46df-b63b-05bf97114a00 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:28.307407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f24bc-3da9-4fb9-a23e-f393b1683e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:28.308118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f24bc-3da9-4fb9-a23e-f393b1683e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:28.308462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f24bc-3da9-4fb9-a23e-f393b1683e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:28.308806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f24bc-3da9-4fb9-a23e-f393b1683e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:28.309494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f24bc-3da9-4fb9-a23e-f393b1683e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:28.311558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f24bc-3da9-4fb9-a23e-f393b1683e15 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:28.347954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1158/2277] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:28 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:26:28.350048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f24bc-3da9-4fb9-a23e-f393b1683e15 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:28.351735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c357d9b-b1a0-423c-8640-bcd5394173fe None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:28.421110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ffd43-5293-4a59-838c-fb303140bc81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:28.421794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ffd43-5293-4a59-838c-fb303140bc81 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:28.422088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ffd43-5293-4a59-838c-fb303140bc81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:28.422400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ffd43-5293-4a59-838c-fb303140bc81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:28.424359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c2ffd43-5293-4a59-838c-fb303140bc81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:28.444731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f24bc-3da9-4fb9-a23e-f393b1683e15 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:28.450637 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e733d-60c7-4068-8bea-0d5c38d5a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:28.451353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e733d-60c7-4068-8bea-0d5c38d5a241 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:28.451711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e733d-60c7-4068-8bea-0d5c38d5a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:28.452084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e733d-60c7-4068-8bea-0d5c38d5a241 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:28.452905 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e733d-60c7-4068-8bea-0d5c38d5a241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:28.455454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e733d-60c7-4068-8bea-0d5c38d5a241 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:28.502361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1159/2278] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:28 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:28.506707 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e733d-60c7-4068-8bea-0d5c38d5a241 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:28.519628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ffd43-5293-4a59-838c-fb303140bc81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:28.520716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e733d-60c7-4068-8bea-0d5c38d5a241 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:28.521381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ffd43-5293-4a59-838c-fb303140bc81 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:28.528334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b9a7b-b4a9-417d-9085-83bfd2cce9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:28.529200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9a7b-b4a9-417d-9085-83bfd2cce9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:28.529550 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9a7b-b4a9-417d-9085-83bfd2cce9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:28.529877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9a7b-b4a9-417d-9085-83bfd2cce9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:28.530535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b9a7b-b4a9-417d-9085-83bfd2cce9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:28.532191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b9a7b-b4a9-417d-9085-83bfd2cce9e4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:28.540327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1120/2279] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:26:28.544240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1160/2280] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:26:28.548441 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ffd43-5293-4a59-838c-fb303140bc81 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:28.559866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ffd43-5293-4a59-838c-fb303140bc81 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:28.567448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15077aab-198d-4bb5-b5fd-d2da8bb1e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:28.568175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15077aab-198d-4bb5-b5fd-d2da8bb1e60b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:28.568516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15077aab-198d-4bb5-b5fd-d2da8bb1e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:28.568848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15077aab-198d-4bb5-b5fd-d2da8bb1e60b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:28.569552 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15077aab-198d-4bb5-b5fd-d2da8bb1e60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:28.571724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15077aab-198d-4bb5-b5fd-d2da8bb1e60b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:28.584500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1121/2281] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:28.590520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b9a7b-b4a9-417d-9085-83bfd2cce9e4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:28.610135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b9a7b-b4a9-417d-9085-83bfd2cce9e4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:28.615678 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c001567-7232-4b36-af64-1460d1188243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:28.616486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c001567-7232-4b36-af64-1460d1188243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:28.617729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c001567-7232-4b36-af64-1460d1188243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:28.617729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c001567-7232-4b36-af64-1460d1188243 admin admin] PATH_INFO: `/v3/projects/03742c834726461ab43faa668d60bba7/users/03dbaac0a002444a83648889fb8153d6/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:28.638132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c001567-7232-4b36-af64-1460d1188243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03742c834726461ab43faa668d60bba7, user_id=03dbaac0a002444a83648889fb8153d6, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:28.640854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c001567-7232-4b36-af64-1460d1188243 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:28.655400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1161/2282] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:28 2022] PUT /identity/v3/projects/03742c834726461ab43faa668d60bba7/users/03dbaac0a002444a83648889fb8153d6/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:28.668881 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175266c6-11be-480d-9999-b0fc9d3d2f4a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:28.669249 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175266c6-11be-480d-9999-b0fc9d3d2f4a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:28.669593 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175266c6-11be-480d-9999-b0fc9d3d2f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:28.677902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:28.700564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-175266c6-11be-480d-9999-b0fc9d3d2f4a None None] MFA Rules not processed for user `03dbaac0a002444a83648889fb8153d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:28.701790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-175266c6-11be-480d-9999-b0fc9d3d2f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:28.767344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1122/2283] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:28.778642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c001567-7232-4b36-af64-1460d1188243 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:28.809121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:28.833069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c001567-7232-4b36-af64-1460d1188243 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:28.837417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678d178-db1d-4139-b838-4a415a4319c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:28.837931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678d178-db1d-4139-b838-4a415a4319c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:28.838208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678d178-db1d-4139-b838-4a415a4319c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:28.838479 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678d178-db1d-4139-b838-4a415a4319c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:28.846946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678d178-db1d-4139-b838-4a415a4319c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:28.848411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678d178-db1d-4139-b838-4a415a4319c7 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:28.858140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1162/2284] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:33.571864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175266c6-11be-480d-9999-b0fc9d3d2f4a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:33.573338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-175266c6-11be-480d-9999-b0fc9d3d2f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:33.642386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175266c6-11be-480d-9999-b0fc9d3d2f4a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:33.647139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:33.648429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:33.648707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:33.648982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] PATH_INFO: `/v3/users/0360fc9a5bcf4197b0f09b5c84ea0117` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:33.650100 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0360fc9a5bcf4197b0f09b5c84ea0117)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:33.652058 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:33.702079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0360fc9a5bcf4197b0f09b5c84ea0117'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:33.713790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0360fc9a5bcf4197b0f09b5c84ea0117'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:33.714529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0360fc9a5bcf4197b0f09b5c84ea0117'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:33.715396 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0360fc9a5bcf4197b0f09b5c84ea0117'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:33.723612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0360fc9a5bcf4197b0f09b5c84ea0117'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:33.744810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1123/2285] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:33 2022] DELETE /identity/v3/users/0360fc9a5bcf4197b0f09b5c84ea0117 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:33.746378 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cefd9-d4ac-45ca-89a0-1247ef289ef3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:33.746846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cefd9-d4ac-45ca-89a0-1247ef289ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:33.752650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cefd9-d4ac-45ca-89a0-1247ef289ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:33.780540 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-598cefd9-d4ac-45ca-89a0-1247ef289ef3 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:33.781935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-598cefd9-d4ac-45ca-89a0-1247ef289ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:33.867725 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1163/2286] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:33.878747 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:33.880275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:33.910266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:33.957703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdedad6-9c9f-4043-884d-8eca4595ab50 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:33.962388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84392ce-513a-4e4f-a122-39d0e1ddeee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:33.962998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84392ce-513a-4e4f-a122-39d0e1ddeee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:33.963273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84392ce-513a-4e4f-a122-39d0e1ddeee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:33.963545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84392ce-513a-4e4f-a122-39d0e1ddeee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:33.972921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84392ce-513a-4e4f-a122-39d0e1ddeee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:33.974343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84392ce-513a-4e4f-a122-39d0e1ddeee2 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:33.985422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1124/2287] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:34.425508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cefd9-d4ac-45ca-89a0-1247ef289ef3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:34.427032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-598cefd9-d4ac-45ca-89a0-1247ef289ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:34.439735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cefd9-d4ac-45ca-89a0-1247ef289ef3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:34.444360 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:34.445102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:34.445381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:34.445655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] PATH_INFO: `/v3/projects/5ab6bae972974a1abebfef49b31580e6` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:34.446772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab6bae972974a1abebfef49b31580e6)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:34.448706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:34.495178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab6bae972974a1abebfef49b31580e6', 'request_id': 'req-f995e4eb-e4f6-4866-b236-5394551c5713'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:34.501223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab6bae972974a1abebfef49b31580e6', 'request_id': 'req-f995e4eb-e4f6-4866-b236-5394551c5713'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:34.509038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab6bae972974a1abebfef49b31580e6', 'request_id': 'req-f995e4eb-e4f6-4866-b236-5394551c5713'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:34.521680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] The token cache is being invalidate because project 5ab6bae972974a1abebfef49b31580e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:34.521969 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:34.523126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:34.524634 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1164/2288] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:34 2022] DELETE /identity/v3/projects/5ab6bae972974a1abebfef49b31580e6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:34.529383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84392ce-513a-4e4f-a122-39d0e1ddeee2 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:34.539802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84392ce-513a-4e4f-a122-39d0e1ddeee2 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:34.598602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:34.599298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:34.599489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:34.599786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] PATH_INFO: `/v3/users/f763c6b699674f94b8cae63254cce8ba` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:34.601506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f763c6b699674f94b8cae63254cce8ba)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:34.603459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:34.657685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f763c6b699674f94b8cae63254cce8ba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:34.665745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f763c6b699674f94b8cae63254cce8ba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:34.666389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f763c6b699674f94b8cae63254cce8ba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:34.667003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f763c6b699674f94b8cae63254cce8ba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:34.674331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f763c6b699674f94b8cae63254cce8ba'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:34.691496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1125/2289] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:34 2022] DELETE /identity/v3/users/f763c6b699674f94b8cae63254cce8ba => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:34.975442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:34.977218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:34.990045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995e4eb-e4f6-4866-b236-5394551c5713 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:35.047450 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:35.056381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:35.057275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:35.057749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:35.058221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] PATH_INFO: `/v3/projects/9061a433e8d947568b727173ef830310` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:35.059451 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9061a433e8d947568b727173ef830310)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:35.061390 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:35.109198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9061a433e8d947568b727173ef830310', 'request_id': 'req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.115146 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9061a433e8d947568b727173ef830310', 'request_id': 'req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.124306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9061a433e8d947568b727173ef830310', 'request_id': 'req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.135860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] The token cache is being invalidate because project 9061a433e8d947568b727173ef830310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:35.136188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.136947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.140524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1165/2290] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:34 2022] DELETE /identity/v3/projects/9061a433e8d947568b727173ef830310 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:35.144411 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:35.145834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:35.159544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d71de-5f7a-4a34-8d30-58f1b4f29c01 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:35.207408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:35.244703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1538e2-c443-4d7e-8b85-b0a469e24968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:35.245516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1538e2-c443-4d7e-8b85-b0a469e24968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:35.245893 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1538e2-c443-4d7e-8b85-b0a469e24968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:35.246268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1538e2-c443-4d7e-8b85-b0a469e24968 admin admin] PATH_INFO: `/v3/users/084da32ee6e44de0bd26002cfb87f432` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:35.247548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1538e2-c443-4d7e-8b85-b0a469e24968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084da32ee6e44de0bd26002cfb87f432)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:35.251945 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1538e2-c443-4d7e-8b85-b0a469e24968 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:35.321799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea1538e2-c443-4d7e-8b85-b0a469e24968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084da32ee6e44de0bd26002cfb87f432'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.332271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea1538e2-c443-4d7e-8b85-b0a469e24968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084da32ee6e44de0bd26002cfb87f432'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.333174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea1538e2-c443-4d7e-8b85-b0a469e24968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084da32ee6e44de0bd26002cfb87f432'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.334165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea1538e2-c443-4d7e-8b85-b0a469e24968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084da32ee6e44de0bd26002cfb87f432'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.343109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ea1538e2-c443-4d7e-8b85-b0a469e24968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084da32ee6e44de0bd26002cfb87f432'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.361926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1126/2291] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:35 2022] DELETE /identity/v3/users/084da32ee6e44de0bd26002cfb87f432 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:35.754124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:35.755600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:35.779695 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c1419-9997-4aa9-a761-7b1034e7b6e4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:35.845150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:35.846001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:35.846280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:35.846559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] PATH_INFO: `/v3/projects/f831828100a84dd69ccd3144e2b2c057` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:35.847701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f831828100a84dd69ccd3144e2b2c057)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:35.849685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:35.913953 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f831828100a84dd69ccd3144e2b2c057', 'request_id': 'req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.921250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f831828100a84dd69ccd3144e2b2c057', 'request_id': 'req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.930874 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f831828100a84dd69ccd3144e2b2c057', 'request_id': 'req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.953312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] The token cache is being invalidate because project f831828100a84dd69ccd3144e2b2c057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:35.953611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.956771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2a9efbac-aaed-4f24-a003-5c8b41d8be4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:35.958277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1166/2292] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:35 2022] DELETE /identity/v3/projects/f831828100a84dd69ccd3144e2b2c057 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:35.967464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edfc73-f982-4068-8a5c-d3aeb40f0798 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:35.967990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edfc73-f982-4068-8a5c-d3aeb40f0798 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:35.968105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edfc73-f982-4068-8a5c-d3aeb40f0798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:35.988095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c4edfc73-f982-4068-8a5c-d3aeb40f0798 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:35.989298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c4edfc73-f982-4068-8a5c-d3aeb40f0798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:36.052198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1127/2293] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:36.062076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09cd18-bd49-43cb-a2ef-dfbb9429f32a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:36.062645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09cd18-bd49-43cb-a2ef-dfbb9429f32a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:36.062754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09cd18-bd49-43cb-a2ef-dfbb9429f32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:36.085679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1b09cd18-bd49-43cb-a2ef-dfbb9429f32a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:36.086903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1b09cd18-bd49-43cb-a2ef-dfbb9429f32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:36.094941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1167/2294] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:36.099071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edfc73-f982-4068-8a5c-d3aeb40f0798 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:36.109851 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edfc73-f982-4068-8a5c-d3aeb40f0798 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:36.114397 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e7b09-39fa-4bad-955f-6a39cd7ab0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:36.114991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e7b09-39fa-4bad-955f-6a39cd7ab0be admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:36.115269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e7b09-39fa-4bad-955f-6a39cd7ab0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:36.115543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e7b09-39fa-4bad-955f-6a39cd7ab0be admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:36.116702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e7b09-39fa-4bad-955f-6a39cd7ab0be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:36.117034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e7b09-39fa-4bad-955f-6a39cd7ab0be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:36.118799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e7b09-39fa-4bad-955f-6a39cd7ab0be admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:36.131047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1128/2295] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:26:36.136224 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09cd18-bd49-43cb-a2ef-dfbb9429f32a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:36.145948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09cd18-bd49-43cb-a2ef-dfbb9429f32a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:36.151563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fa4f2-76c5-4b17-ac0a-83b385d6de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:36.152282 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fa4f2-76c5-4b17-ac0a-83b385d6de27 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:36.152628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fa4f2-76c5-4b17-ac0a-83b385d6de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:36.152971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fa4f2-76c5-4b17-ac0a-83b385d6de27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:36.153667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fa4f2-76c5-4b17-ac0a-83b385d6de27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:36.155691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fa4f2-76c5-4b17-ac0a-83b385d6de27 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:36.162575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:36.191944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1168/2296] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:36 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:36.196854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e7b09-39fa-4bad-955f-6a39cd7ab0be admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:36.208138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e7b09-39fa-4bad-955f-6a39cd7ab0be admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:36.249385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:36.267477 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36118e1-cfec-4dec-a915-e5664b84940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:36.268279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36118e1-cfec-4dec-a915-e5664b84940f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:36.268731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36118e1-cfec-4dec-a915-e5664b84940f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:36.268995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36118e1-cfec-4dec-a915-e5664b84940f admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:36.269912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36118e1-cfec-4dec-a915-e5664b84940f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:36.271995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36118e1-cfec-4dec-a915-e5664b84940f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:36.296237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1129/2297] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:36 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:36.297449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fa4f2-76c5-4b17-ac0a-83b385d6de27 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:36.308685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fa4f2-76c5-4b17-ac0a-83b385d6de27 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:36.314119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55a773-3b19-4e8c-97ac-bcc4e1cc611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:36.314725 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55a773-3b19-4e8c-97ac-bcc4e1cc611c admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:36.315009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55a773-3b19-4e8c-97ac-bcc4e1cc611c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:36.315292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55a773-3b19-4e8c-97ac-bcc4e1cc611c admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:36.315991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55a773-3b19-4e8c-97ac-bcc4e1cc611c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:36.317781 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55a773-3b19-4e8c-97ac-bcc4e1cc611c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:36.333332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1169/2298] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:36.334323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36118e1-cfec-4dec-a915-e5664b84940f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:36.345055 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36118e1-cfec-4dec-a915-e5664b84940f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:36.350000 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a89d3-798b-40e6-b382-1c7e64a3bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:36.351351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a89d3-798b-40e6-b382-1c7e64a3bb06 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:36.351757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a89d3-798b-40e6-b382-1c7e64a3bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:36.352067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a89d3-798b-40e6-b382-1c7e64a3bb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:36.352708 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a89d3-798b-40e6-b382-1c7e64a3bb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:36.354428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a89d3-798b-40e6-b382-1c7e64a3bb06 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:36.365556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1130/2299] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:36.370376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55a773-3b19-4e8c-97ac-bcc4e1cc611c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:36.380532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55a773-3b19-4e8c-97ac-bcc4e1cc611c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:36.385671 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706cefe-0bd4-495d-a98f-0d42e1d0106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:36.386311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706cefe-0bd4-495d-a98f-0d42e1d0106c admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:36.386591 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706cefe-0bd4-495d-a98f-0d42e1d0106c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:36.386866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706cefe-0bd4-495d-a98f-0d42e1d0106c admin admin] PATH_INFO: `/v3/projects/083c9cee359c463394111c3fe6ecb51e/users/84e1e22f53f949e89659f56724d4c493/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:36.402388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706cefe-0bd4-495d-a98f-0d42e1d0106c admin admin] RBAC: Authorizing `identity:create_grant(project_id=083c9cee359c463394111c3fe6ecb51e, user_id=84e1e22f53f949e89659f56724d4c493, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:36.405090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706cefe-0bd4-495d-a98f-0d42e1d0106c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:36.419153 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1170/2300] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:36 2022] PUT /identity/v3/projects/083c9cee359c463394111c3fe6ecb51e/users/84e1e22f53f949e89659f56724d4c493/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:36.430136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0c9cd-f765-464d-b70c-a2a187c37068 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:36.430413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0c9cd-f765-464d-b70c-a2a187c37068 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:36.430706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0c9cd-f765-464d-b70c-a2a187c37068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:36.461716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-45f0c9cd-f765-464d-b70c-a2a187c37068 None None] MFA Rules not processed for user `84e1e22f53f949e89659f56724d4c493`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:36.462954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-45f0c9cd-f765-464d-b70c-a2a187c37068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:36.539716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1131/2301] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:36.561623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706cefe-0bd4-495d-a98f-0d42e1d0106c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:36.563602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1706cefe-0bd4-495d-a98f-0d42e1d0106c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:36.640787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706cefe-0bd4-495d-a98f-0d42e1d0106c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:36.644901 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8cdfd-7557-4a18-8da5-5d97f32cef57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:36.645604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8cdfd-7557-4a18-8da5-5d97f32cef57 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:36.645973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8cdfd-7557-4a18-8da5-5d97f32cef57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:36.646347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8cdfd-7557-4a18-8da5-5d97f32cef57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:36.659061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8cdfd-7557-4a18-8da5-5d97f32cef57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:36.660840 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8cdfd-7557-4a18-8da5-5d97f32cef57 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:36.672761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1171/2302] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:36.701993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0c9cd-f765-464d-b70c-a2a187c37068 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:36.800354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0c9cd-f765-464d-b70c-a2a187c37068 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:36.805911 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:36.806619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:36.806970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:36.807363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] PATH_INFO: `/v3/users/84e1e22f53f949e89659f56724d4c493` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:36.808627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e1e22f53f949e89659f56724d4c493)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:36.810735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:36.874372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e1e22f53f949e89659f56724d4c493'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:36.879208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:36.885655 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e1e22f53f949e89659f56724d4c493'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:36.886874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e1e22f53f949e89659f56724d4c493'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:36.887857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e1e22f53f949e89659f56724d4c493'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:36.896109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e1e22f53f949e89659f56724d4c493'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:36.917315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1132/2303] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:36 2022] DELETE /identity/v3/users/84e1e22f53f949e89659f56724d4c493 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:36.921634 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d5b8-0056-46d7-a325-5aea409564cb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:36.921939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d5b8-0056-46d7-a325-5aea409564cb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:36.922209 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d5b8-0056-46d7-a325-5aea409564cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:36.942087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cdb5d5b8-0056-46d7-a325-5aea409564cb None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:36.943290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cdb5d5b8-0056-46d7-a325-5aea409564cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:37.026577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1172/2304] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:37.036423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:37.037912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:37.098450 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db555c-663d-4084-b19f-b9a86aa59fcd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:37.107319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48a6fb-b535-4254-af35-9b2049d72404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:37.108082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48a6fb-b535-4254-af35-9b2049d72404 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:37.108367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48a6fb-b535-4254-af35-9b2049d72404 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:37.108646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48a6fb-b535-4254-af35-9b2049d72404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:37.118832 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48a6fb-b535-4254-af35-9b2049d72404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:37.120260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48a6fb-b535-4254-af35-9b2049d72404 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:37.129928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1133/2305] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:37.436007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5d5b8-0056-46d7-a325-5aea409564cb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:37.437586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cdb5d5b8-0056-46d7-a325-5aea409564cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:37.454056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5d5b8-0056-46d7-a325-5aea409564cb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:37.461033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:37.462111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:37.462451 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:37.462798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] PATH_INFO: `/v3/projects/083c9cee359c463394111c3fe6ecb51e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:37.464187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=083c9cee359c463394111c3fe6ecb51e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:37.466273 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:37.520404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083c9cee359c463394111c3fe6ecb51e', 'request_id': 'req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:37.521648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:37.529376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083c9cee359c463394111c3fe6ecb51e', 'request_id': 'req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:37.540988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083c9cee359c463394111c3fe6ecb51e', 'request_id': 'req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:37.555977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] The token cache is being invalidate because project 083c9cee359c463394111c3fe6ecb51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:37.556239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:37.556886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-2aa21cb7-1639-4ed6-9857-ce6a9c1485ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:37.558353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1173/2306] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:37 2022] DELETE /identity/v3/projects/083c9cee359c463394111c3fe6ecb51e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:37.563290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5a6f-288e-410f-b7bc-b80137144aba None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:37.563578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5a6f-288e-410f-b7bc-b80137144aba None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:37.563857 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f5a6f-288e-410f-b7bc-b80137144aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:37.584574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ca7f5a6f-288e-410f-b7bc-b80137144aba None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:37.586581 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ca7f5a6f-288e-410f-b7bc-b80137144aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:37.662751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1134/2307] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:37.671929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47709b-14c6-4f64-b1b6-964c21d728ac None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:37.672212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47709b-14c6-4f64-b1b6-964c21d728ac None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:37.672493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47709b-14c6-4f64-b1b6-964c21d728ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:37.691703 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fd47709b-14c6-4f64-b1b6-964c21d728ac None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:37.693139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fd47709b-14c6-4f64-b1b6-964c21d728ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:37.703701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1174/2308] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:37.709017 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f5a6f-288e-410f-b7bc-b80137144aba None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:37.719817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f5a6f-288e-410f-b7bc-b80137144aba None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:37.724570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1298b-0310-48fd-a30e-79a58487aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:37.725169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1298b-0310-48fd-a30e-79a58487aa58 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:37.725563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1298b-0310-48fd-a30e-79a58487aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:37.726340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1298b-0310-48fd-a30e-79a58487aa58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:37.726981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1298b-0310-48fd-a30e-79a58487aa58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:37.727282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1298b-0310-48fd-a30e-79a58487aa58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:37.728910 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1298b-0310-48fd-a30e-79a58487aa58 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:37.741026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1135/2309] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:26:37.745168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47709b-14c6-4f64-b1b6-964c21d728ac None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:37.754860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47709b-14c6-4f64-b1b6-964c21d728ac None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:37.760778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876c9d8-2e58-4ae1-8d2b-609b884f3044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:37.761631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876c9d8-2e58-4ae1-8d2b-609b884f3044 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:37.761965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876c9d8-2e58-4ae1-8d2b-609b884f3044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:37.762557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876c9d8-2e58-4ae1-8d2b-609b884f3044 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:37.763019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876c9d8-2e58-4ae1-8d2b-609b884f3044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:37.765000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876c9d8-2e58-4ae1-8d2b-609b884f3044 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:37.817571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1175/2310] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:37 2022] POST /identity/v3/projects => generated 399 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:37.822322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1298b-0310-48fd-a30e-79a58487aa58 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:37.846036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1298b-0310-48fd-a30e-79a58487aa58 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:37.922959 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e52ac-167f-48c4-b86d-57813fc9db57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:37.923836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e52ac-167f-48c4-b86d-57813fc9db57 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:37.924376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e52ac-167f-48c4-b86d-57813fc9db57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:37.924822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e52ac-167f-48c4-b86d-57813fc9db57 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:37.925711 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e52ac-167f-48c4-b86d-57813fc9db57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:37.927675 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e52ac-167f-48c4-b86d-57813fc9db57 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:37.940414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:37.978418 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1136/2311] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:37 2022] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:37.979780 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876c9d8-2e58-4ae1-8d2b-609b884f3044 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:37.990941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876c9d8-2e58-4ae1-8d2b-609b884f3044 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:37.996364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06307afd-5f01-4f0c-8f69-478b20ed7344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:37.996976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307afd-5f01-4f0c-8f69-478b20ed7344 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:37.997368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307afd-5f01-4f0c-8f69-478b20ed7344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:37.997650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307afd-5f01-4f0c-8f69-478b20ed7344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:37.998289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06307afd-5f01-4f0c-8f69-478b20ed7344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:37.999935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06307afd-5f01-4f0c-8f69-478b20ed7344 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:38.012859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1176/2312] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:38.016897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e52ac-167f-48c4-b86d-57813fc9db57 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:38.029470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e52ac-167f-48c4-b86d-57813fc9db57 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:38.057509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568a3b7-e321-415f-bf4a-bbf248db1aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:38.058434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568a3b7-e321-415f-bf4a-bbf248db1aff admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:38.058719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568a3b7-e321-415f-bf4a-bbf248db1aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:38.058996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568a3b7-e321-415f-bf4a-bbf248db1aff admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:38.061265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568a3b7-e321-415f-bf4a-bbf248db1aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:38.063211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568a3b7-e321-415f-bf4a-bbf248db1aff admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:38.076720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1137/2313] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:38.081684 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06307afd-5f01-4f0c-8f69-478b20ed7344 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:38.103079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06307afd-5f01-4f0c-8f69-478b20ed7344 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:38.109951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a2a4-825e-43ec-bc0f-72a487347454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:38.110633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a2a4-825e-43ec-bc0f-72a487347454 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:38.111030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a2a4-825e-43ec-bc0f-72a487347454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:38.111331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643a2a4-825e-43ec-bc0f-72a487347454 admin admin] PATH_INFO: `/v3/projects/cb2f0b7c4b0a4d3f9eb547d70071d8c3/users/cf2065d9f5024b3daa954c4db81c6d39/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:38.136577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643a2a4-825e-43ec-bc0f-72a487347454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2f0b7c4b0a4d3f9eb547d70071d8c3, user_id=cf2065d9f5024b3daa954c4db81c6d39, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:38.139454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643a2a4-825e-43ec-bc0f-72a487347454 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:38.156509 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1177/2314] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:38 2022] PUT /identity/v3/projects/cb2f0b7c4b0a4d3f9eb547d70071d8c3/users/cf2065d9f5024b3daa954c4db81c6d39/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:38.167211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba4b1a-aa3f-4938-9dff-76cec985f16d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:38.167495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba4b1a-aa3f-4938-9dff-76cec985f16d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:38.167770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba4b1a-aa3f-4938-9dff-76cec985f16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:38.199157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-33ba4b1a-aa3f-4938-9dff-76cec985f16d None None] MFA Rules not processed for user `cf2065d9f5024b3daa954c4db81c6d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:38.200394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-33ba4b1a-aa3f-4938-9dff-76cec985f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:38.267501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1138/2315] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:38.279966 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a2a4-825e-43ec-bc0f-72a487347454 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:38.281687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0643a2a4-825e-43ec-bc0f-72a487347454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:38.339306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643a2a4-825e-43ec-bc0f-72a487347454 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:38.342938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc8512-dca8-404f-aac9-5a53913fa10b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:38.343536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc8512-dca8-404f-aac9-5a53913fa10b service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:38.343812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc8512-dca8-404f-aac9-5a53913fa10b service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:38.344110 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc8512-dca8-404f-aac9-5a53913fa10b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:38.352886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc8512-dca8-404f-aac9-5a53913fa10b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:38.354306 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc8512-dca8-404f-aac9-5a53913fa10b service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:38.363156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1178/2316] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:38 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:41.556003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba4b1a-aa3f-4938-9dff-76cec985f16d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:41.558168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-33ba4b1a-aa3f-4938-9dff-76cec985f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:41.670392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba4b1a-aa3f-4938-9dff-76cec985f16d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:41.683364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:41.684144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:41.684697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:41.685022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] PATH_INFO: `/v3/users/03dbaac0a002444a83648889fb8153d6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:41.686303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=03dbaac0a002444a83648889fb8153d6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:41.688879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:41.767414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03dbaac0a002444a83648889fb8153d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:41.777889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03dbaac0a002444a83648889fb8153d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:41.780357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03dbaac0a002444a83648889fb8153d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:41.781106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03dbaac0a002444a83648889fb8153d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:41.806799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03dbaac0a002444a83648889fb8153d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:41.824209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:41.876721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1139/2317] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:41 2022] DELETE /identity/v3/users/03dbaac0a002444a83648889fb8153d6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:41.881035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a5239-9985-409b-b965-3f3b54d0a534 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:41.882058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a5239-9985-409b-b965-3f3b54d0a534 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:41.882858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a5239-9985-409b-b965-3f3b54d0a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:41.934219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7a6a5239-9985-409b-b965-3f3b54d0a534 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:41.935624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7a6a5239-9985-409b-b965-3f3b54d0a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:42.049802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1179/2318] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:42.060529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:42.062022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:42.139211 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582c23-1b89-42f2-8c11-b6728dd684ea admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:42.143016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fed6db-0273-4053-bf11-bf9062081333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:42.143549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed6db-0273-4053-bf11-bf9062081333 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:42.143823 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed6db-0273-4053-bf11-bf9062081333 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:42.144121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed6db-0273-4053-bf11-bf9062081333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:42.155706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fed6db-0273-4053-bf11-bf9062081333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:42.157165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fed6db-0273-4053-bf11-bf9062081333 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:42.192124 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1140/2319] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:42.688188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a5239-9985-409b-b965-3f3b54d0a534 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:42.689916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7a6a5239-9985-409b-b965-3f3b54d0a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:42.705130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a5239-9985-409b-b965-3f3b54d0a534 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:42.711732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:42.712436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:42.712717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:42.712994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] PATH_INFO: `/v3/projects/03742c834726461ab43faa668d60bba7` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:42.715034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03742c834726461ab43faa668d60bba7)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:42.717602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:42.733745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:42.775205 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03742c834726461ab43faa668d60bba7', 'request_id': 'req-50ea4589-2ccb-490e-abba-c1dd6dd53749'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:42.782881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03742c834726461ab43faa668d60bba7', 'request_id': 'req-50ea4589-2ccb-490e-abba-c1dd6dd53749'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:42.797838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03742c834726461ab43faa668d60bba7', 'request_id': 'req-50ea4589-2ccb-490e-abba-c1dd6dd53749'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:42.810656 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] The token cache is being invalidate because project 03742c834726461ab43faa668d60bba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:42.810877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:42.811524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-50ea4589-2ccb-490e-abba-c1dd6dd53749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:42.813293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1180/2320] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:42 2022] DELETE /identity/v3/projects/03742c834726461ab43faa668d60bba7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:42.819641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028b1c0-cd62-4be3-b330-de4eaecad1a1 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:42.820244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028b1c0-cd62-4be3-b330-de4eaecad1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:42.820244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028b1c0-cd62-4be3-b330-de4eaecad1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:42.845639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3028b1c0-cd62-4be3-b330-de4eaecad1a1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:42.846884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3028b1c0-cd62-4be3-b330-de4eaecad1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:42.909037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1141/2321] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:42.917499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece5875-d128-4682-8b59-7bf0a1a657dd None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:42.918064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece5875-d128-4682-8b59-7bf0a1a657dd None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:42.918182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece5875-d128-4682-8b59-7bf0a1a657dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:42.940114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1ece5875-d128-4682-8b59-7bf0a1a657dd None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:42.941539 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1ece5875-d128-4682-8b59-7bf0a1a657dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:42.950463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1181/2322] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:42.954666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028b1c0-cd62-4be3-b330-de4eaecad1a1 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:42.965504 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028b1c0-cd62-4be3-b330-de4eaecad1a1 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:42.970150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a6593-b7e6-4301-8b9c-6319ad58b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:42.970751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a6593-b7e6-4301-8b9c-6319ad58b05a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:42.971029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a6593-b7e6-4301-8b9c-6319ad58b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:42.971300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a6593-b7e6-4301-8b9c-6319ad58b05a admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:42.972021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a6593-b7e6-4301-8b9c-6319ad58b05a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:42.972328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a6593-b7e6-4301-8b9c-6319ad58b05a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:42.973975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a6593-b7e6-4301-8b9c-6319ad58b05a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:42.994391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1142/2323] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:26:42.998747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece5875-d128-4682-8b59-7bf0a1a657dd None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:43.009385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece5875-d128-4682-8b59-7bf0a1a657dd None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:43.014491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efda94-f824-4bc4-b007-7f46f0dd1809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:43.015097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efda94-f824-4bc4-b007-7f46f0dd1809 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:43.015379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efda94-f824-4bc4-b007-7f46f0dd1809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:43.015653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efda94-f824-4bc4-b007-7f46f0dd1809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:43.016311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efda94-f824-4bc4-b007-7f46f0dd1809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:43.018455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efda94-f824-4bc4-b007-7f46f0dd1809 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:43.058987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1182/2324] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:42 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:43.060432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a6593-b7e6-4301-8b9c-6319ad58b05a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:43.070695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a6593-b7e6-4301-8b9c-6319ad58b05a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:43.133279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fcc68-0ac7-4442-a80d-74d1cf465326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:43.133879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fcc68-0ac7-4442-a80d-74d1cf465326 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:43.134153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fcc68-0ac7-4442-a80d-74d1cf465326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:43.134424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fcc68-0ac7-4442-a80d-74d1cf465326 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:43.135043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fcc68-0ac7-4442-a80d-74d1cf465326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:43.137050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fcc68-0ac7-4442-a80d-74d1cf465326 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:43.164692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1143/2325] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:43 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:26:43.165927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efda94-f824-4bc4-b007-7f46f0dd1809 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:43.177052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efda94-f824-4bc4-b007-7f46f0dd1809 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:43.182110 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e2901-5e18-463c-a304-c26f3da13809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:43.182748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e2901-5e18-463c-a304-c26f3da13809 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:43.183027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e2901-5e18-463c-a304-c26f3da13809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:43.183300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e2901-5e18-463c-a304-c26f3da13809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:43.184003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e2901-5e18-463c-a304-c26f3da13809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:43.185624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e2901-5e18-463c-a304-c26f3da13809 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:43.196409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1183/2326] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:26:43.200738 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fcc68-0ac7-4442-a80d-74d1cf465326 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:43.211185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fcc68-0ac7-4442-a80d-74d1cf465326 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:43.222269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee02776-b467-4d3e-975a-4865beb41f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:43.222933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02776-b467-4d3e-975a-4865beb41f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:43.223210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02776-b467-4d3e-975a-4865beb41f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:43.223482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee02776-b467-4d3e-975a-4865beb41f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:43.224544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee02776-b467-4d3e-975a-4865beb41f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:43.227011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee02776-b467-4d3e-975a-4865beb41f3f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:43.228634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:43.248032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1144/2327] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:43.251418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e2901-5e18-463c-a304-c26f3da13809 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:43.267875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e2901-5e18-463c-a304-c26f3da13809 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:43.273185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19f415-20ae-4c8a-800f-953db90e1337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:43.274102 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f415-20ae-4c8a-800f-953db90e1337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:43.274384 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f415-20ae-4c8a-800f-953db90e1337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:43.274664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f415-20ae-4c8a-800f-953db90e1337 admin admin] PATH_INFO: `/v3/projects/366c4f65c9774d4c9096eb4c2be08aa3/users/87bfa5ffd791423db5bd287e57318eb9/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:43.292181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19f415-20ae-4c8a-800f-953db90e1337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=366c4f65c9774d4c9096eb4c2be08aa3, user_id=87bfa5ffd791423db5bd287e57318eb9, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:43.295156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19f415-20ae-4c8a-800f-953db90e1337 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:43.310303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1184/2328] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:43 2022] PUT /identity/v3/projects/366c4f65c9774d4c9096eb4c2be08aa3/users/87bfa5ffd791423db5bd287e57318eb9/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:43.315361 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01410570-6686-4ad0-852e-fd106a98b13e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:43.315743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01410570-6686-4ad0-852e-fd106a98b13e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:43.315972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01410570-6686-4ad0-852e-fd106a98b13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:43.342998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-01410570-6686-4ad0-852e-fd106a98b13e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:43.344752 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-01410570-6686-4ad0-852e-fd106a98b13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:43.431785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d12775-0246-4eab-a735-025643b5bfe7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:43.432111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d12775-0246-4eab-a735-025643b5bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:43.432388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d12775-0246-4eab-a735-025643b5bfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:43.442839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1145/2329] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:43.453529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01410570-6686-4ad0-852e-fd106a98b13e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:43.453831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-40d12775-0246-4eab-a735-025643b5bfe7 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:43.455318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-40d12775-0246-4eab-a735-025643b5bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:43.455739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-01410570-6686-4ad0-852e-fd106a98b13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:43.516143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1185/2330] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:26:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:26:43.520620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01410570-6686-4ad0-852e-fd106a98b13e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:43.525620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cdb75-ae5c-4bb1-9355-0df7fc2ab90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:43.526154 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cdb75-ae5c-4bb1-9355-0df7fc2ab90d service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:43.526529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cdb75-ae5c-4bb1-9355-0df7fc2ab90d service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:43.526806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cdb75-ae5c-4bb1-9355-0df7fc2ab90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:43.541125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cdb75-ae5c-4bb1-9355-0df7fc2ab90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:43.542256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cdb75-ae5c-4bb1-9355-0df7fc2ab90d service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:43.556079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1146/2331] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:26:43.565009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d12775-0246-4eab-a735-025643b5bfe7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:43.566328 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-40d12775-0246-4eab-a735-025643b5bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:43.620082 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:43.649533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d12775-0246-4eab-a735-025643b5bfe7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:43.655096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475a3da-1618-4f93-9dec-e1ff5fb413c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:43.655856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475a3da-1618-4f93-9dec-e1ff5fb413c2 service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:43.656208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475a3da-1618-4f93-9dec-e1ff5fb413c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:43.656572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475a3da-1618-4f93-9dec-e1ff5fb413c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:43.666397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475a3da-1618-4f93-9dec-e1ff5fb413c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:43.668128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475a3da-1618-4f93-9dec-e1ff5fb413c2 service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:43.676544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1186/2332] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:26:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:26:45.774273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cdb75-ae5c-4bb1-9355-0df7fc2ab90d service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:45.776207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a62cdb75-ae5c-4bb1-9355-0df7fc2ab90d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:45.814023 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cdb75-ae5c-4bb1-9355-0df7fc2ab90d service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:45.836550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:45.838698 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:45.838990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:45.840619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] PATH_INFO: `/v3/users/cf2065d9f5024b3daa954c4db81c6d39` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:45.845273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2065d9f5024b3daa954c4db81c6d39)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:45.849887 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:45.951599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2065d9f5024b3daa954c4db81c6d39'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:45.971302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2065d9f5024b3daa954c4db81c6d39'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:45.972602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2065d9f5024b3daa954c4db81c6d39'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:45.973298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2065d9f5024b3daa954c4db81c6d39'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:45.982183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2065d9f5024b3daa954c4db81c6d39'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:46.003620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1147/2333] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:45 2022] DELETE /identity/v3/users/cf2065d9f5024b3daa954c4db81c6d39 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:46.008300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea1c2a-174d-44ce-ac6f-faec0c4b8f33 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:46.008896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea1c2a-174d-44ce-ac6f-faec0c4b8f33 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:46.008896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea1c2a-174d-44ce-ac6f-faec0c4b8f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:46.049518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-59ea1c2a-174d-44ce-ac6f-faec0c4b8f33 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:46.051691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-59ea1c2a-174d-44ce-ac6f-faec0c4b8f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:46.224121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1187/2334] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:46.238457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:46.241804 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:46.270204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:46.372441 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f53f4-d578-4540-b33f-f2ac701fa80e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:46.382483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562deb9e-3e6d-4e09-a1e8-b06be301e9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:46.383122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562deb9e-3e6d-4e09-a1e8-b06be301e9cb service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:46.383402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562deb9e-3e6d-4e09-a1e8-b06be301e9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:46.383676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562deb9e-3e6d-4e09-a1e8-b06be301e9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:46.418456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562deb9e-3e6d-4e09-a1e8-b06be301e9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:46.419979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562deb9e-3e6d-4e09-a1e8-b06be301e9cb service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:46.447700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1148/2335] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:47.061711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea1c2a-174d-44ce-ac6f-faec0c4b8f33 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:47.063249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-59ea1c2a-174d-44ce-ac6f-faec0c4b8f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:47.092904 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea1c2a-174d-44ce-ac6f-faec0c4b8f33 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:47.108761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:47.110046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:47.110522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:47.110967 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] PATH_INFO: `/v3/projects/cb2f0b7c4b0a4d3f9eb547d70071d8c3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:47.112335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2f0b7c4b0a4d3f9eb547d70071d8c3)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:47.118921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:47.205446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2f0b7c4b0a4d3f9eb547d70071d8c3', 'request_id': 'req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:47.214201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2f0b7c4b0a4d3f9eb547d70071d8c3', 'request_id': 'req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:47.224134 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2f0b7c4b0a4d3f9eb547d70071d8c3', 'request_id': 'req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:47.239866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] The token cache is being invalidate because project cb2f0b7c4b0a4d3f9eb547d70071d8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:47.240161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:47.241616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9b66f764-6c61-4ac9-90dc-ab20673f2e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:47.247584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1188/2336] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:47 2022] DELETE /identity/v3/projects/cb2f0b7c4b0a4d3f9eb547d70071d8c3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:47.249563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4d70-06ed-489d-8c66-cf7f6a6a3382 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:47.250078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4d70-06ed-489d-8c66-cf7f6a6a3382 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:47.250078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff4d70-06ed-489d-8c66-cf7f6a6a3382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:47.273510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-89ff4d70-06ed-489d-8c66-cf7f6a6a3382 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:47.275474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-89ff4d70-06ed-489d-8c66-cf7f6a6a3382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:47.385576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1149/2337] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:47.400968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f9fa7-73cc-4a61-a363-18933201ad34 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:47.401260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f9fa7-73cc-4a61-a363-18933201ad34 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:47.401565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f9fa7-73cc-4a61-a363-18933201ad34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:47.460636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-407f9fa7-73cc-4a61-a363-18933201ad34 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:47.462121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-407f9fa7-73cc-4a61-a363-18933201ad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:47.475289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1189/2338] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:47.480152 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4d70-06ed-489d-8c66-cf7f6a6a3382 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:47.492033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff4d70-06ed-489d-8c66-cf7f6a6a3382 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:47.497277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0430964-80ea-4b06-9c98-7ac5856a19d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:47.497954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430964-80ea-4b06-9c98-7ac5856a19d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:47.498243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430964-80ea-4b06-9c98-7ac5856a19d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:47.498558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430964-80ea-4b06-9c98-7ac5856a19d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:47.499324 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0430964-80ea-4b06-9c98-7ac5856a19d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:26:47.499666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0430964-80ea-4b06-9c98-7ac5856a19d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:47.501638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0430964-80ea-4b06-9c98-7ac5856a19d1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:47.516866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1150/2339] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:26:47.521828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f9fa7-73cc-4a61-a363-18933201ad34 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:47.532413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f9fa7-73cc-4a61-a363-18933201ad34 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:47.538613 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8673b-88d5-4247-96b9-2ce0b0e6d149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:47.539200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8673b-88d5-4247-96b9-2ce0b0e6d149 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:47.539486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8673b-88d5-4247-96b9-2ce0b0e6d149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:47.539933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8673b-88d5-4247-96b9-2ce0b0e6d149 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:47.540491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8673b-88d5-4247-96b9-2ce0b0e6d149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:47.542473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8673b-88d5-4247-96b9-2ce0b0e6d149 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:47.605764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0430964-80ea-4b06-9c98-7ac5856a19d1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:47.616804 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1190/2340] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:47 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:47.620238 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0430964-80ea-4b06-9c98-7ac5856a19d1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:47.713382 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4858120-a660-480f-adeb-8bbc18f99441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:47.714119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4858120-a660-480f-adeb-8bbc18f99441 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:47.714447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4858120-a660-480f-adeb-8bbc18f99441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:47.714876 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4858120-a660-480f-adeb-8bbc18f99441 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:47.715352 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4858120-a660-480f-adeb-8bbc18f99441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:47.718161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4858120-a660-480f-adeb-8bbc18f99441 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:47.753636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1151/2341] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:47 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:47.758113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8673b-88d5-4247-96b9-2ce0b0e6d149 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:47.798478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8673b-88d5-4247-96b9-2ce0b0e6d149 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:47.808915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c19d1-dfd7-49d2-b235-fa0727175ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:47.809619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c19d1-dfd7-49d2-b235-fa0727175ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:47.809856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c19d1-dfd7-49d2-b235-fa0727175ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:47.810149 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c19d1-dfd7-49d2-b235-fa0727175ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:47.811533 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c19d1-dfd7-49d2-b235-fa0727175ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:47.814062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c19d1-dfd7-49d2-b235-fa0727175ef7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:47.832521 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1191/2342] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:47.833793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4858120-a660-480f-adeb-8bbc18f99441 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:47.847841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4858120-a660-480f-adeb-8bbc18f99441 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:47.860920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115d714-cf5a-4afa-8e4a-73765983fc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:47.861819 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115d714-cf5a-4afa-8e4a-73765983fc06 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:47.862260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115d714-cf5a-4afa-8e4a-73765983fc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:47.862788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115d714-cf5a-4afa-8e4a-73765983fc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:47.863543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115d714-cf5a-4afa-8e4a-73765983fc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:47.868477 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115d714-cf5a-4afa-8e4a-73765983fc06 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:47.895024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1152/2343] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:47.905676 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c19d1-dfd7-49d2-b235-fa0727175ef7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:47.963965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c19d1-dfd7-49d2-b235-fa0727175ef7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:47.978158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c12075-4c3a-43a3-ab9a-4d9cf4b2c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:47.979111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c12075-4c3a-43a3-ab9a-4d9cf4b2c619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:47.979615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c12075-4c3a-43a3-ab9a-4d9cf4b2c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:47.980115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c12075-4c3a-43a3-ab9a-4d9cf4b2c619 admin admin] PATH_INFO: `/v3/projects/40e4cec50cb849fe9b9ea8b192c69f18/users/03b0ac401fa24aab91f20aaf08c44679/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:48.014350 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:48.020472 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c12075-4c3a-43a3-ab9a-4d9cf4b2c619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e4cec50cb849fe9b9ea8b192c69f18, user_id=03b0ac401fa24aab91f20aaf08c44679, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:48.032279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c12075-4c3a-43a3-ab9a-4d9cf4b2c619 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:48.063362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1192/2344] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:47 2022] PUT /identity/v3/projects/40e4cec50cb849fe9b9ea8b192c69f18/users/03b0ac401fa24aab91f20aaf08c44679/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:48.067720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c31f-21f4-458c-a3ea-ef775c370659 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:48.068034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c31f-21f4-458c-a3ea-ef775c370659 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:48.068298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c31f-21f4-458c-a3ea-ef775c370659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:48.096562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8246c31f-21f4-458c-a3ea-ef775c370659 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:48.097920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8246c31f-21f4-458c-a3ea-ef775c370659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:48.134383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:48.242911 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1153/2345] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:48.260409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c12075-4c3a-43a3-ab9a-4d9cf4b2c619 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:48.263460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f3c12075-4c3a-43a3-ab9a-4d9cf4b2c619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:48.424508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c12075-4c3a-43a3-ab9a-4d9cf4b2c619 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:48.445833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3637c61-43c3-45d1-81a1-479e94cc74ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:48.448926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3637c61-43c3-45d1-81a1-479e94cc74ea service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:48.449218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3637c61-43c3-45d1-81a1-479e94cc74ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:48.452410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3637c61-43c3-45d1-81a1-479e94cc74ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:48.490689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3637c61-43c3-45d1-81a1-479e94cc74ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:48.494598 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3637c61-43c3-45d1-81a1-479e94cc74ea service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:48.557244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1193/2346] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:50.838617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246c31f-21f4-458c-a3ea-ef775c370659 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:50.840466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8246c31f-21f4-458c-a3ea-ef775c370659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:50.880632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246c31f-21f4-458c-a3ea-ef775c370659 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:50.890271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d055664-555c-4649-a237-49b2aa541bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:50.891259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d055664-555c-4649-a237-49b2aa541bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:50.891702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d055664-555c-4649-a237-49b2aa541bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:50.892034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d055664-555c-4649-a237-49b2aa541bf6 admin admin] PATH_INFO: `/v3/users/1b1a871cb10a45a6bda0f00321e4ce82` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:50.893342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d055664-555c-4649-a237-49b2aa541bf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1a871cb10a45a6bda0f00321e4ce82)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:50.901017 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d055664-555c-4649-a237-49b2aa541bf6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:50.973980 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605d943-a38d-4431-94fb-8dcd3a3544a9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:50.975039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605d943-a38d-4431-94fb-8dcd3a3544a9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:50.975784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605d943-a38d-4431-94fb-8dcd3a3544a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:51.007543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d055664-555c-4649-a237-49b2aa541bf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1a871cb10a45a6bda0f00321e4ce82'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:51.026451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d055664-555c-4649-a237-49b2aa541bf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1a871cb10a45a6bda0f00321e4ce82'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:51.028411 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d055664-555c-4649-a237-49b2aa541bf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1a871cb10a45a6bda0f00321e4ce82'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:51.028961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d055664-555c-4649-a237-49b2aa541bf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1a871cb10a45a6bda0f00321e4ce82'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:51.037810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f605d943-a38d-4431-94fb-8dcd3a3544a9 None None] MFA Rules not processed for user `87bfa5ffd791423db5bd287e57318eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:51.039336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f605d943-a38d-4431-94fb-8dcd3a3544a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:51.043090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2d055664-555c-4649-a237-49b2aa541bf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1a871cb10a45a6bda0f00321e4ce82'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:51.095481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1154/2347] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:26:50 2022] DELETE /identity/v3/users/1b1a871cb10a45a6bda0f00321e4ce82 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:51.097849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5248ed7-b055-4035-ae0c-ebd6c74fb830 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:51.098135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5248ed7-b055-4035-ae0c-ebd6c74fb830 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:51.098410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5248ed7-b055-4035-ae0c-ebd6c74fb830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:51.144798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f5248ed7-b055-4035-ae0c-ebd6c74fb830 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:51.146993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f5248ed7-b055-4035-ae0c-ebd6c74fb830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:51.158812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1194/2348] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:51.165461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605d943-a38d-4431-94fb-8dcd3a3544a9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:51.167666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f605d943-a38d-4431-94fb-8dcd3a3544a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:51.185834 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605d943-a38d-4431-94fb-8dcd3a3544a9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:51.293359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1155/2349] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:51.307005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5248ed7-b055-4035-ae0c-ebd6c74fb830 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:51.308572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f5248ed7-b055-4035-ae0c-ebd6c74fb830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:51.382765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fe72-61dd-4718-995e-acfcac8e56b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:51.383693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fe72-61dd-4718-995e-acfcac8e56b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:51.384317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fe72-61dd-4718-995e-acfcac8e56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:51.384777 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fe72-61dd-4718-995e-acfcac8e56b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:51.385581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73fe72-61dd-4718-995e-acfcac8e56b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:51.388505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73fe72-61dd-4718-995e-acfcac8e56b7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:51.480582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:51.503285 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1195/2350] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:51 2022] POST /identity/v3/projects => generated 373 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:51.504594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fe72-61dd-4718-995e-acfcac8e56b7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:51.525994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5248ed7-b055-4035-ae0c-ebd6c74fb830 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:51.528161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:51.664675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fe72-61dd-4718-995e-acfcac8e56b7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:51.675318 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1adfc8-3383-4947-a077-dec341382a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:51.676293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1adfc8-3383-4947-a077-dec341382a91 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:51.676673 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1adfc8-3383-4947-a077-dec341382a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:51.677085 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1adfc8-3383-4947-a077-dec341382a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:51.680166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d29fd-8d1f-4677-9970-f069f9f038f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:51.680982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d29fd-8d1f-4677-9970-f069f9f038f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:51.681404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d29fd-8d1f-4677-9970-f069f9f038f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:51.681831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d29fd-8d1f-4677-9970-f069f9f038f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:51.682825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d29fd-8d1f-4677-9970-f069f9f038f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:51.685132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d29fd-8d1f-4677-9970-f069f9f038f7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:51.718652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1adfc8-3383-4947-a077-dec341382a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:51.720277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1adfc8-3383-4947-a077-dec341382a91 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:51.732039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1196/2351] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:51 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:51.737508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d29fd-8d1f-4677-9970-f069f9f038f7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:51.743196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1156/2352] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:26:51.784578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d29fd-8d1f-4677-9970-f069f9f038f7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:51.807274 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413dad2-529e-4b4a-bd42-4a74b90cbe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:51.808354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413dad2-529e-4b4a-bd42-4a74b90cbe88 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:51.808643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413dad2-529e-4b4a-bd42-4a74b90cbe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:51.809559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413dad2-529e-4b4a-bd42-4a74b90cbe88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:51.810214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413dad2-529e-4b4a-bd42-4a74b90cbe88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:51.819620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413dad2-529e-4b4a-bd42-4a74b90cbe88 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:51.854216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1197/2353] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:51.860032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1adfc8-3383-4947-a077-dec341382a91 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:51.882802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1adfc8-3383-4947-a077-dec341382a91 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:51.901424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013091e-4ff7-4fa9-99aa-08fe8dc3fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:51.904689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013091e-4ff7-4fa9-99aa-08fe8dc3fc25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:51.908914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013091e-4ff7-4fa9-99aa-08fe8dc3fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:51.908914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013091e-4ff7-4fa9-99aa-08fe8dc3fc25 admin admin] PATH_INFO: `/v3/projects/71d269e4a52c4678a709406852a69af7/users/166c6d488fa548dd93e778e9e4804270/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:51.969194 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013091e-4ff7-4fa9-99aa-08fe8dc3fc25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d269e4a52c4678a709406852a69af7, user_id=166c6d488fa548dd93e778e9e4804270, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:51.972269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013091e-4ff7-4fa9-99aa-08fe8dc3fc25 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:52.000165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1157/2354] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:51 2022] PUT /identity/v3/projects/71d269e4a52c4678a709406852a69af7/users/166c6d488fa548dd93e778e9e4804270/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:52.004156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413dad2-529e-4b4a-bd42-4a74b90cbe88 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:52.017132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413dad2-529e-4b4a-bd42-4a74b90cbe88 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:52.196296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333a0b0-632b-43e1-80b7-922e23322799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:52.197706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333a0b0-632b-43e1-80b7-922e23322799 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:52.198174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333a0b0-632b-43e1-80b7-922e23322799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:52.198626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333a0b0-632b-43e1-80b7-922e23322799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:52.199809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333a0b0-632b-43e1-80b7-922e23322799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:52.202034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333a0b0-632b-43e1-80b7-922e23322799 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:52.229545 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1198/2355] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:52.233865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013091e-4ff7-4fa9-99aa-08fe8dc3fc25 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:52.263484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013091e-4ff7-4fa9-99aa-08fe8dc3fc25 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:52.282333 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81c888-6c4c-4486-b0c7-e5d9c8199b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:52.283012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81c888-6c4c-4486-b0c7-e5d9c8199b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:52.283292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81c888-6c4c-4486-b0c7-e5d9c8199b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:52.283571 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81c888-6c4c-4486-b0c7-e5d9c8199b30 admin admin] PATH_INFO: `/v3/projects/71d269e4a52c4678a709406852a69af7/users/166c6d488fa548dd93e778e9e4804270/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:52.294270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81c888-6c4c-4486-b0c7-e5d9c8199b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d269e4a52c4678a709406852a69af7, user_id=166c6d488fa548dd93e778e9e4804270, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:52.302968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81c888-6c4c-4486-b0c7-e5d9c8199b30 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:52.358319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1158/2356] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:52 2022] PUT /identity/v3/projects/71d269e4a52c4678a709406852a69af7/users/166c6d488fa548dd93e778e9e4804270/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:52.637100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333a0b0-632b-43e1-80b7-922e23322799 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:52.640227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b333a0b0-632b-43e1-80b7-922e23322799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:52.675522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333a0b0-632b-43e1-80b7-922e23322799 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:52.778249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:52.778913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:52.779190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:52.780181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] PATH_INFO: `/v3/projects/e6f49630255c4c469b653fc788d29ffa` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:52.781024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f49630255c4c469b653fc788d29ffa)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:52.783276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:52.846018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:52.913456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f49630255c4c469b653fc788d29ffa', 'request_id': 'req-f107f6ab-7766-4ca7-80b3-23a797196c43'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:52.925873 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f49630255c4c469b653fc788d29ffa', 'request_id': 'req-f107f6ab-7766-4ca7-80b3-23a797196c43'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:52.942375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f49630255c4c469b653fc788d29ffa', 'request_id': 'req-f107f6ab-7766-4ca7-80b3-23a797196c43'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:52.971889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] The token cache is being invalidate because project e6f49630255c4c469b653fc788d29ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:26:52.972252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:52.973088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f107f6ab-7766-4ca7-80b3-23a797196c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:26:52.978082 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1199/2357] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:26:52 2022] DELETE /identity/v3/projects/e6f49630255c4c469b653fc788d29ffa => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:26:54.702473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbf5ad-b23b-41ec-9606-5d27049e4ddf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:54.703016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbf5ad-b23b-41ec-9606-5d27049e4ddf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:54.703016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbf5ad-b23b-41ec-9606-5d27049e4ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:54.736451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-27dbf5ad-b23b-41ec-9606-5d27049e4ddf None None] MFA Rules not processed for user `2846f016f36f4c61a6ec959478f2dcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:54.745647 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-27dbf5ad-b23b-41ec-9606-5d27049e4ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:54.901181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1159/2358] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:58.780132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561640a-deb0-4e94-93c3-77d6e8be8063 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:58.780671 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561640a-deb0-4e94-93c3-77d6e8be8063 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:58.780860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561640a-deb0-4e94-93c3-77d6e8be8063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:58.844538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0561640a-deb0-4e94-93c3-77d6e8be8063 None None] MFA Rules not processed for user `03b0ac401fa24aab91f20aaf08c44679`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:26:58.845765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0561640a-deb0-4e94-93c3-77d6e8be8063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:58.990863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1200/2359] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:26:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:26:58.995341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbf5ad-b23b-41ec-9606-5d27049e4ddf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:58.999171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-27dbf5ad-b23b-41ec-9606-5d27049e4ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:26:59.268500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbf5ad-b23b-41ec-9606-5d27049e4ddf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:59.279483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9527d19-06b1-4509-9597-394528fa942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:59.280339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9527d19-06b1-4509-9597-394528fa942a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:59.284103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9527d19-06b1-4509-9597-394528fa942a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:59.284504 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9527d19-06b1-4509-9597-394528fa942a admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:59.285359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9527d19-06b1-4509-9597-394528fa942a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:59.288119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9527d19-06b1-4509-9597-394528fa942a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:59.304326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:26:59.379541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1160/2360] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:26:58 2022] POST /identity/v3/projects => generated 383 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:59.382151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561640a-deb0-4e94-93c3-77d6e8be8063 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:59.400004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561640a-deb0-4e94-93c3-77d6e8be8063 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:59.573076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664054-96f1-43e2-a170-78e10db49f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:59.574237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664054-96f1-43e2-a170-78e10db49f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:59.575003 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664054-96f1-43e2-a170-78e10db49f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:59.575468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664054-96f1-43e2-a170-78e10db49f44 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:59.579566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16664054-96f1-43e2-a170-78e10db49f44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:59.586009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16664054-96f1-43e2-a170-78e10db49f44 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:59.640179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1201/2361] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:26:59 2022] POST /identity/v3/users => generated 298 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:26:59.644184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9527d19-06b1-4509-9597-394528fa942a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:59.659753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9527d19-06b1-4509-9597-394528fa942a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:59.671680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d78270-9d9e-48ca-8789-c0b8c8867c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:59.673699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d78270-9d9e-48ca-8789-c0b8c8867c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:59.678615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d78270-9d9e-48ca-8789-c0b8c8867c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:59.679038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d78270-9d9e-48ca-8789-c0b8c8867c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:59.679864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d78270-9d9e-48ca-8789-c0b8c8867c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:59.681676 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d78270-9d9e-48ca-8789-c0b8c8867c13 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:59.709976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1161/2362] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:26:59.714318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664054-96f1-43e2-a170-78e10db49f44 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:59.734237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664054-96f1-43e2-a170-78e10db49f44 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:26:59.749799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e6975-1f16-4400-9e20-db291c6273cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:26:59.756013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e6975-1f16-4400-9e20-db291c6273cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:26:59.757012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e6975-1f16-4400-9e20-db291c6273cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:26:59.757384 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e6975-1f16-4400-9e20-db291c6273cf admin admin] PATH_INFO: `/v3/projects/908e169d82b748cb8e8a97f45718d4d6/users/4e112ea9ae9c4695afce04f61df5804b/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:26:59.798368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e6975-1f16-4400-9e20-db291c6273cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=908e169d82b748cb8e8a97f45718d4d6, user_id=4e112ea9ae9c4695afce04f61df5804b, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:26:59.808020 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e6975-1f16-4400-9e20-db291c6273cf admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:26:59.843551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1202/2363] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:26:59 2022] PUT /identity/v3/projects/908e169d82b748cb8e8a97f45718d4d6/users/4e112ea9ae9c4695afce04f61df5804b/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:26:59.847596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d78270-9d9e-48ca-8789-c0b8c8867c13 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:26:59.868739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d78270-9d9e-48ca-8789-c0b8c8867c13 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:00.194130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bff20-a137-4379-8592-53059021b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:00.198897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bff20-a137-4379-8592-53059021b8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:00.199258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bff20-a137-4379-8592-53059021b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:00.199461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bff20-a137-4379-8592-53059021b8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:00.201247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bff20-a137-4379-8592-53059021b8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:00.206355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bff20-a137-4379-8592-53059021b8e8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:00.236706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1162/2364] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:27:00.241861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e6975-1f16-4400-9e20-db291c6273cf admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:00.254065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e6975-1f16-4400-9e20-db291c6273cf admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:00.279172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c9336-65cd-40d7-804e-723fbf973081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:00.280364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9336-65cd-40d7-804e-723fbf973081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:00.280667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9336-65cd-40d7-804e-723fbf973081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:00.280958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9336-65cd-40d7-804e-723fbf973081 admin admin] PATH_INFO: `/v3/projects/908e169d82b748cb8e8a97f45718d4d6/users/4e112ea9ae9c4695afce04f61df5804b/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:00.288901 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c9336-65cd-40d7-804e-723fbf973081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908e169d82b748cb8e8a97f45718d4d6, user_id=4e112ea9ae9c4695afce04f61df5804b, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:00.293529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c9336-65cd-40d7-804e-723fbf973081 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:00.312763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:00.346923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1203/2365] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:27:00 2022] PUT /identity/v3/projects/908e169d82b748cb8e8a97f45718d4d6/users/4e112ea9ae9c4695afce04f61df5804b/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:27:04.500715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eddd6-8022-4ef6-b502-8051e780ccb0 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:04.501543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eddd6-8022-4ef6-b502-8051e780ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:04.502244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eddd6-8022-4ef6-b502-8051e780ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:04.579273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c98eddd6-8022-4ef6-b502-8051e780ccb0 None None] MFA Rules not processed for user `166c6d488fa548dd93e778e9e4804270`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:04.583477 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c98eddd6-8022-4ef6-b502-8051e780ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:04.726463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1163/2366] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:04.742174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c9336-65cd-40d7-804e-723fbf973081 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:04.745217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7d2c9336-65cd-40d7-804e-723fbf973081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:04.951768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c9336-65cd-40d7-804e-723fbf973081 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:04.971522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1edfbe-277b-4c34-89f9-d1b8b6776189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:04.972439 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edfbe-277b-4c34-89f9-d1b8b6776189 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:04.972880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edfbe-277b-4c34-89f9-d1b8b6776189 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:04.975444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edfbe-277b-4c34-89f9-d1b8b6776189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:04.980255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cd1edfbe-277b-4c34-89f9-d1b8b6776189 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:05.158635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1edfbe-277b-4c34-89f9-d1b8b6776189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:05.160601 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1edfbe-277b-4c34-89f9-d1b8b6776189 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:05.201176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1204/2367] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:27:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:27:06.389953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98eddd6-8022-4ef6-b502-8051e780ccb0 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:06.401499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c98eddd6-8022-4ef6-b502-8051e780ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:06.650411 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:06.678609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98eddd6-8022-4ef6-b502-8051e780ccb0 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:06.692600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:06.694014 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:06.694696 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:06.695627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] PATH_INFO: `/v3/users/e69057fbb55a467783154e6a4090e751` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:06.697475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69057fbb55a467783154e6a4090e751)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:06.700093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:06.894976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69057fbb55a467783154e6a4090e751'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:06.913856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69057fbb55a467783154e6a4090e751'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:06.918727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69057fbb55a467783154e6a4090e751'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:06.920285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69057fbb55a467783154e6a4090e751'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:06.948594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69057fbb55a467783154e6a4090e751'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:06.989617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1164/2368] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:27:06 2022] DELETE /identity/v3/users/e69057fbb55a467783154e6a4090e751 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:27:06.990589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1effdb-561f-4eca-b554-bbf9750ccbb9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:06.991049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1effdb-561f-4eca-b554-bbf9750ccbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:06.991157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1effdb-561f-4eca-b554-bbf9750ccbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:07.046380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-dd1effdb-561f-4eca-b554-bbf9750ccbb9 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:07.047646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dd1effdb-561f-4eca-b554-bbf9750ccbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:07.198060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1205/2369] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:07.243140 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:07.254475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:07.449930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52904cd-845b-4110-802a-bdc6e047cf84 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:07.470276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02d29a-8543-4395-9085-31bf66c8efe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:07.470912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02d29a-8543-4395-9085-31bf66c8efe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:07.471187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02d29a-8543-4395-9085-31bf66c8efe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:07.471456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02d29a-8543-4395-9085-31bf66c8efe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:07.532823 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02d29a-8543-4395-9085-31bf66c8efe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:07.541256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02d29a-8543-4395-9085-31bf66c8efe5 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:07.568370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1165/2370] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:27:09.042748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d951b-4576-466b-8f55-40b078b73df8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:09.043792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d951b-4576-466b-8f55-40b078b73df8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:09.044359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d951b-4576-466b-8f55-40b078b73df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:09.084477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1c6d951b-4576-466b-8f55-40b078b73df8 None None] MFA Rules not processed for user `87bfa5ffd791423db5bd287e57318eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:09.085925 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1c6d951b-4576-466b-8f55-40b078b73df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:09.189867 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:09.282442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1206/2371] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:09.316858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02d29a-8543-4395-9085-31bf66c8efe5 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:09.319200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0a02d29a-8543-4395-9085-31bf66c8efe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:09.338210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02d29a-8543-4395-9085-31bf66c8efe5 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:09.347387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:09.348286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:09.349297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:09.349933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] PATH_INFO: `/v3/projects/eebac51b53ec489a8319ca468d377c3a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:09.351754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eebac51b53ec489a8319ca468d377c3a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:09.353803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:09.483114 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eebac51b53ec489a8319ca468d377c3a', 'request_id': 'req-4d56be9f-fe98-4442-97c4-1bac128f441e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:09.492254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eebac51b53ec489a8319ca468d377c3a', 'request_id': 'req-4d56be9f-fe98-4442-97c4-1bac128f441e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:09.516745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eebac51b53ec489a8319ca468d377c3a', 'request_id': 'req-4d56be9f-fe98-4442-97c4-1bac128f441e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:09.553256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:09.558128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] The token cache is being invalidate because project eebac51b53ec489a8319ca468d377c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:27:09.560883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:09.565048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4d56be9f-fe98-4442-97c4-1bac128f441e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:09.570983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1166/2372] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:27:09 2022] DELETE /identity/v3/projects/eebac51b53ec489a8319ca468d377c3a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:27:09.577786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c32ca8-2a73-42c3-9d7c-1fb795f28afa None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:09.578251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c32ca8-2a73-42c3-9d7c-1fb795f28afa None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:09.578851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c32ca8-2a73-42c3-9d7c-1fb795f28afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:09.637359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-20c32ca8-2a73-42c3-9d7c-1fb795f28afa None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:09.642597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-20c32ca8-2a73-42c3-9d7c-1fb795f28afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:09.855024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1207/2373] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:09.862590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87b41-2418-4ba9-9049-18251acccdcb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:09.863007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87b41-2418-4ba9-9049-18251acccdcb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:09.863386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb87b41-2418-4ba9-9049-18251acccdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:09.903432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bfb87b41-2418-4ba9-9049-18251acccdcb None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:09.910865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bfb87b41-2418-4ba9-9049-18251acccdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:09.932907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c32ca8-2a73-42c3-9d7c-1fb795f28afa None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:09.933506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1167/2374] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:09.948239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c32ca8-2a73-42c3-9d7c-1fb795f28afa None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:09.967724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da7f65-fa23-40ab-a9bb-38fec47fc2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:09.967724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da7f65-fa23-40ab-a9bb-38fec47fc2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:09.967724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da7f65-fa23-40ab-a9bb-38fec47fc2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:09.967724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da7f65-fa23-40ab-a9bb-38fec47fc2a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:09.976566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da7f65-fa23-40ab-a9bb-38fec47fc2a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:27:09.977564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da7f65-fa23-40ab-a9bb-38fec47fc2a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:09.983271 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da7f65-fa23-40ab-a9bb-38fec47fc2a2 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:10.025574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb87b41-2418-4ba9-9049-18251acccdcb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:10.039128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1208/2375] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:27:10.048207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb87b41-2418-4ba9-9049-18251acccdcb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:10.061591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce51b93-212c-4d44-83aa-bcb0043a24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:10.063141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce51b93-212c-4d44-83aa-bcb0043a24fe admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:10.063822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce51b93-212c-4d44-83aa-bcb0043a24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:10.065678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce51b93-212c-4d44-83aa-bcb0043a24fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:10.068357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce51b93-212c-4d44-83aa-bcb0043a24fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:10.071539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce51b93-212c-4d44-83aa-bcb0043a24fe admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:10.188883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da7f65-fa23-40ab-a9bb-38fec47fc2a2 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:10.201061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1168/2376] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:27:10 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:27:10.203700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da7f65-fa23-40ab-a9bb-38fec47fc2a2 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:10.376288 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6738a2e-8352-4fdd-9233-59f6f5fcefa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:10.379535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738a2e-8352-4fdd-9233-59f6f5fcefa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:10.379972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738a2e-8352-4fdd-9233-59f6f5fcefa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:10.380265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738a2e-8352-4fdd-9233-59f6f5fcefa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:10.381005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6738a2e-8352-4fdd-9233-59f6f5fcefa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:10.383084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6738a2e-8352-4fdd-9233-59f6f5fcefa8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:10.435133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1209/2377] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:27:10 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:27:10.435508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce51b93-212c-4d44-83aa-bcb0043a24fe admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:10.453169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce51b93-212c-4d44-83aa-bcb0043a24fe admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:10.470468 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a61f4-210e-48f1-8a6f-520b9ad206f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:10.471195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a61f4-210e-48f1-8a6f-520b9ad206f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:10.471473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a61f4-210e-48f1-8a6f-520b9ad206f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:10.471746 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a61f4-210e-48f1-8a6f-520b9ad206f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:10.472443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a61f4-210e-48f1-8a6f-520b9ad206f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:10.489599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a61f4-210e-48f1-8a6f-520b9ad206f2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:10.547382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6738a2e-8352-4fdd-9233-59f6f5fcefa8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:10.559842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1169/2378] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:27:10.577437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6738a2e-8352-4fdd-9233-59f6f5fcefa8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:10.593206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7521d-b313-46fa-b8bb-b88fec38a38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:10.593830 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7521d-b313-46fa-b8bb-b88fec38a38e admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:10.594203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7521d-b313-46fa-b8bb-b88fec38a38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:10.594514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7521d-b313-46fa-b8bb-b88fec38a38e admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:10.595173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7521d-b313-46fa-b8bb-b88fec38a38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:10.597017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7521d-b313-46fa-b8bb-b88fec38a38e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:10.627768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a61f4-210e-48f1-8a6f-520b9ad206f2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:10.642615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1210/2379] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:27:10.656362 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a61f4-210e-48f1-8a6f-520b9ad206f2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:10.670027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ff171-974e-4f16-937a-5212a1d91a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:10.670700 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ff171-974e-4f16-937a-5212a1d91a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:10.670976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ff171-974e-4f16-937a-5212a1d91a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:10.671369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ff171-974e-4f16-937a-5212a1d91a95 admin admin] PATH_INFO: `/v3/projects/24ceacd632ab4314b9c9510f89bc9d1b/users/d16404f9f6fa4cfcb6d39ef45637e232/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:10.725495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ff171-974e-4f16-937a-5212a1d91a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ceacd632ab4314b9c9510f89bc9d1b, user_id=d16404f9f6fa4cfcb6d39ef45637e232, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:10.728216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ff171-974e-4f16-937a-5212a1d91a95 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:10.757487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1170/2380] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:27:10 2022] PUT /identity/v3/projects/24ceacd632ab4314b9c9510f89bc9d1b/users/d16404f9f6fa4cfcb6d39ef45637e232/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:27:10.778125 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d8f2c-f9f1-4f90-b2df-9106a12d711b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:10.778614 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d8f2c-f9f1-4f90-b2df-9106a12d711b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:10.779057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d8f2c-f9f1-4f90-b2df-9106a12d711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:10.855617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-810d8f2c-f9f1-4f90-b2df-9106a12d711b None None] MFA Rules not processed for user `d16404f9f6fa4cfcb6d39ef45637e232`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:10.856936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-810d8f2c-f9f1-4f90-b2df-9106a12d711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:10.927612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:11.012188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1211/2381] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:11.027511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ff171-974e-4f16-937a-5212a1d91a95 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:11.033258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a66ff171-974e-4f16-937a-5212a1d91a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:11.140088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ff171-974e-4f16-937a-5212a1d91a95 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:11.156458 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c4d6b-cdca-47dc-ae50-f2065ff8941d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:11.159313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4d6b-cdca-47dc-ae50-f2065ff8941d service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:11.161030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4d6b-cdca-47dc-ae50-f2065ff8941d service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:11.161586 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4d6b-cdca-47dc-ae50-f2065ff8941d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:11.187087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c4d6b-cdca-47dc-ae50-f2065ff8941d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:11.188907 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c4d6b-cdca-47dc-ae50-f2065ff8941d service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:11.218615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1171/2382] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:27:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:27:12.742344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8118d-e3fb-4523-a699-93da55874928 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:12.743580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8118d-e3fb-4523-a699-93da55874928 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:12.744417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8118d-e3fb-4523-a699-93da55874928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:12.816597 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a0a8118d-e3fb-4523-a699-93da55874928 None None] MFA Rules not processed for user `4e112ea9ae9c4695afce04f61df5804b`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:12.819645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a0a8118d-e3fb-4523-a699-93da55874928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:12.985691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1212/2383] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:13.213796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42804d4-174a-42c4-8373-cfc115dc69fc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:13.214282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42804d4-174a-42c4-8373-cfc115dc69fc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:13.214455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42804d4-174a-42c4-8373-cfc115dc69fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:13.255306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d42804d4-174a-42c4-8373-cfc115dc69fc None None] MFA Rules not processed for user `d16404f9f6fa4cfcb6d39ef45637e232`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:13.256606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d42804d4-174a-42c4-8373-cfc115dc69fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:13.280273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1172/2384] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:21.849919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8118d-e3fb-4523-a699-93da55874928 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:21.851443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a0a8118d-e3fb-4523-a699-93da55874928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:21.915115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8118d-e3fb-4523-a699-93da55874928 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:21.918814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c193-6d11-4e5f-a311-586871839307 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c498b5857f42f2ab84423f8f4ea11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:21.919439 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c193-6d11-4e5f-a311-586871839307 service glance] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:21.919719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c193-6d11-4e5f-a311-586871839307 service glance] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:21.920025 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c193-6d11-4e5f-a311-586871839307 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:21.921756 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-aa52c193-6d11-4e5f-a311-586871839307 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:21.985303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c193-6d11-4e5f-a311-586871839307 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:21.986735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c193-6d11-4e5f-a311-586871839307 service glance] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:21.996307 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1213/2385] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:27:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:27:22.165840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c30473-9e26-426d-84b4-8eb80c69ce1f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:22.166350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c30473-9e26-426d-84b4-8eb80c69ce1f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:22.166455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c30473-9e26-426d-84b4-8eb80c69ce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:22.189115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d7c30473-9e26-426d-84b4-8eb80c69ce1f None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:22.190344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d7c30473-9e26-426d-84b4-8eb80c69ce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:22.251451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1173/2386] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:27:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:22.264369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c193-6d11-4e5f-a311-586871839307 service glance] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:22.265865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-aa52c193-6d11-4e5f-a311-586871839307 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:22.281199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:22.345936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c193-6d11-4e5f-a311-586871839307 service glance] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:22.351622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d1ef-fbcc-4704-a4bd-8dee78e28588 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:22.352611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d1ef-fbcc-4704-a4bd-8dee78e28588 service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:22.352893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d1ef-fbcc-4704-a4bd-8dee78e28588 service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:22.353163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d1ef-fbcc-4704-a4bd-8dee78e28588 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:22.361006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7d1ef-fbcc-4704-a4bd-8dee78e28588 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:22.362590 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7d1ef-fbcc-4704-a4bd-8dee78e28588 service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:22.371659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1214/2387] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:27:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:27:26.216651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1bc40-8de3-4551-a61c-b3d7e47d8670 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:26.220852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1bc40-8de3-4551-a61c-b3d7e47d8670 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:26.221153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1bc40-8de3-4551-a61c-b3d7e47d8670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:26.250578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f0c1bc40-8de3-4551-a61c-b3d7e47d8670 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:26.254415 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f0c1bc40-8de3-4551-a61c-b3d7e47d8670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:26.262644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1174/2388] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 18 06:27:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:26.278397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d1ef-fbcc-4704-a4bd-8dee78e28588 service swift] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:26.291943 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d1ef-fbcc-4704-a4bd-8dee78e28588 service swift] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:26.298669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b27a46-85db-4f0a-8c72-5c535d649c92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:26.299547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b27a46-85db-4f0a-8c72-5c535d649c92 service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:26.299897 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b27a46-85db-4f0a-8c72-5c535d649c92 service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:26.300301 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b27a46-85db-4f0a-8c72-5c535d649c92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:26.309790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b27a46-85db-4f0a-8c72-5c535d649c92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:26.315040 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b27a46-85db-4f0a-8c72-5c535d649c92 service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:26.326031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1215/2389] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:27:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:27:29.140866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1bc40-8de3-4551-a61c-b3d7e47d8670 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:29.142288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f0c1bc40-8de3-4551-a61c-b3d7e47d8670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:29.210749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:29.261136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1bc40-8de3-4551-a61c-b3d7e47d8670 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:29.266249 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370aad0-9e69-4ffe-bc8a-4da95f62036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:29.266885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370aad0-9e69-4ffe-bc8a-4da95f62036d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:29.267165 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370aad0-9e69-4ffe-bc8a-4da95f62036d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:29.267434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370aad0-9e69-4ffe-bc8a-4da95f62036d admin admin] PATH_INFO: `/v3/users/8e4e84914fc643689aa6516f3f24e66c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:29.282304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370aad0-9e69-4ffe-bc8a-4da95f62036d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e4e84914fc643689aa6516f3f24e66c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:29.291044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370aad0-9e69-4ffe-bc8a-4da95f62036d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:29.360731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e370aad0-9e69-4ffe-bc8a-4da95f62036d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e4e84914fc643689aa6516f3f24e66c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:29.370756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e370aad0-9e69-4ffe-bc8a-4da95f62036d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e4e84914fc643689aa6516f3f24e66c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:29.371738 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e370aad0-9e69-4ffe-bc8a-4da95f62036d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e4e84914fc643689aa6516f3f24e66c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:29.372641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e370aad0-9e69-4ffe-bc8a-4da95f62036d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e4e84914fc643689aa6516f3f24e66c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:29.380757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e370aad0-9e69-4ffe-bc8a-4da95f62036d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e4e84914fc643689aa6516f3f24e66c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:29.401400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1175/2390] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:27:29 2022] DELETE /identity/v3/users/8e4e84914fc643689aa6516f3f24e66c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:27:29.626687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b27a46-85db-4f0a-8c72-5c535d649c92 service swift] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:29.640616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b27a46-85db-4f0a-8c72-5c535d649c92 service swift] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:29.750514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:29.751292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:29.751921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:29.752437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] PATH_INFO: `/v3/projects/523eab75e6904cc8bf86148f997d896c` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:29.754113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523eab75e6904cc8bf86148f997d896c)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:29.756668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:29.841982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523eab75e6904cc8bf86148f997d896c', 'request_id': 'req-8d320e0f-17cd-4081-ac23-749ac9359db6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:29.860454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523eab75e6904cc8bf86148f997d896c', 'request_id': 'req-8d320e0f-17cd-4081-ac23-749ac9359db6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:29.876237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523eab75e6904cc8bf86148f997d896c', 'request_id': 'req-8d320e0f-17cd-4081-ac23-749ac9359db6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:29.907651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] The token cache is being invalidate because project 523eab75e6904cc8bf86148f997d896c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:27:29.907988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:29.911010 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8d320e0f-17cd-4081-ac23-749ac9359db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:29.918154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1216/2391] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:27:29 2022] DELETE /identity/v3/projects/523eab75e6904cc8bf86148f997d896c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:27:29.921304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb0c19-4aa3-41d0-aa67-571283787bed None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:29.921401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb0c19-4aa3-41d0-aa67-571283787bed None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:29.921634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb0c19-4aa3-41d0-aa67-571283787bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:29.970608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-75fb0c19-4aa3-41d0-aa67-571283787bed None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:29.974624 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-75fb0c19-4aa3-41d0-aa67-571283787bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:30.163887 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1176/2392] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:30.166529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd8009-120a-40fa-87b7-46376524a91f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:30.166809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd8009-120a-40fa-87b7-46376524a91f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:30.167085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd8009-120a-40fa-87b7-46376524a91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:30.220094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-a8fd8009-120a-40fa-87b7-46376524a91f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:30.225501 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a8fd8009-120a-40fa-87b7-46376524a91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:30.257571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1217/2393] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:30.262914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb0c19-4aa3-41d0-aa67-571283787bed None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:30.282317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb0c19-4aa3-41d0-aa67-571283787bed None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:30.295251 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd7a7-5374-4408-b7d3-2f26aca7edb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:30.296502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd7a7-5374-4408-b7d3-2f26aca7edb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:30.296992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd7a7-5374-4408-b7d3-2f26aca7edb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:30.297712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd7a7-5374-4408-b7d3-2f26aca7edb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:30.299423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd7a7-5374-4408-b7d3-2f26aca7edb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:27:30.299733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd7a7-5374-4408-b7d3-2f26aca7edb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:30.305414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd7a7-5374-4408-b7d3-2f26aca7edb5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:30.334121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd8009-120a-40fa-87b7-46376524a91f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:30.334569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1177/2394] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:27:30.344043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd8009-120a-40fa-87b7-46376524a91f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:30.349743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e87f8-2400-4699-b157-55c5747f7108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:30.350361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e87f8-2400-4699-b157-55c5747f7108 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:30.350641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e87f8-2400-4699-b157-55c5747f7108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:30.350918 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e87f8-2400-4699-b157-55c5747f7108 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:30.351557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e87f8-2400-4699-b157-55c5747f7108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:30.353512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e87f8-2400-4699-b157-55c5747f7108 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:30.367674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:30.387951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1218/2395] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:27:30 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:27:30.391949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd7a7-5374-4408-b7d3-2f26aca7edb5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:30.402779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd7a7-5374-4408-b7d3-2f26aca7edb5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:30.467915 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:30.505269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9700cd-53b6-4ef4-99d6-6639172aeb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:30.505896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9700cd-53b6-4ef4-99d6-6639172aeb92 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:30.506179 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9700cd-53b6-4ef4-99d6-6639172aeb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:30.506459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9700cd-53b6-4ef4-99d6-6639172aeb92 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:30.507111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9700cd-53b6-4ef4-99d6-6639172aeb92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:30.509314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9700cd-53b6-4ef4-99d6-6639172aeb92 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:30.546511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1178/2396] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:27:30 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:27:30.550329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e87f8-2400-4699-b157-55c5747f7108 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:30.566999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e87f8-2400-4699-b157-55c5747f7108 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:30.573178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a424c-61e0-40e9-89e2-ee5af9b2904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:30.574388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a424c-61e0-40e9-89e2-ee5af9b2904d admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:30.575064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a424c-61e0-40e9-89e2-ee5af9b2904d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:30.575437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a424c-61e0-40e9-89e2-ee5af9b2904d admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:30.576233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a424c-61e0-40e9-89e2-ee5af9b2904d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:30.577953 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a424c-61e0-40e9-89e2-ee5af9b2904d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:30.600736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1219/2397] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:27:30.601443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9700cd-53b6-4ef4-99d6-6639172aeb92 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:30.611950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9700cd-53b6-4ef4-99d6-6639172aeb92 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:30.622253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeb80c-6321-4933-ba59-d87f737b1235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:30.622879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeb80c-6321-4933-ba59-d87f737b1235 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:30.623171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeb80c-6321-4933-ba59-d87f737b1235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:30.623444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeb80c-6321-4933-ba59-d87f737b1235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:30.624405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeb80c-6321-4933-ba59-d87f737b1235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:30.626205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeb80c-6321-4933-ba59-d87f737b1235 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:30.643956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1179/2398] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:27:30.648271 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a424c-61e0-40e9-89e2-ee5af9b2904d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:30.664295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a424c-61e0-40e9-89e2-ee5af9b2904d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:30.673595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2abcc-3b73-4f9d-9db7-886a8dca30ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:30.676551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2abcc-3b73-4f9d-9db7-886a8dca30ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:30.676853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2abcc-3b73-4f9d-9db7-886a8dca30ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:30.677133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2abcc-3b73-4f9d-9db7-886a8dca30ff admin admin] PATH_INFO: `/v3/projects/40b9b24e3a64489f9eb5c3af3ea9eede/users/ac06c0d0333248e9ad66d88b1e9b24a0/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:30.714418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2abcc-3b73-4f9d-9db7-886a8dca30ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b9b24e3a64489f9eb5c3af3ea9eede, user_id=ac06c0d0333248e9ad66d88b1e9b24a0, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:30.717169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2abcc-3b73-4f9d-9db7-886a8dca30ff admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:30.748553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1220/2399] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:27:30 2022] PUT /identity/v3/projects/40b9b24e3a64489f9eb5c3af3ea9eede/users/ac06c0d0333248e9ad66d88b1e9b24a0/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:27:30.760790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e22cd9-f5cc-4f0f-9178-eb3809c7b019 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:30.761151 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e22cd9-f5cc-4f0f-9178-eb3809c7b019 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:30.761590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e22cd9-f5cc-4f0f-9178-eb3809c7b019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:30.812848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-69e22cd9-f5cc-4f0f-9178-eb3809c7b019 None None] MFA Rules not processed for user `ac06c0d0333248e9ad66d88b1e9b24a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:30.814130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-69e22cd9-f5cc-4f0f-9178-eb3809c7b019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:30.964822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1180/2400] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:30.984059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2abcc-3b73-4f9d-9db7-886a8dca30ff admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:30.986358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e1f2abcc-3b73-4f9d-9db7-886a8dca30ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:31.117297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2abcc-3b73-4f9d-9db7-886a8dca30ff admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:31.122308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e6771-2cdd-4e14-ace3-0b862c6014c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:31.123756 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e6771-2cdd-4e14-ace3-0b862c6014c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:31.124177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e6771-2cdd-4e14-ace3-0b862c6014c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:31.124549 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e6771-2cdd-4e14-ace3-0b862c6014c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:31.158377 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e6771-2cdd-4e14-ace3-0b862c6014c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:31.158377 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e6771-2cdd-4e14-ace3-0b862c6014c3 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:31.171761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1221/2401] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:27:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:27:32.820807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73f36-ccc6-4e51-a98c-d08f3c2224d9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:32.821338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73f36-ccc6-4e51-a98c-d08f3c2224d9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:32.821338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73f36-ccc6-4e51-a98c-d08f3c2224d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:32.856855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-8ef73f36-ccc6-4e51-a98c-d08f3c2224d9 None None] MFA Rules not processed for user `11898a78089f407aa67cae2c48f99d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:32.858470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8ef73f36-ccc6-4e51-a98c-d08f3c2224d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:32.949278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1181/2402] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:33.372749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e74b4d-af3d-4d7d-bb3e-03ce3466a8bc None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:33.373311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e74b4d-af3d-4d7d-bb3e-03ce3466a8bc None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:33.373311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e74b4d-af3d-4d7d-bb3e-03ce3466a8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:33.394254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-87e74b4d-af3d-4d7d-bb3e-03ce3466a8bc None None] MFA Rules not processed for user `03b0ac401fa24aab91f20aaf08c44679`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:33.395490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-87e74b4d-af3d-4d7d-bb3e-03ce3466a8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:33.454576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1222/2403] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:38.263410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c268-89f5-4347-8cca-4c7b4207ebee None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:38.264016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c268-89f5-4347-8cca-4c7b4207ebee None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:38.264016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c268-89f5-4347-8cca-4c7b4207ebee None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:38.267566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1182/2404] 10.222.0.16 () {54 vars in 961 bytes} [Sun Sep 18 06:27:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:27:38.276124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448b6d-39ca-4ba2-b383-437504ef654c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:38.276650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448b6d-39ca-4ba2-b383-437504ef654c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:38.276758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0448b6d-39ca-4ba2-b383-437504ef654c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:38.315962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e0448b6d-39ca-4ba2-b383-437504ef654c None None] MFA Rules not processed for user `320a1c60b5b6461c8e2e2b6ec74ce78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:38.317303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e0448b6d-39ca-4ba2-b383-437504ef654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:38.415877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:38.429222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1223/2405] 10.222.0.16 () {58 vars in 1058 bytes} [Sun Sep 18 06:27:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:38.437444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c268-89f5-4347-8cca-4c7b4207ebee None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:38.455346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c268-89f5-4347-8cca-4c7b4207ebee None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:38.462935 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5d741-7ee1-4cff-b977-b6d1cff8a091 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:38.464507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5d741-7ee1-4cff-b977-b6d1cff8a091 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:38.464971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5d741-7ee1-4cff-b977-b6d1cff8a091 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:38.465426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5d741-7ee1-4cff-b977-b6d1cff8a091 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:38.467713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a0f5d741-7ee1-4cff-b977-b6d1cff8a091 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:38.486273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5d741-7ee1-4cff-b977-b6d1cff8a091 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:38.488427 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5d741-7ee1-4cff-b977-b6d1cff8a091 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:38.515781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1183/2406] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:27:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:27:38.797492 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e3ca6-88d4-46e2-ab84-a3b402ae29f4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:38.797996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e3ca6-88d4-46e2-ab84-a3b402ae29f4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:38.798493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e3ca6-88d4-46e2-ab84-a3b402ae29f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:38.842870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f38e3ca6-88d4-46e2-ab84-a3b402ae29f4 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:38.845768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f38e3ca6-88d4-46e2-ab84-a3b402ae29f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:38.999411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1224/2407] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:27:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:39.015590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5d741-7ee1-4cff-b977-b6d1cff8a091 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:39.020213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a0f5d741-7ee1-4cff-b977-b6d1cff8a091 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:39.128826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:39.164004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5d741-7ee1-4cff-b977-b6d1cff8a091 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:39.188596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398bf6b-ad89-4172-a8e8-2be19312bbfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:39.191253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398bf6b-ad89-4172-a8e8-2be19312bbfe service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:39.191531 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398bf6b-ad89-4172-a8e8-2be19312bbfe service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:39.191790 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398bf6b-ad89-4172-a8e8-2be19312bbfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:39.204122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398bf6b-ad89-4172-a8e8-2be19312bbfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:39.206551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398bf6b-ad89-4172-a8e8-2be19312bbfe service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:39.218208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1184/2408] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:27:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:27:43.516472 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e3ca6-88d4-46e2-ab84-a3b402ae29f4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:43.590929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e3ca6-88d4-46e2-ab84-a3b402ae29f4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:43.595563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:43.596466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:43.596946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:43.597234 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] PATH_INFO: `/v3/users/ac06c0d0333248e9ad66d88b1e9b24a0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:43.598722 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac06c0d0333248e9ad66d88b1e9b24a0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:43.600880 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:43.649765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac06c0d0333248e9ad66d88b1e9b24a0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:43.657618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac06c0d0333248e9ad66d88b1e9b24a0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:43.658334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac06c0d0333248e9ad66d88b1e9b24a0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:43.664442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac06c0d0333248e9ad66d88b1e9b24a0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:43.680745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac06c0d0333248e9ad66d88b1e9b24a0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:43.693455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1225/2409] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:27:43 2022] DELETE /identity/v3/users/ac06c0d0333248e9ad66d88b1e9b24a0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:27:43.698029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afca5b-d98f-44ea-a944-f172549f0469 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:43.698664 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afca5b-d98f-44ea-a944-f172549f0469 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:43.698664 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afca5b-d98f-44ea-a944-f172549f0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:43.720882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e6afca5b-d98f-44ea-a944-f172549f0469 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:27:43.722197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e6afca5b-d98f-44ea-a944-f172549f0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:43.784803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1185/2410] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:27:43.796577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:43.798135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:43.842700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:43.896255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c975c-244c-4d31-973a-74cdc9fcbf0e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:43.900241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd7007-8c94-4dff-aea4-b76110e4b733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:43.901461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd7007-8c94-4dff-aea4-b76110e4b733 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:43.901461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd7007-8c94-4dff-aea4-b76110e4b733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:43.901461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd7007-8c94-4dff-aea4-b76110e4b733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:43.912343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd7007-8c94-4dff-aea4-b76110e4b733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:43.913801 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd7007-8c94-4dff-aea4-b76110e4b733 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:43.926361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1226/2411] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:27:44.445207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afca5b-d98f-44ea-a944-f172549f0469 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:27:44.447285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e6afca5b-d98f-44ea-a944-f172549f0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:27:44.463594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afca5b-d98f-44ea-a944-f172549f0469 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:27:44.489301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:27:44.489962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:27:44.490267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:27:44.490546 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] PATH_INFO: `/v3/projects/40b9b24e3a64489f9eb5c3af3ea9eede` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:27:44.491762 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b9b24e3a64489f9eb5c3af3ea9eede)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:27:44.493834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:27:44.555510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b9b24e3a64489f9eb5c3af3ea9eede', 'request_id': 'req-69308dbd-1a52-4121-9aea-1bdd6e9dd941'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:44.563001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b9b24e3a64489f9eb5c3af3ea9eede', 'request_id': 'req-69308dbd-1a52-4121-9aea-1bdd6e9dd941'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:44.571300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b9b24e3a64489f9eb5c3af3ea9eede', 'request_id': 'req-69308dbd-1a52-4121-9aea-1bdd6e9dd941'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:44.583564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] The token cache is being invalidate because project 40b9b24e3a64489f9eb5c3af3ea9eede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:27:44.583993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:44.584718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:27:44.586267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1186/2412] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:27:44 2022] DELETE /identity/v3/projects/40b9b24e3a64489f9eb5c3af3ea9eede => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:27:53.920338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=15 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:27:54.580158 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:28:12.360949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15900bec-fae2-4a26-ae6f-5109c8508889 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:12.361467 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15900bec-fae2-4a26-ae6f-5109c8508889 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:12.361956 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15900bec-fae2-4a26-ae6f-5109c8508889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:12.388402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-15900bec-fae2-4a26-ae6f-5109c8508889 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:28:12.390132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-15900bec-fae2-4a26-ae6f-5109c8508889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:12.472233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1227/2413] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:28:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:28:12.493338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:12.495550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:12.621056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69308dbd-1a52-4121-9aea-1bdd6e9dd941 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:12.627240 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c3312-3f43-4b72-ac7d-1d28e290e8a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:12.628769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c3312-3f43-4b72-ac7d-1d28e290e8a1 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:12.628982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c3312-3f43-4b72-ac7d-1d28e290e8a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:12.629258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c3312-3f43-4b72-ac7d-1d28e290e8a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:12.639675 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c3312-3f43-4b72-ac7d-1d28e290e8a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:12.641355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c3312-3f43-4b72-ac7d-1d28e290e8a1 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:12.651474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1187/2414] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:28:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:28:13.112837 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04616b6-3b7e-4000-9493-21cc4c101519 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:13.114143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04616b6-3b7e-4000-9493-21cc4c101519 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:13.114819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04616b6-3b7e-4000-9493-21cc4c101519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:13.154240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e04616b6-3b7e-4000-9493-21cc4c101519 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:28:13.155526 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e04616b6-3b7e-4000-9493-21cc4c101519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:13.167536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1228/2415] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:28:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:28:13.185093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c3312-3f43-4b72-ac7d-1d28e290e8a1 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:13.198662 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c3312-3f43-4b72-ac7d-1d28e290e8a1 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:13.206795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bef94-bdda-4d32-bb1a-d4019a074aa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:13.207449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bef94-bdda-4d32-bb1a-d4019a074aa1 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:13.207817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bef94-bdda-4d32-bb1a-d4019a074aa1 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:13.207996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bef94-bdda-4d32-bb1a-d4019a074aa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:13.219234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bef94-bdda-4d32-bb1a-d4019a074aa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:13.221297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bef94-bdda-4d32-bb1a-d4019a074aa1 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:13.234891 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1188/2416] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:28:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:28:13.334223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea31a5-9fca-4307-b6f9-08c5f5b1a8e8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:13.334511 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea31a5-9fca-4307-b6f9-08c5f5b1a8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:13.334784 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea31a5-9fca-4307-b6f9-08c5f5b1a8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:13.365902 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-26ea31a5-9fca-4307-b6f9-08c5f5b1a8e8 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:28:13.369302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-26ea31a5-9fca-4307-b6f9-08c5f5b1a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:13.382502 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1229/2417] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 18 06:28:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:28:13.413068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bef94-bdda-4d32-bb1a-d4019a074aa1 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:13.431780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bef94-bdda-4d32-bb1a-d4019a074aa1 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:13.438685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30bca3-386c-4675-b907-4aec7b1b01d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:13.439595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30bca3-386c-4675-b907-4aec7b1b01d9 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:13.440097 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30bca3-386c-4675-b907-4aec7b1b01d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:13.440560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30bca3-386c-4675-b907-4aec7b1b01d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:13.455719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30bca3-386c-4675-b907-4aec7b1b01d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:13.460349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30bca3-386c-4675-b907-4aec7b1b01d9 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:13.470993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1189/2418] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:28:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:28:13.913939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d209d5-cf9d-40d0-aca2-7218039fb5f4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:13.914502 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d209d5-cf9d-40d0-aca2-7218039fb5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:13.914940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d209d5-cf9d-40d0-aca2-7218039fb5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:13.948287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-47d209d5-cf9d-40d0-aca2-7218039fb5f4 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:28:13.951107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-47d209d5-cf9d-40d0-aca2-7218039fb5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:13.973579 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1230/2419] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:28:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:28:14.036430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30bca3-386c-4675-b907-4aec7b1b01d9 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:14.082286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30bca3-386c-4675-b907-4aec7b1b01d9 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:14.109382 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6133fc4-eac7-4a5f-8f59-2adb17e231f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:14.110071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6133fc4-eac7-4a5f-8f59-2adb17e231f0 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:14.110713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6133fc4-eac7-4a5f-8f59-2adb17e231f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:14.111185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6133fc4-eac7-4a5f-8f59-2adb17e231f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:14.146328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6133fc4-eac7-4a5f-8f59-2adb17e231f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:14.153213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6133fc4-eac7-4a5f-8f59-2adb17e231f0 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:14.199620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1190/2420] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:28:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:28:14.795162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bf06d-69b2-4374-8306-1e72b5dadada None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:14.795734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bf06d-69b2-4374-8306-1e72b5dadada None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:14.795891 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bf06d-69b2-4374-8306-1e72b5dadada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:14.821229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b83bf06d-69b2-4374-8306-1e72b5dadada None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:28:14.838853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b83bf06d-69b2-4374-8306-1e72b5dadada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:14.868324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1231/2421] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 18 06:28:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:28:14.889041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6133fc4-eac7-4a5f-8f59-2adb17e231f0 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:14.904590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6133fc4-eac7-4a5f-8f59-2adb17e231f0 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:14.922838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f99238-3387-42bf-ae6c-59328ba8eef0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:14.924056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99238-3387-42bf-ae6c-59328ba8eef0 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:14.924600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99238-3387-42bf-ae6c-59328ba8eef0 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:14.925762 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99238-3387-42bf-ae6c-59328ba8eef0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:14.962299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f99238-3387-42bf-ae6c-59328ba8eef0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:14.964256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f99238-3387-42bf-ae6c-59328ba8eef0 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:14.994316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1191/2422] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:28:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:28:17.950696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bf06d-69b2-4374-8306-1e72b5dadada None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:17.952346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b83bf06d-69b2-4374-8306-1e72b5dadada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:18.026096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bf06d-69b2-4374-8306-1e72b5dadada None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:18.032221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:18.033156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:18.033675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:18.034357 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] PATH_INFO: `/v3/users/d16404f9f6fa4cfcb6d39ef45637e232` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:18.040622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16404f9f6fa4cfcb6d39ef45637e232)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:18.042591 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:18.106452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16404f9f6fa4cfcb6d39ef45637e232'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:28:18.118625 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16404f9f6fa4cfcb6d39ef45637e232'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:28:18.121213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16404f9f6fa4cfcb6d39ef45637e232'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:28:18.124766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16404f9f6fa4cfcb6d39ef45637e232'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:28:18.150077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16404f9f6fa4cfcb6d39ef45637e232'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:28:18.159124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:28:18.171732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1232/2423] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:28:17 2022] DELETE /identity/v3/users/d16404f9f6fa4cfcb6d39ef45637e232 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:28:18.177431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e03e5-428c-4d98-af3c-d71ead008ba7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:18.177982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e03e5-428c-4d98-af3c-d71ead008ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:18.177982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e03e5-428c-4d98-af3c-d71ead008ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:18.217696 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3d4e03e5-428c-4d98-af3c-d71ead008ba7 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:28:18.220639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3d4e03e5-428c-4d98-af3c-d71ead008ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:18.306112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1192/2424] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:28:18.317069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:18.318555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:18.384913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a7c2b-f87c-4eec-84d3-3cb45bf61fb7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:18.389338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c4cb4-1b03-4edb-9808-db7a92e649ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:18.390400 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c4cb4-1b03-4edb-9808-db7a92e649ab service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:18.390851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c4cb4-1b03-4edb-9808-db7a92e649ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:18.391289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c4cb4-1b03-4edb-9808-db7a92e649ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:18.402282 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c4cb4-1b03-4edb-9808-db7a92e649ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:18.403861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c4cb4-1b03-4edb-9808-db7a92e649ab service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:18.415755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1233/2425] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:28:18.744340 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e03e5-428c-4d98-af3c-d71ead008ba7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:18.745985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3d4e03e5-428c-4d98-af3c-d71ead008ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:18.763643 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e03e5-428c-4d98-af3c-d71ead008ba7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:18.770037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:18.781927 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:18.782382 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:18.785157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] PATH_INFO: `/v3/projects/24ceacd632ab4314b9c9510f89bc9d1b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:18.788345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ceacd632ab4314b9c9510f89bc9d1b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:18.790358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:18.835354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:28:18.863376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ceacd632ab4314b9c9510f89bc9d1b', 'request_id': 'req-e4f98296-997d-4584-ab61-45b349e8bfd7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:28:18.877213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ceacd632ab4314b9c9510f89bc9d1b', 'request_id': 'req-e4f98296-997d-4584-ab61-45b349e8bfd7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:28:18.890559 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ceacd632ab4314b9c9510f89bc9d1b', 'request_id': 'req-e4f98296-997d-4584-ab61-45b349e8bfd7'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:28:18.912963 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] The token cache is being invalidate because project 24ceacd632ab4314b9c9510f89bc9d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:28:18.913466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:28:18.916268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:28:18.920181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1193/2426] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:28:18 2022] DELETE /identity/v3/projects/24ceacd632ab4314b9c9510f89bc9d1b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:28:20.192499 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c4cb4-1b03-4edb-9808-db7a92e649ab service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:20.194033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1c3c4cb4-1b03-4edb-9808-db7a92e649ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:20.207578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c4cb4-1b03-4edb-9808-db7a92e649ab service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:20.274276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89fa9b-2a47-496c-9c4c-6778c4ac01b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:20.275034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89fa9b-2a47-496c-9c4c-6778c4ac01b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:20.275428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89fa9b-2a47-496c-9c4c-6778c4ac01b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:20.275771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89fa9b-2a47-496c-9c4c-6778c4ac01b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:20.277733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cd89fa9b-2a47-496c-9c4c-6778c4ac01b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:20.389108 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89fa9b-2a47-496c-9c4c-6778c4ac01b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:20.390565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89fa9b-2a47-496c-9c4c-6778c4ac01b9 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:20.407325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1234/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:28:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:28:23.431104 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:23.433922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:23.453274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f98296-997d-4584-ab61-45b349e8bfd7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:23.459457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741c3f2-9e98-41c0-97da-88f43113365f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:23.460059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741c3f2-9e98-41c0-97da-88f43113365f service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:23.460345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741c3f2-9e98-41c0-97da-88f43113365f service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:23.460618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741c3f2-9e98-41c0-97da-88f43113365f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:23.462616 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8741c3f2-9e98-41c0-97da-88f43113365f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:23.577759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741c3f2-9e98-41c0-97da-88f43113365f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:23.579490 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741c3f2-9e98-41c0-97da-88f43113365f service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:23.610769 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1194/2428] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:28:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:28:30.397159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=77 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:28:31.312836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c653961-b0f8-4685-b92a-0e336e95416e None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:31.313026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c653961-b0f8-4685-b92a-0e336e95416e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:31.313300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c653961-b0f8-4685-b92a-0e336e95416e None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:31.314697 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1235/2429] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:28:31.321008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311080e-f7ea-4db1-8561-290c1344e124 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:31.321531 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311080e-f7ea-4db1-8561-290c1344e124 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:31.321531 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311080e-f7ea-4db1-8561-290c1344e124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:31.341555 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-3311080e-f7ea-4db1-8561-290c1344e124 None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:28:31.342767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3311080e-f7ea-4db1-8561-290c1344e124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:31.412971 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1195/2430] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:28:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:28:31.425478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c653961-b0f8-4685-b92a-0e336e95416e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:31.427315 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5c653961-b0f8-4685-b92a-0e336e95416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:31.494538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c653961-b0f8-4685-b92a-0e336e95416e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:31.498017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2da96a-64f6-449b-9d6e-2b872d6c753c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c498b5857f42f2ab84423f8f4ea11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:31.498603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2da96a-64f6-449b-9d6e-2b872d6c753c service glance] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:31.498877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2da96a-64f6-449b-9d6e-2b872d6c753c service glance] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:31.499143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2da96a-64f6-449b-9d6e-2b872d6c753c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:31.509203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2da96a-64f6-449b-9d6e-2b872d6c753c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:31.510613 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2da96a-64f6-449b-9d6e-2b872d6c753c service glance] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:31.521970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1236/2431] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:28:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:28:31.591226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3db2a-da33-4215-89f2-966a623381af None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:31.591416 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3db2a-da33-4215-89f2-966a623381af None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:31.591690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3db2a-da33-4215-89f2-966a623381af None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:31.593083 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1196/2432] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:28:31.598948 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998de83-a11a-401a-902f-a128576f322e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:31.599240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998de83-a11a-401a-902f-a128576f322e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:31.599508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998de83-a11a-401a-902f-a128576f322e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:31.619885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d998de83-a11a-401a-902f-a128576f322e None None] MFA Rules not processed for user `1d78e909fc894ddd9b35ead5fe68b898`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:28:31.621115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d998de83-a11a-401a-902f-a128576f322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:31.627758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1237/2433] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:28:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:28:31.639756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3db2a-da33-4215-89f2-966a623381af None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:31.641657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e4c3db2a-da33-4215-89f2-966a623381af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:31.655293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3db2a-da33-4215-89f2-966a623381af None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:31.659475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef64f29-2d80-4003-b024-ae7ffaef2c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:31.660086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64f29-2d80-4003-b024-ae7ffaef2c72 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:31.660359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64f29-2d80-4003-b024-ae7ffaef2c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:31.660627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64f29-2d80-4003-b024-ae7ffaef2c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:31.667507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef64f29-2d80-4003-b024-ae7ffaef2c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:31.669056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef64f29-2d80-4003-b024-ae7ffaef2c72 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:31.677084 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1197/2434] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:28:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:28:31.770524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82564d-d200-429d-b7be-af391103f70a None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:31.770824 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82564d-d200-429d-b7be-af391103f70a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:31.771087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82564d-d200-429d-b7be-af391103f70a None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:31.772462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1238/2435] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:28:31.777345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed6561-d577-40af-8748-8417fd96c58a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:31.777628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed6561-d577-40af-8748-8417fd96c58a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:31.777900 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed6561-d577-40af-8748-8417fd96c58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:31.797277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e3ed6561-d577-40af-8748-8417fd96c58a None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:28:31.798480 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e3ed6561-d577-40af-8748-8417fd96c58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:31.807628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1198/2436] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:28:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:28:31.818608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82564d-d200-429d-b7be-af391103f70a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:31.829511 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82564d-d200-429d-b7be-af391103f70a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:31.837523 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca8398-d3f9-4c57-acd4-0289a953b900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:31.838132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca8398-d3f9-4c57-acd4-0289a953b900 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:31.838489 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca8398-d3f9-4c57-acd4-0289a953b900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:31.838766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca8398-d3f9-4c57-acd4-0289a953b900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:31.855338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca8398-d3f9-4c57-acd4-0289a953b900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:31.856740 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca8398-d3f9-4c57-acd4-0289a953b900 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:31.867692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1239/2437] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:28:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:28:34.526170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809e8f-f93f-42bb-a277-dcc5bc409824 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:34.526662 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809e8f-f93f-42bb-a277-dcc5bc409824 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:34.526776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809e8f-f93f-42bb-a277-dcc5bc409824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:34.545525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-14809e8f-f93f-42bb-a277-dcc5bc409824 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:28:34.546713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-14809e8f-f93f-42bb-a277-dcc5bc409824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:34.567695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:28:34.603354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1199/2438] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:28:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:28:34.616070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca8398-d3f9-4c57-acd4-0289a953b900 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:28:34.617495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d8ca8398-d3f9-4c57-acd4-0289a953b900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:28:34.687586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca8398-d3f9-4c57-acd4-0289a953b900 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:28:34.693493 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f480b-446a-4420-98ca-d53532146a3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:28:34.694095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f480b-446a-4420-98ca-d53532146a3c service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:28:34.694374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f480b-446a-4420-98ca-d53532146a3c service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:28:34.694650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f480b-446a-4420-98ca-d53532146a3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:28:34.702546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f480b-446a-4420-98ca-d53532146a3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:28:34.704156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f480b-446a-4420-98ca-d53532146a3c service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:28:34.712572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1240/2439] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:28:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:28:44.596792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=13 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:28:44.708922 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=67 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:29:01.622372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583cdf-26d2-4950-b98e-3f03b160eb11 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:29:01.622887 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583cdf-26d2-4950-b98e-3f03b160eb11 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:29:01.622995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583cdf-26d2-4950-b98e-3f03b160eb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:29:01.643330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f5583cdf-26d2-4950-b98e-3f03b160eb11 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:29:01.644559 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f5583cdf-26d2-4950-b98e-3f03b160eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:29:01.652718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1200/2440] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 18 06:29:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:29:01.664851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f480b-446a-4420-98ca-d53532146a3c service swift] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:29:01.676290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f480b-446a-4420-98ca-d53532146a3c service swift] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:29:01.681381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917553d0-20ff-460a-9b0a-14f58b08bb5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:29:01.681970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917553d0-20ff-460a-9b0a-14f58b08bb5b service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:29:01.682245 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917553d0-20ff-460a-9b0a-14f58b08bb5b service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:29:01.682519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917553d0-20ff-460a-9b0a-14f58b08bb5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:29:01.691432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917553d0-20ff-460a-9b0a-14f58b08bb5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:29:01.693080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917553d0-20ff-460a-9b0a-14f58b08bb5b service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:29:01.701289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1241/2441] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:29:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:29:11.637398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:29:11.698020 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:29:24.151616 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff565c-7967-4e2e-bfa7-9ecab2629cb7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:29:24.152192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff565c-7967-4e2e-bfa7-9ecab2629cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:29:24.152192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff565c-7967-4e2e-bfa7-9ecab2629cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:29:24.170762 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2dff565c-7967-4e2e-bfa7-9ecab2629cb7 None None] MFA Rules not processed for user `2846f016f36f4c61a6ec959478f2dcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:29:24.171995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2dff565c-7967-4e2e-bfa7-9ecab2629cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:29:24.227789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1201/2442] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:29:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:29:34.220420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=25 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:29:56.802574 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917553d0-20ff-460a-9b0a-14f58b08bb5b service swift] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:29:56.812032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917553d0-20ff-460a-9b0a-14f58b08bb5b service swift] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:29:56.815778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b3b0f-52d5-4803-886a-f110e2bb4dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:29:56.816402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b3b0f-52d5-4803-886a-f110e2bb4dba service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:29:56.816680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b3b0f-52d5-4803-886a-f110e2bb4dba service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:29:56.816954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b3b0f-52d5-4803-886a-f110e2bb4dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:29:56.818629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d84b3b0f-52d5-4803-886a-f110e2bb4dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:29:56.834942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b3b0f-52d5-4803-886a-f110e2bb4dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:29:56.836436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b3b0f-52d5-4803-886a-f110e2bb4dba service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:29:56.849014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1242/2443] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:29:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:29:58.047863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff565c-7967-4e2e-bfa7-9ecab2629cb7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:29:58.057421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff565c-7967-4e2e-bfa7-9ecab2629cb7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:29:58.060991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8eb4c-7736-4ae4-87f8-59044032d9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:29:58.061577 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8eb4c-7736-4ae4-87f8-59044032d9bd service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:29:58.061865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8eb4c-7736-4ae4-87f8-59044032d9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:29:58.062114 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8eb4c-7736-4ae4-87f8-59044032d9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:29:58.064592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d5d8eb4c-7736-4ae4-87f8-59044032d9bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:29:58.077530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8eb4c-7736-4ae4-87f8-59044032d9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:29:58.079947 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8eb4c-7736-4ae4-87f8-59044032d9bd service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:29:58.090686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1202/2444] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:29:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:30:00.595071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b3b0f-52d5-4803-886a-f110e2bb4dba service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:00.596434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d84b3b0f-52d5-4803-886a-f110e2bb4dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:00.610750 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b3b0f-52d5-4803-886a-f110e2bb4dba service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:00.616294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a953c13-966c-4185-921a-e7d5ca943bc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:00.616885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a953c13-966c-4185-921a-e7d5ca943bc8 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:00.617159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a953c13-966c-4185-921a-e7d5ca943bc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:00.617431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a953c13-966c-4185-921a-e7d5ca943bc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:00.619086 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7a953c13-966c-4185-921a-e7d5ca943bc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:00.677225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a953c13-966c-4185-921a-e7d5ca943bc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:00.678743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a953c13-966c-4185-921a-e7d5ca943bc8 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:00.687788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1243/2445] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:30:08.085845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:30:10.683593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=34 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:30:10.815324 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8eb4c-7736-4ae4-87f8-59044032d9bd service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:10.817098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d5d8eb4c-7736-4ae4-87f8-59044032d9bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:10.832123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8eb4c-7736-4ae4-87f8-59044032d9bd service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:10.844205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa33bf6-f1bb-40cf-b4dd-fa8e68f3f515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:10.844996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33bf6-f1bb-40cf-b4dd-fa8e68f3f515 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:10.845275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33bf6-f1bb-40cf-b4dd-fa8e68f3f515 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:10.845549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33bf6-f1bb-40cf-b4dd-fa8e68f3f515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:10.847330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9fa33bf6-f1bb-40cf-b4dd-fa8e68f3f515 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:10.909453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa33bf6-f1bb-40cf-b4dd-fa8e68f3f515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:10.911062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa33bf6-f1bb-40cf-b4dd-fa8e68f3f515 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:10.920387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1203/2446] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:30:14.880093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe632698-222b-4a33-accf-ac7e149167da None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:14.880958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe632698-222b-4a33-accf-ac7e149167da None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:14.881212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe632698-222b-4a33-accf-ac7e149167da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:14.902582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fe632698-222b-4a33-accf-ac7e149167da None None] MFA Rules not processed for user `11898a78089f407aa67cae2c48f99d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:30:14.904177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fe632698-222b-4a33-accf-ac7e149167da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:14.912423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1244/2447] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:30:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:30:15.223128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa33bf6-f1bb-40cf-b4dd-fa8e68f3f515 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:15.232690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa33bf6-f1bb-40cf-b4dd-fa8e68f3f515 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:15.237039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679e2bd-95ac-435e-bc59-22899f6359b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:15.237637 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679e2bd-95ac-435e-bc59-22899f6359b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:15.237942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679e2bd-95ac-435e-bc59-22899f6359b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:15.238410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679e2bd-95ac-435e-bc59-22899f6359b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:15.240235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7679e2bd-95ac-435e-bc59-22899f6359b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:15.249865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679e2bd-95ac-435e-bc59-22899f6359b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:15.251281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679e2bd-95ac-435e-bc59-22899f6359b3 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:15.259692 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1204/2448] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:30:15.634755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe632698-222b-4a33-accf-ac7e149167da None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:15.636241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fe632698-222b-4a33-accf-ac7e149167da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:15.727135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe632698-222b-4a33-accf-ac7e149167da None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:15.739544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e822f3-5d8e-4b2e-bdff-e48017cc6793 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:15.740844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e822f3-5d8e-4b2e-bdff-e48017cc6793 service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:15.741458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e822f3-5d8e-4b2e-bdff-e48017cc6793 service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:15.742083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e822f3-5d8e-4b2e-bdff-e48017cc6793 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:15.745132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a2e822f3-5d8e-4b2e-bdff-e48017cc6793 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:15.769151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e822f3-5d8e-4b2e-bdff-e48017cc6793 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:15.770860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e822f3-5d8e-4b2e-bdff-e48017cc6793 service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:15.782609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1245/2449] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:30:16.309155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679e2bd-95ac-435e-bc59-22899f6359b3 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:16.328276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679e2bd-95ac-435e-bc59-22899f6359b3 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:16.336022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e48d59-5e4d-4172-9404-e036e46425e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:16.336874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48d59-5e4d-4172-9404-e036e46425e8 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:16.337344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48d59-5e4d-4172-9404-e036e46425e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:16.337925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48d59-5e4d-4172-9404-e036e46425e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:16.343953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-38e48d59-5e4d-4172-9404-e036e46425e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:16.382419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e48d59-5e4d-4172-9404-e036e46425e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:16.384357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e48d59-5e4d-4172-9404-e036e46425e8 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:16.415754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1205/2450] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:30:18.980586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e822f3-5d8e-4b2e-bdff-e48017cc6793 service placement] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:18.993896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e822f3-5d8e-4b2e-bdff-e48017cc6793 service placement] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:18.999779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22e924-8924-47ce-a56f-a8fabaf6d0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:19.001228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22e924-8924-47ce-a56f-a8fabaf6d0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:19.001675 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22e924-8924-47ce-a56f-a8fabaf6d0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:19.002109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22e924-8924-47ce-a56f-a8fabaf6d0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:19.004252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ee22e924-8924-47ce-a56f-a8fabaf6d0f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:19.017131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22e924-8924-47ce-a56f-a8fabaf6d0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:19.019814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22e924-8924-47ce-a56f-a8fabaf6d0f9 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:19.031226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1246/2451] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:30:20.122448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71921417-96b8-42b7-9c0b-ee10456da0c9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:20.123006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71921417-96b8-42b7-9c0b-ee10456da0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:20.123123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71921417-96b8-42b7-9c0b-ee10456da0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:20.143767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-71921417-96b8-42b7-9c0b-ee10456da0c9 None None] MFA Rules not processed for user `b805252c0e714dbcb305ad156ed58113`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:30:20.145078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-71921417-96b8-42b7-9c0b-ee10456da0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:20.152213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1206/2452] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:30:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:30:25.557286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22e924-8924-47ce-a56f-a8fabaf6d0f9 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:25.572484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22e924-8924-47ce-a56f-a8fabaf6d0f9 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:25.578478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3d45d-130b-4f11-bb4c-68b787a989b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:25.579114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d45d-130b-4f11-bb4c-68b787a989b3 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:25.579391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d45d-130b-4f11-bb4c-68b787a989b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:25.579663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d45d-130b-4f11-bb4c-68b787a989b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:25.581440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bdc3d45d-130b-4f11-bb4c-68b787a989b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:25.596458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3d45d-130b-4f11-bb4c-68b787a989b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:25.598048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3d45d-130b-4f11-bb4c-68b787a989b3 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:25.608659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1247/2453] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:30:30.137397 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=43 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:30:33.200888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71921417-96b8-42b7-9c0b-ee10456da0c9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:33.202906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-71921417-96b8-42b7-9c0b-ee10456da0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:33.266002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71921417-96b8-42b7-9c0b-ee10456da0c9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:33.269956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba8337-f1a8-40f7-a39e-02a7431f28f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:33.270685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba8337-f1a8-40f7-a39e-02a7431f28f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:33.271031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba8337-f1a8-40f7-a39e-02a7431f28f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:33.271371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba8337-f1a8-40f7-a39e-02a7431f28f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:33.273360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0cba8337-f1a8-40f7-a39e-02a7431f28f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:33.285049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba8337-f1a8-40f7-a39e-02a7431f28f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:33.286656 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba8337-f1a8-40f7-a39e-02a7431f28f8 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:33.297925 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1207/2454] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:30:35.604254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=47 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:30:43.293255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=26 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:30:54.310099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3d45d-130b-4f11-bb4c-68b787a989b3 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:54.319380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3d45d-130b-4f11-bb4c-68b787a989b3 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:54.324910 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617d8ed-a637-4180-bd4a-b524af82399d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:54.325504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617d8ed-a637-4180-bd4a-b524af82399d service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:54.325777 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617d8ed-a637-4180-bd4a-b524af82399d service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:54.326059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617d8ed-a637-4180-bd4a-b524af82399d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:54.327756 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5617d8ed-a637-4180-bd4a-b524af82399d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:54.389519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617d8ed-a637-4180-bd4a-b524af82399d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:54.391486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617d8ed-a637-4180-bd4a-b524af82399d service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:54.401065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1248/2455] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:30:57.567039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0f118-3f77-43c9-9f40-f39c0693694a None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:57.567897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0f118-3f77-43c9-9f40-f39c0693694a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:57.568222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0f118-3f77-43c9-9f40-f39c0693694a None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:57.569930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1208/2456] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:30:57.597616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335446a-cd00-4180-91c8-1bb23f869794 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:57.599564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335446a-cd00-4180-91c8-1bb23f869794 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:57.599857 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335446a-cd00-4180-91c8-1bb23f869794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:57.623635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8335446a-cd00-4180-91c8-1bb23f869794 None None] MFA Rules not processed for user `320a1c60b5b6461c8e2e2b6ec74ce78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:30:57.625443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8335446a-cd00-4180-91c8-1bb23f869794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:57.635310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1249/2457] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:30:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:30:57.635462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0f118-3f77-43c9-9f40-f39c0693694a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:57.637129 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-75a0f118-3f77-43c9-9f40-f39c0693694a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:57.653427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335446a-cd00-4180-91c8-1bb23f869794 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:57.654862 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8335446a-cd00-4180-91c8-1bb23f869794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:57.660120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0f118-3f77-43c9-9f40-f39c0693694a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:57.665265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb708cf-893a-42e1-9473-561e644da223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:57.665889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb708cf-893a-42e1-9473-561e644da223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:57.666164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb708cf-893a-42e1-9473-561e644da223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:57.666438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb708cf-893a-42e1-9473-561e644da223 admin admin] PATH_INFO: `/v3/users/2846f016f36f4c61a6ec959478f2dcd8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:57.667383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335446a-cd00-4180-91c8-1bb23f869794 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:57.667550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb708cf-893a-42e1-9473-561e644da223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2846f016f36f4c61a6ec959478f2dcd8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:57.669474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb708cf-893a-42e1-9473-561e644da223 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:57.673178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587cda4-a5e7-4873-8ce1-155b38d9a13a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:57.673855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587cda4-a5e7-4873-8ce1-155b38d9a13a service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:57.674142 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587cda4-a5e7-4873-8ce1-155b38d9a13a service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:57.674435 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587cda4-a5e7-4873-8ce1-155b38d9a13a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:57.683860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587cda4-a5e7-4873-8ce1-155b38d9a13a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:57.685485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587cda4-a5e7-4873-8ce1-155b38d9a13a service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:57.696473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1250/2458] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:30:57.733932 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9bb708cf-893a-42e1-9473-561e644da223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2846f016f36f4c61a6ec959478f2dcd8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:30:57.741342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9bb708cf-893a-42e1-9473-561e644da223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2846f016f36f4c61a6ec959478f2dcd8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:30:57.741973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9bb708cf-893a-42e1-9473-561e644da223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2846f016f36f4c61a6ec959478f2dcd8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:30:57.742585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9bb708cf-893a-42e1-9473-561e644da223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2846f016f36f4c61a6ec959478f2dcd8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:30:57.750343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-9bb708cf-893a-42e1-9473-561e644da223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2846f016f36f4c61a6ec959478f2dcd8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:30:57.768251 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1209/2459] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:30:57 2022] DELETE /identity/v3/users/2846f016f36f4c61a6ec959478f2dcd8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:30:57.946393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587cda4-a5e7-4873-8ce1-155b38d9a13a service placement] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:57.957526 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587cda4-a5e7-4873-8ce1-155b38d9a13a service placement] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:58.019076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:58.019632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.019950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.020224 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] PATH_INFO: `/v3/projects/a7d84e3d93934b3b97229eb9b584753b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.021348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d84e3d93934b3b97229eb9b584753b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:58.023285 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:58.071299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d84e3d93934b3b97229eb9b584753b', 'request_id': 'req-576001e8-5ad0-4b68-9567-08c2c4e0ff49'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:30:58.086552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d84e3d93934b3b97229eb9b584753b', 'request_id': 'req-576001e8-5ad0-4b68-9567-08c2c4e0ff49'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:30:58.097623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d84e3d93934b3b97229eb9b584753b', 'request_id': 'req-576001e8-5ad0-4b68-9567-08c2c4e0ff49'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:30:58.110058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] The token cache is being invalidate because project a7d84e3d93934b3b97229eb9b584753b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:30:58.110478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:30:58.111402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-576001e8-5ad0-4b68-9567-08c2c4e0ff49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:30:58.113304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1251/2460] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:30:57 2022] DELETE /identity/v3/projects/a7d84e3d93934b3b97229eb9b584753b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:30:58.118338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee07e9-557c-4595-8d8d-290f035e3efc None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.118622 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee07e9-557c-4595-8d8d-290f035e3efc None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.118922 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee07e9-557c-4595-8d8d-290f035e3efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.141814 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6eee07e9-557c-4595-8d8d-290f035e3efc None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:30:58.143048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6eee07e9-557c-4595-8d8d-290f035e3efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:58.207893 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1210/2461] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:30:58.215629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4e9d-9351-4d72-9d57-829050686f7c None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.215920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4e9d-9351-4d72-9d57-829050686f7c None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.216212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4e9d-9351-4d72-9d57-829050686f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.226011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:30:58.239257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b86c4e9d-9351-4d72-9d57-829050686f7c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:30:58.240835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b86c4e9d-9351-4d72-9d57-829050686f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:58.258408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1252/2462] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:30:58.261455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee07e9-557c-4595-8d8d-290f035e3efc None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:58.273429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee07e9-557c-4595-8d8d-290f035e3efc None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:58.277987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39b58-df53-48c3-a229-56b71519d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:58.278583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39b58-df53-48c3-a229-56b71519d181 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.278859 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39b58-df53-48c3-a229-56b71519d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.279131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39b58-df53-48c3-a229-56b71519d181 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.279772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c39b58-df53-48c3-a229-56b71519d181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:30:58.280160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c39b58-df53-48c3-a229-56b71519d181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:58.282544 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c39b58-df53-48c3-a229-56b71519d181 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:58.295212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1211/2463] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:30:58.300165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4e9d-9351-4d72-9d57-829050686f7c None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:58.311004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4e9d-9351-4d72-9d57-829050686f7c None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:58.318734 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c7b86-cab8-442e-96f9-d44401a89225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:58.319432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c7b86-cab8-442e-96f9-d44401a89225 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.319779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c7b86-cab8-442e-96f9-d44401a89225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.320166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c7b86-cab8-442e-96f9-d44401a89225 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.320878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c7b86-cab8-442e-96f9-d44401a89225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:58.322898 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c7b86-cab8-442e-96f9-d44401a89225 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:58.352268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1253/2464] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:30:58 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:30:58.356481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39b58-df53-48c3-a229-56b71519d181 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:58.367566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39b58-df53-48c3-a229-56b71519d181 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:58.433803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46ca07-e0b5-4e69-a604-c21181a16d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:58.434537 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ca07-e0b5-4e69-a604-c21181a16d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.434947 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ca07-e0b5-4e69-a604-c21181a16d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.435252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ca07-e0b5-4e69-a604-c21181a16d37 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.435931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46ca07-e0b5-4e69-a604-c21181a16d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:58.440838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46ca07-e0b5-4e69-a604-c21181a16d37 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:58.449869 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:30:58.466374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1212/2465] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:30:58 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:30:58.471795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c7b86-cab8-442e-96f9-d44401a89225 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:58.482437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c7b86-cab8-442e-96f9-d44401a89225 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:58.488270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10db15-e65a-4c3a-840b-654fe32c49b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:58.488865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10db15-e65a-4c3a-840b-654fe32c49b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.489260 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10db15-e65a-4c3a-840b-654fe32c49b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.489402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10db15-e65a-4c3a-840b-654fe32c49b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.490030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10db15-e65a-4c3a-840b-654fe32c49b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:58.491616 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10db15-e65a-4c3a-840b-654fe32c49b7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:58.501855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1254/2466] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:30:58.505810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46ca07-e0b5-4e69-a604-c21181a16d37 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:58.516469 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46ca07-e0b5-4e69-a604-c21181a16d37 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:58.521271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd668c8-cc2f-48a1-961f-8344f80e1559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:58.521854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd668c8-cc2f-48a1-961f-8344f80e1559 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.522135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd668c8-cc2f-48a1-961f-8344f80e1559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.522409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd668c8-cc2f-48a1-961f-8344f80e1559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.523053 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd668c8-cc2f-48a1-961f-8344f80e1559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:58.524867 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd668c8-cc2f-48a1-961f-8344f80e1559 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:58.536195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1213/2467] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:30:58.540473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10db15-e65a-4c3a-840b-654fe32c49b7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:58.552343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10db15-e65a-4c3a-840b-654fe32c49b7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:58.556935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902557dd-f226-4dd3-9a1e-03861a8e9056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:58.557572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902557dd-f226-4dd3-9a1e-03861a8e9056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.557845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902557dd-f226-4dd3-9a1e-03861a8e9056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.558116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902557dd-f226-4dd3-9a1e-03861a8e9056 admin admin] PATH_INFO: `/v3/projects/e8bb7743cb774f3e95967a1f29befdf4/users/df665770acce412c831830c2d4c110eb/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.574490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902557dd-f226-4dd3-9a1e-03861a8e9056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bb7743cb774f3e95967a1f29befdf4, user_id=df665770acce412c831830c2d4c110eb, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:58.577379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902557dd-f226-4dd3-9a1e-03861a8e9056 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:58.593965 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1255/2468] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:30:58 2022] PUT /identity/v3/projects/e8bb7743cb774f3e95967a1f29befdf4/users/df665770acce412c831830c2d4c110eb/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:30:58.604123 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eebc9f-6904-4c1b-9d66-95eec65e9b33 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.604604 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eebc9f-6904-4c1b-9d66-95eec65e9b33 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.604720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eebc9f-6904-4c1b-9d66-95eec65e9b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.633281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-12eebc9f-6904-4c1b-9d66-95eec65e9b33 None None] MFA Rules not processed for user `df665770acce412c831830c2d4c110eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:30:58.634502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-12eebc9f-6904-4c1b-9d66-95eec65e9b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:58.714029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902557dd-f226-4dd3-9a1e-03861a8e9056 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:58.715529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1214/2469] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:30:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:30:58.776984 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902557dd-f226-4dd3-9a1e-03861a8e9056 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:58.782267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc830-28dc-42f0-a25c-54d4eb9b3086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:58.782865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc830-28dc-42f0-a25c-54d4eb9b3086 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.783145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc830-28dc-42f0-a25c-54d4eb9b3086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.783418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc830-28dc-42f0-a25c-54d4eb9b3086 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.784081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cc830-28dc-42f0-a25c-54d4eb9b3086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:58.785989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cc830-28dc-42f0-a25c-54d4eb9b3086 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:58.815941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1256/2470] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:30:58 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:30:58.819716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eebc9f-6904-4c1b-9d66-95eec65e9b33 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:58.839247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eebc9f-6904-4c1b-9d66-95eec65e9b33 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:58.898998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bd242-aa3b-458c-b172-b0bfda5598a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:58.899600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd242-aa3b-458c-b172-b0bfda5598a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.899879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd242-aa3b-458c-b172-b0bfda5598a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.900185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd242-aa3b-458c-b172-b0bfda5598a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.900866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bd242-aa3b-458c-b172-b0bfda5598a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:58.902787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bd242-aa3b-458c-b172-b0bfda5598a5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:58.925252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1215/2471] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:30:58 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:30:58.929482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc830-28dc-42f0-a25c-54d4eb9b3086 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:58.941424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc830-28dc-42f0-a25c-54d4eb9b3086 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:58.946132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942a32-3f50-4877-8301-6850281ebb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:58.946723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942a32-3f50-4877-8301-6850281ebb8d admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.946996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942a32-3f50-4877-8301-6850281ebb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.947264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03942a32-3f50-4877-8301-6850281ebb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.947975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03942a32-3f50-4877-8301-6850281ebb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:58.949574 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03942a32-3f50-4877-8301-6850281ebb8d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:58.961035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1257/2472] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:30:58.965452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bd242-aa3b-458c-b172-b0bfda5598a5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:58.976787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bd242-aa3b-458c-b172-b0bfda5598a5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:58.981516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb55ee-32ea-4e07-8018-c19603a16cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:58.982170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb55ee-32ea-4e07-8018-c19603a16cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:58.982451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb55ee-32ea-4e07-8018-c19603a16cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:58.982736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb55ee-32ea-4e07-8018-c19603a16cc1 admin admin] PATH_INFO: `/v3/projects/7b4682776488407db5f472af4b53fd7d/users/e071c3f7a4e64b85812b176226914b00/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:58.999052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb55ee-32ea-4e07-8018-c19603a16cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4682776488407db5f472af4b53fd7d, user_id=e071c3f7a4e64b85812b176226914b00, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:59.001793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb55ee-32ea-4e07-8018-c19603a16cc1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:59.016809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1216/2473] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:30:58 2022] PUT /identity/v3/projects/7b4682776488407db5f472af4b53fd7d/users/e071c3f7a4e64b85812b176226914b00/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:30:59.020944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942a32-3f50-4877-8301-6850281ebb8d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:59.032201 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03942a32-3f50-4877-8301-6850281ebb8d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:59.087970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616e4d5-f11d-4f68-bdca-ad41ee42e903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:59.088554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616e4d5-f11d-4f68-bdca-ad41ee42e903 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:59.088829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616e4d5-f11d-4f68-bdca-ad41ee42e903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:59.089100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616e4d5-f11d-4f68-bdca-ad41ee42e903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:59.089736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616e4d5-f11d-4f68-bdca-ad41ee42e903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:59.091434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616e4d5-f11d-4f68-bdca-ad41ee42e903 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:59.103007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1258/2474] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:30:59.107202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb55ee-32ea-4e07-8018-c19603a16cc1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:59.118713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb55ee-32ea-4e07-8018-c19603a16cc1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:59.123735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72ac4e-9d8a-4348-a55e-9a4247780918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:59.124500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72ac4e-9d8a-4348-a55e-9a4247780918 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:59.124993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72ac4e-9d8a-4348-a55e-9a4247780918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:59.125376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72ac4e-9d8a-4348-a55e-9a4247780918 admin admin] PATH_INFO: `/v3/projects/7b4682776488407db5f472af4b53fd7d/users/e071c3f7a4e64b85812b176226914b00/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:59.127343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72ac4e-9d8a-4348-a55e-9a4247780918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4682776488407db5f472af4b53fd7d, user_id=e071c3f7a4e64b85812b176226914b00, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:59.130127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72ac4e-9d8a-4348-a55e-9a4247780918 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:59.141192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1217/2475] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:30:59 2022] PUT /identity/v3/projects/7b4682776488407db5f472af4b53fd7d/users/e071c3f7a4e64b85812b176226914b00/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:30:59.152717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd88d3-e01b-4db7-9347-de3f1edfa3b6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:59.153078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd88d3-e01b-4db7-9347-de3f1edfa3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:59.153422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd88d3-e01b-4db7-9347-de3f1edfa3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:59.177191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:30:59.186984 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-51bd88d3-e01b-4db7-9347-de3f1edfa3b6 None None] MFA Rules not processed for user `e071c3f7a4e64b85812b176226914b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:30:59.189004 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-51bd88d3-e01b-4db7-9347-de3f1edfa3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:59.261415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1259/2476] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:30:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:30:59.273205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72ac4e-9d8a-4348-a55e-9a4247780918 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:59.274914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4b72ac4e-9d8a-4348-a55e-9a4247780918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:30:59.299307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:30:59.339933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72ac4e-9d8a-4348-a55e-9a4247780918 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:59.344598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a568cdf-50f3-43e5-8f42-a726b4e1cced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:59.345200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a568cdf-50f3-43e5-8f42-a726b4e1cced service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:59.345474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a568cdf-50f3-43e5-8f42-a726b4e1cced service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:59.345745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a568cdf-50f3-43e5-8f42-a726b4e1cced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:59.355289 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a568cdf-50f3-43e5-8f42-a726b4e1cced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:59.356767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a568cdf-50f3-43e5-8f42-a726b4e1cced service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:59.366547 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1218/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:30:59.450168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd88d3-e01b-4db7-9347-de3f1edfa3b6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:30:59.462094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd88d3-e01b-4db7-9347-de3f1edfa3b6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:30:59.465727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b0a0f-9f1b-40b6-bcb6-2cbf65d8c920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:30:59.466331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0a0f-9f1b-40b6-bcb6-2cbf65d8c920 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:30:59.466608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0a0f-9f1b-40b6-bcb6-2cbf65d8c920 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:30:59.467151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0a0f-9f1b-40b6-bcb6-2cbf65d8c920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:30:59.528033 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b0a0f-9f1b-40b6-bcb6-2cbf65d8c920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:30:59.529476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b0a0f-9f1b-40b6-bcb6-2cbf65d8c920 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:30:59.539946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1260/2478] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:30:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:06.409345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a568cdf-50f3-43e5-8f42-a726b4e1cced service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:06.471472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a568cdf-50f3-43e5-8f42-a726b4e1cced service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:06.476020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:06.476637 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:06.476919 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:06.477187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] PATH_INFO: `/v3/users/df665770acce412c831830c2d4c110eb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:06.478301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] RBAC: Authorizing `identity:delete_user(user_id=df665770acce412c831830c2d4c110eb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:06.480235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:06.525902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df665770acce412c831830c2d4c110eb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:06.533016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df665770acce412c831830c2d4c110eb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:06.533628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df665770acce412c831830c2d4c110eb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:06.534230 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df665770acce412c831830c2d4c110eb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:06.541098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df665770acce412c831830c2d4c110eb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:06.557719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1219/2479] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:06 2022] DELETE /identity/v3/users/df665770acce412c831830c2d4c110eb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:06.563147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33819a7-8fa6-49ff-b10e-a8669110c494 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:06.563619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33819a7-8fa6-49ff-b10e-a8669110c494 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:06.563733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33819a7-8fa6-49ff-b10e-a8669110c494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:06.583022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c33819a7-8fa6-49ff-b10e-a8669110c494 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:06.584244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c33819a7-8fa6-49ff-b10e-a8669110c494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:06.642363 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1261/2480] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:06.652938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:06.654364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:06.700678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:06.714188 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3d0c-2b7f-4080-8693-3bb45d5d598f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:06.718205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf775a9-0728-44b1-a1df-da1a27c4c3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:06.718807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf775a9-0728-44b1-a1df-da1a27c4c3ce service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:06.719081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf775a9-0728-44b1-a1df-da1a27c4c3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:06.719354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf775a9-0728-44b1-a1df-da1a27c4c3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:06.728213 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf775a9-0728-44b1-a1df-da1a27c4c3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:06.729628 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf775a9-0728-44b1-a1df-da1a27c4c3ce service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:06.738901 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1220/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:07.252011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33819a7-8fa6-49ff-b10e-a8669110c494 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:07.253434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c33819a7-8fa6-49ff-b10e-a8669110c494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:07.266095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33819a7-8fa6-49ff-b10e-a8669110c494 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:07.270951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:07.271579 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:07.271854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:07.272193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] PATH_INFO: `/v3/projects/e8bb7743cb774f3e95967a1f29befdf4` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:07.273339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8bb7743cb774f3e95967a1f29befdf4)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:07.275270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:07.311229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:07.325618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bb7743cb774f3e95967a1f29befdf4', 'request_id': 'req-0025b9ae-9b84-4f98-b908-b764cb4479ed'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.332084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bb7743cb774f3e95967a1f29befdf4', 'request_id': 'req-0025b9ae-9b84-4f98-b908-b764cb4479ed'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.339160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bb7743cb774f3e95967a1f29befdf4', 'request_id': 'req-0025b9ae-9b84-4f98-b908-b764cb4479ed'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.350253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] The token cache is being invalidate because project e8bb7743cb774f3e95967a1f29befdf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:07.350537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.351157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.352652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1262/2482] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:07 2022] DELETE /identity/v3/projects/e8bb7743cb774f3e95967a1f29befdf4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:07.356668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf775a9-0728-44b1-a1df-da1a27c4c3ce service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:07.366993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf775a9-0728-44b1-a1df-da1a27c4c3ce service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:07.424981 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6916d6f-fa4e-420e-a6ec-561e41b8201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:07.425638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6916d6f-fa4e-420e-a6ec-561e41b8201d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:07.425864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6916d6f-fa4e-420e-a6ec-561e41b8201d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:07.426136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6916d6f-fa4e-420e-a6ec-561e41b8201d admin admin] PATH_INFO: `/v3/users/e071c3f7a4e64b85812b176226914b00` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:07.427244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6916d6f-fa4e-420e-a6ec-561e41b8201d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e071c3f7a4e64b85812b176226914b00)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:07.429182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6916d6f-fa4e-420e-a6ec-561e41b8201d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:07.474312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d6916d6f-fa4e-420e-a6ec-561e41b8201d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e071c3f7a4e64b85812b176226914b00'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.481285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d6916d6f-fa4e-420e-a6ec-561e41b8201d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e071c3f7a4e64b85812b176226914b00'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.481902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d6916d6f-fa4e-420e-a6ec-561e41b8201d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e071c3f7a4e64b85812b176226914b00'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.482516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d6916d6f-fa4e-420e-a6ec-561e41b8201d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e071c3f7a4e64b85812b176226914b00'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.490010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d6916d6f-fa4e-420e-a6ec-561e41b8201d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e071c3f7a4e64b85812b176226914b00'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.506637 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1221/2483] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:07 2022] DELETE /identity/v3/users/e071c3f7a4e64b85812b176226914b00 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:07.776620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:07.778215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:07.792444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025b9ae-9b84-4f98-b908-b764cb4479ed admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:07.851037 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:07.851664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:07.851960 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:07.852233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] PATH_INFO: `/v3/projects/7b4682776488407db5f472af4b53fd7d` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:07.853331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4682776488407db5f472af4b53fd7d)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:07.855220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:07.900339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4682776488407db5f472af4b53fd7d', 'request_id': 'req-a0d6e342-6f76-4f57-a644-0952a58f9ca1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.907210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4682776488407db5f472af4b53fd7d', 'request_id': 'req-a0d6e342-6f76-4f57-a644-0952a58f9ca1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.913865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4682776488407db5f472af4b53fd7d', 'request_id': 'req-a0d6e342-6f76-4f57-a644-0952a58f9ca1'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.924842 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] The token cache is being invalidate because project 7b4682776488407db5f472af4b53fd7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:07.925131 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.925766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a0d6e342-6f76-4f57-a644-0952a58f9ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:07.927289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1263/2484] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:07 2022] DELETE /identity/v3/projects/7b4682776488407db5f472af4b53fd7d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:07.932297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad653a6-67df-48c3-b046-bf2ecd0288e2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:07.932582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad653a6-67df-48c3-b046-bf2ecd0288e2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:07.932888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad653a6-67df-48c3-b046-bf2ecd0288e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:07.953024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2ad653a6-67df-48c3-b046-bf2ecd0288e2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:07.954296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2ad653a6-67df-48c3-b046-bf2ecd0288e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:08.012610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1222/2485] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:08.021055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170a0d5-404c-4765-a88a-95ff9d7511c2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.021428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170a0d5-404c-4765-a88a-95ff9d7511c2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.021777 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170a0d5-404c-4765-a88a-95ff9d7511c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.041089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b170a0d5-404c-4765-a88a-95ff9d7511c2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:08.042286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b170a0d5-404c-4765-a88a-95ff9d7511c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:08.050436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1264/2486] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:08.054553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad653a6-67df-48c3-b046-bf2ecd0288e2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.060581 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:08.065464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad653a6-67df-48c3-b046-bf2ecd0288e2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.071080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e438d1-e42c-43da-a464-e1335119d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.071841 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e438d1-e42c-43da-a464-e1335119d19a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.072305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e438d1-e42c-43da-a464-e1335119d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.072627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e438d1-e42c-43da-a464-e1335119d19a admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.073460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e438d1-e42c-43da-a464-e1335119d19a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:31:08.073774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e438d1-e42c-43da-a464-e1335119d19a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.075368 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e438d1-e42c-43da-a464-e1335119d19a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.087598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1223/2487] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:31:08.092133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170a0d5-404c-4765-a88a-95ff9d7511c2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.101294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170a0d5-404c-4765-a88a-95ff9d7511c2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.105973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3763d-a8a8-46a4-a1e2-380c80f26f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.106559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3763d-a8a8-46a4-a1e2-380c80f26f2a admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.106836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3763d-a8a8-46a4-a1e2-380c80f26f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.107109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3763d-a8a8-46a4-a1e2-380c80f26f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.107736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3763d-a8a8-46a4-a1e2-380c80f26f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.109868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3763d-a8a8-46a4-a1e2-380c80f26f2a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.136940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1265/2488] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:31:08 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:08.141588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e438d1-e42c-43da-a464-e1335119d19a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.151558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e438d1-e42c-43da-a464-e1335119d19a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.206303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d662980-4d0d-40a3-a019-caf4abb8a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.206895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662980-4d0d-40a3-a019-caf4abb8a692 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.207171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662980-4d0d-40a3-a019-caf4abb8a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.207442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662980-4d0d-40a3-a019-caf4abb8a692 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.208087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d662980-4d0d-40a3-a019-caf4abb8a692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.209975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d662980-4d0d-40a3-a019-caf4abb8a692 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.230944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1224/2489] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:31:08 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:08.235089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3763d-a8a8-46a4-a1e2-380c80f26f2a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.245280 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3763d-a8a8-46a4-a1e2-380c80f26f2a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.250797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c4076-b8dd-42f7-9f32-44b3c2cd1561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.251386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c4076-b8dd-42f7-9f32-44b3c2cd1561 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.251667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c4076-b8dd-42f7-9f32-44b3c2cd1561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.251981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c4076-b8dd-42f7-9f32-44b3c2cd1561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.252617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c4076-b8dd-42f7-9f32-44b3c2cd1561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.254219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c4076-b8dd-42f7-9f32-44b3c2cd1561 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.263917 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1266/2490] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:08.268635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d662980-4d0d-40a3-a019-caf4abb8a692 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.278402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d662980-4d0d-40a3-a019-caf4abb8a692 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.283006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7393f23-23e9-4ffa-8cf6-5dfddc4f28c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.283590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7393f23-23e9-4ffa-8cf6-5dfddc4f28c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.283866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7393f23-23e9-4ffa-8cf6-5dfddc4f28c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.284170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7393f23-23e9-4ffa-8cf6-5dfddc4f28c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.284801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7393f23-23e9-4ffa-8cf6-5dfddc4f28c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.286379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7393f23-23e9-4ffa-8cf6-5dfddc4f28c2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.296822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1225/2491] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:08.300745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c4076-b8dd-42f7-9f32-44b3c2cd1561 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.310579 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c4076-b8dd-42f7-9f32-44b3c2cd1561 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.315753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdda751-2504-4a42-93a6-cb53e8a6c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.316449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdda751-2504-4a42-93a6-cb53e8a6c417 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.316729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdda751-2504-4a42-93a6-cb53e8a6c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.317000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdda751-2504-4a42-93a6-cb53e8a6c417 admin admin] PATH_INFO: `/v3/projects/5010dcd636c548ab82b06d83edd17cff/users/92ff797833f343ccb4245ef4750dfd11/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.320043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:08.333329 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdda751-2504-4a42-93a6-cb53e8a6c417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5010dcd636c548ab82b06d83edd17cff, user_id=92ff797833f343ccb4245ef4750dfd11, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.336030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdda751-2504-4a42-93a6-cb53e8a6c417 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.349073 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1267/2492] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:08 2022] PUT /identity/v3/projects/5010dcd636c548ab82b06d83edd17cff/users/92ff797833f343ccb4245ef4750dfd11/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:08.360844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cb635-c987-43bc-8972-3f678a92d2b2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.361129 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cb635-c987-43bc-8972-3f678a92d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.361405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cb635-c987-43bc-8972-3f678a92d2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.389283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7d0cb635-c987-43bc-8972-3f678a92d2b2 None None] MFA Rules not processed for user `92ff797833f343ccb4245ef4750dfd11`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:08.390613 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7d0cb635-c987-43bc-8972-3f678a92d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:08.454183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1226/2493] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:08.458621 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdda751-2504-4a42-93a6-cb53e8a6c417 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.519997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdda751-2504-4a42-93a6-cb53e8a6c417 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.524665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d893d2-d943-4360-ba3f-bcd9cd32e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.525264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d893d2-d943-4360-ba3f-bcd9cd32e951 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.525544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d893d2-d943-4360-ba3f-bcd9cd32e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.525819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d893d2-d943-4360-ba3f-bcd9cd32e951 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.526432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d893d2-d943-4360-ba3f-bcd9cd32e951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.528382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d893d2-d943-4360-ba3f-bcd9cd32e951 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.554566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1268/2494] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:31:08 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:08.558591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cb635-c987-43bc-8972-3f678a92d2b2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.569982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cb635-c987-43bc-8972-3f678a92d2b2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.626448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f13c5-8db6-4abd-9542-53c89c4c50c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.627068 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f13c5-8db6-4abd-9542-53c89c4c50c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.627465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f13c5-8db6-4abd-9542-53c89c4c50c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.627749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f13c5-8db6-4abd-9542-53c89c4c50c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.628414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f13c5-8db6-4abd-9542-53c89c4c50c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.630331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f13c5-8db6-4abd-9542-53c89c4c50c4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.638261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:08.653055 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1227/2495] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:31:08 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:31:08.656985 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d893d2-d943-4360-ba3f-bcd9cd32e951 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.667087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d893d2-d943-4360-ba3f-bcd9cd32e951 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.672321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eea22-02f5-4bb4-8917-d31837a59b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.672908 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eea22-02f5-4bb4-8917-d31837a59b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.673186 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eea22-02f5-4bb4-8917-d31837a59b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.673458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eea22-02f5-4bb4-8917-d31837a59b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.674089 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eea22-02f5-4bb4-8917-d31837a59b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.675689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eea22-02f5-4bb4-8917-d31837a59b02 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.687626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1269/2496] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:08.691814 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f13c5-8db6-4abd-9542-53c89c4c50c4 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.701678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f13c5-8db6-4abd-9542-53c89c4c50c4 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.707004 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148f7e9-ed4d-4a01-acef-d198d1dde5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.707578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148f7e9-ed4d-4a01-acef-d198d1dde5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.707854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148f7e9-ed4d-4a01-acef-d198d1dde5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.708187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148f7e9-ed4d-4a01-acef-d198d1dde5b0 admin admin] PATH_INFO: `/v3/projects/9254dced3eea451f9863a299d1de182d/users/24d5bb0101724d67a565058226bed0e9/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.724310 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148f7e9-ed4d-4a01-acef-d198d1dde5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9254dced3eea451f9863a299d1de182d, user_id=24d5bb0101724d67a565058226bed0e9, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.727031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148f7e9-ed4d-4a01-acef-d198d1dde5b0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.739776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1228/2497] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:08 2022] PUT /identity/v3/projects/9254dced3eea451f9863a299d1de182d/users/24d5bb0101724d67a565058226bed0e9/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:08.743645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eea22-02f5-4bb4-8917-d31837a59b02 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.754587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eea22-02f5-4bb4-8917-d31837a59b02 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.813517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b23678-db7d-4d49-9825-7eed7855c900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.814182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b23678-db7d-4d49-9825-7eed7855c900 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.814374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b23678-db7d-4d49-9825-7eed7855c900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.814645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b23678-db7d-4d49-9825-7eed7855c900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.815270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b23678-db7d-4d49-9825-7eed7855c900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.816933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b23678-db7d-4d49-9825-7eed7855c900 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.826609 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1270/2498] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:08.832031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148f7e9-ed4d-4a01-acef-d198d1dde5b0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.842846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148f7e9-ed4d-4a01-acef-d198d1dde5b0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:08.847507 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef0afa-f723-4dfa-920f-d0c6d507db8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:08.848197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef0afa-f723-4dfa-920f-d0c6d507db8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.848478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef0afa-f723-4dfa-920f-d0c6d507db8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.848756 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef0afa-f723-4dfa-920f-d0c6d507db8d admin admin] PATH_INFO: `/v3/projects/9254dced3eea451f9863a299d1de182d/users/24d5bb0101724d67a565058226bed0e9/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.850693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef0afa-f723-4dfa-920f-d0c6d507db8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9254dced3eea451f9863a299d1de182d, user_id=24d5bb0101724d67a565058226bed0e9, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:08.853360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef0afa-f723-4dfa-920f-d0c6d507db8d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:08.863797 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1229/2499] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:08 2022] PUT /identity/v3/projects/9254dced3eea451f9863a299d1de182d/users/24d5bb0101724d67a565058226bed0e9/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:31:08.874709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866db7ba-69d5-4e09-965a-fea9b1b0aa09 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:08.874990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866db7ba-69d5-4e09-965a-fea9b1b0aa09 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:08.875267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866db7ba-69d5-4e09-965a-fea9b1b0aa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:08.903218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-866db7ba-69d5-4e09-965a-fea9b1b0aa09 None None] MFA Rules not processed for user `24d5bb0101724d67a565058226bed0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:08.904471 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-866db7ba-69d5-4e09-965a-fea9b1b0aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:08.947075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:08.972573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1271/2500] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:08.983754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef0afa-f723-4dfa-920f-d0c6d507db8d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:08.985530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e6ef0afa-f723-4dfa-920f-d0c6d507db8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:09.042492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef0afa-f723-4dfa-920f-d0c6d507db8d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:09.046300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a3024-ad3c-49c5-b0fe-02bbe615c204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:09.046897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a3024-ad3c-49c5-b0fe-02bbe615c204 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:09.047175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a3024-ad3c-49c5-b0fe-02bbe615c204 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:09.047447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a3024-ad3c-49c5-b0fe-02bbe615c204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:09.056506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a3024-ad3c-49c5-b0fe-02bbe615c204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:09.057921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a3024-ad3c-49c5-b0fe-02bbe615c204 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:09.067728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1230/2501] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:09.452919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866db7ba-69d5-4e09-965a-fea9b1b0aa09 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:09.513711 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866db7ba-69d5-4e09-965a-fea9b1b0aa09 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:09.518171 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:09.518783 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:09.519055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:09.519338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] PATH_INFO: `/v3/users/92ff797833f343ccb4245ef4750dfd11` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:09.520434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ff797833f343ccb4245ef4750dfd11)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:09.522321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:09.568549 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ff797833f343ccb4245ef4750dfd11'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:09.576305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ff797833f343ccb4245ef4750dfd11'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:09.577492 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ff797833f343ccb4245ef4750dfd11'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:09.578284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ff797833f343ccb4245ef4750dfd11'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:09.589912 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ff797833f343ccb4245ef4750dfd11'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:09.602340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1272/2502] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:09 2022] DELETE /identity/v3/users/92ff797833f343ccb4245ef4750dfd11 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:09.606783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb6fa5-13c5-4572-9fee-c8dc61702172 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:09.607242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb6fa5-13c5-4572-9fee-c8dc61702172 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:09.607337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb6fa5-13c5-4572-9fee-c8dc61702172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:09.627520 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-61fb6fa5-13c5-4572-9fee-c8dc61702172 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:09.628743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-61fb6fa5-13c5-4572-9fee-c8dc61702172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:09.687609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1231/2503] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:09.697644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:09.699055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:09.756476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3501d66-c5e5-4f01-8598-32fed820d55f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:09.760077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5515fb-85a5-46aa-87bc-4e9d34f86065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:09.760665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5515fb-85a5-46aa-87bc-4e9d34f86065 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:09.760937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5515fb-85a5-46aa-87bc-4e9d34f86065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:09.761208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5515fb-85a5-46aa-87bc-4e9d34f86065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:09.770662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5515fb-85a5-46aa-87bc-4e9d34f86065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:09.772048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5515fb-85a5-46aa-87bc-4e9d34f86065 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:09.781845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1273/2504] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:10.053006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb6fa5-13c5-4572-9fee-c8dc61702172 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:10.054417 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-61fb6fa5-13c5-4572-9fee-c8dc61702172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:10.068291 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb6fa5-13c5-4572-9fee-c8dc61702172 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:10.076423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:10.077517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:10.078001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:10.078526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] PATH_INFO: `/v3/projects/5010dcd636c548ab82b06d83edd17cff` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:10.080475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=5010dcd636c548ab82b06d83edd17cff)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:10.083235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:10.139184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5010dcd636c548ab82b06d83edd17cff', 'request_id': 'req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.140654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:10.147634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5010dcd636c548ab82b06d83edd17cff', 'request_id': 'req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.156021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5010dcd636c548ab82b06d83edd17cff', 'request_id': 'req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.166268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] The token cache is being invalidate because project 5010dcd636c548ab82b06d83edd17cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:10.166557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.167185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.168715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1232/2505] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:10 2022] DELETE /identity/v3/projects/5010dcd636c548ab82b06d83edd17cff => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:10.173303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5515fb-85a5-46aa-87bc-4e9d34f86065 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:10.178212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:10.184481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5515fb-85a5-46aa-87bc-4e9d34f86065 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:10.241839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e156f-e309-49f6-8bd5-8841c3ffb9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:10.242461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e156f-e309-49f6-8bd5-8841c3ffb9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:10.242743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e156f-e309-49f6-8bd5-8841c3ffb9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:10.243018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e156f-e309-49f6-8bd5-8841c3ffb9a4 admin admin] PATH_INFO: `/v3/users/24d5bb0101724d67a565058226bed0e9` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:10.244170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e156f-e309-49f6-8bd5-8841c3ffb9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d5bb0101724d67a565058226bed0e9)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:10.246084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e156f-e309-49f6-8bd5-8841c3ffb9a4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:10.290157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-913e156f-e309-49f6-8bd5-8841c3ffb9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d5bb0101724d67a565058226bed0e9'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.298048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-913e156f-e309-49f6-8bd5-8841c3ffb9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d5bb0101724d67a565058226bed0e9'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.298664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-913e156f-e309-49f6-8bd5-8841c3ffb9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d5bb0101724d67a565058226bed0e9'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.299406 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-913e156f-e309-49f6-8bd5-8841c3ffb9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d5bb0101724d67a565058226bed0e9'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.311454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-913e156f-e309-49f6-8bd5-8841c3ffb9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d5bb0101724d67a565058226bed0e9'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.323383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1274/2506] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:10 2022] DELETE /identity/v3/users/24d5bb0101724d67a565058226bed0e9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:10.595044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:10.596495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:10.610024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800d8f5-1e88-4dd1-b4ab-dc79ab4d0ede admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:10.669192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:10.669821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:10.670101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:10.670380 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] PATH_INFO: `/v3/projects/9254dced3eea451f9863a299d1de182d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:10.671758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9254dced3eea451f9863a299d1de182d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:10.673694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:10.719611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9254dced3eea451f9863a299d1de182d', 'request_id': 'req-932d4ca9-f278-4857-b352-e7e6b353d670'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.725741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9254dced3eea451f9863a299d1de182d', 'request_id': 'req-932d4ca9-f278-4857-b352-e7e6b353d670'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.734321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9254dced3eea451f9863a299d1de182d', 'request_id': 'req-932d4ca9-f278-4857-b352-e7e6b353d670'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.744923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] The token cache is being invalidate because project 9254dced3eea451f9863a299d1de182d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:10.745215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.745838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-932d4ca9-f278-4857-b352-e7e6b353d670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:10.747302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1233/2507] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:10 2022] DELETE /identity/v3/projects/9254dced3eea451f9863a299d1de182d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:10.752543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12b82d-1ed7-4df5-9f50-ffba5bab7208 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:10.752861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12b82d-1ed7-4df5-9f50-ffba5bab7208 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:10.753141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12b82d-1ed7-4df5-9f50-ffba5bab7208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:10.772761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-8d12b82d-1ed7-4df5-9f50-ffba5bab7208 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:10.773988 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8d12b82d-1ed7-4df5-9f50-ffba5bab7208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:10.834916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1275/2508] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:10.843093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cb070-1734-4326-ad6d-ecc26f632ee3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:10.843324 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cb070-1734-4326-ad6d-ecc26f632ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:10.843737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cb070-1734-4326-ad6d-ecc26f632ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:10.863897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c26cb070-1734-4326-ad6d-ecc26f632ee3 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:10.865136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c26cb070-1734-4326-ad6d-ecc26f632ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:10.873043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1234/2509] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:31:10.878056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12b82d-1ed7-4df5-9f50-ffba5bab7208 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:10.887726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12b82d-1ed7-4df5-9f50-ffba5bab7208 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:10.893253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f6c5e-e274-4fe4-bbc3-02f5b0739ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:10.893845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f6c5e-e274-4fe4-bbc3-02f5b0739ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:10.894121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f6c5e-e274-4fe4-bbc3-02f5b0739ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:10.894392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f6c5e-e274-4fe4-bbc3-02f5b0739ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:10.895056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f6c5e-e274-4fe4-bbc3-02f5b0739ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:31:10.895353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f6c5e-e274-4fe4-bbc3-02f5b0739ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:10.896976 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f6c5e-e274-4fe4-bbc3-02f5b0739ebf admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:10.909173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1276/2510] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:31:10.913242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cb070-1734-4326-ad6d-ecc26f632ee3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:10.922567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cb070-1734-4326-ad6d-ecc26f632ee3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:10.927272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea60501-3d09-4521-a651-4c595f27cf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:10.927855 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea60501-3d09-4521-a651-4c595f27cf95 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:10.928168 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea60501-3d09-4521-a651-4c595f27cf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:10.928442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea60501-3d09-4521-a651-4c595f27cf95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:10.929062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea60501-3d09-4521-a651-4c595f27cf95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:10.930944 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea60501-3d09-4521-a651-4c595f27cf95 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:10.958239 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1235/2511] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:31:10 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:10.962501 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f6c5e-e274-4fe4-bbc3-02f5b0739ebf admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:10.973407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f6c5e-e274-4fe4-bbc3-02f5b0739ebf admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:10.977950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:11.031136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8334-07c6-4c29-972a-26e6311970f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.031738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8334-07c6-4c29-972a-26e6311970f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.032039 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8334-07c6-4c29-972a-26e6311970f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.032313 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8334-07c6-4c29-972a-26e6311970f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.032926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab8334-07c6-4c29-972a-26e6311970f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:11.034837 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab8334-07c6-4c29-972a-26e6311970f9 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:11.056571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1277/2512] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:31:10 2022] POST /identity/v3/users => generated 278 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:11.060876 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea60501-3d09-4521-a651-4c595f27cf95 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:11.071472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea60501-3d09-4521-a651-4c595f27cf95 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:11.076027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a742481-a3a6-437d-b4b0-0ae1c0e7df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.076609 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a742481-a3a6-437d-b4b0-0ae1c0e7df6c admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.077447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a742481-a3a6-437d-b4b0-0ae1c0e7df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.077715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a742481-a3a6-437d-b4b0-0ae1c0e7df6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.078367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a742481-a3a6-437d-b4b0-0ae1c0e7df6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:11.079964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a742481-a3a6-437d-b4b0-0ae1c0e7df6c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:11.089661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1236/2513] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:11.093808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8334-07c6-4c29-972a-26e6311970f9 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:11.103667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8334-07c6-4c29-972a-26e6311970f9 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:11.108563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf3b1d-6e2b-4742-93d6-4475e4fb7042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.109178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3b1d-6e2b-4742-93d6-4475e4fb7042 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.109458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3b1d-6e2b-4742-93d6-4475e4fb7042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.109732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf3b1d-6e2b-4742-93d6-4475e4fb7042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.110363 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf3b1d-6e2b-4742-93d6-4475e4fb7042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:11.112079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf3b1d-6e2b-4742-93d6-4475e4fb7042 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:11.124532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1278/2514] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:11.128909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a742481-a3a6-437d-b4b0-0ae1c0e7df6c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:11.138702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a742481-a3a6-437d-b4b0-0ae1c0e7df6c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:11.144032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96bf72-a889-4938-8d17-a092058b4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.144663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96bf72-a889-4938-8d17-a092058b4bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.144936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96bf72-a889-4938-8d17-a092058b4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.145254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96bf72-a889-4938-8d17-a092058b4bb1 admin admin] PATH_INFO: `/v3/projects/a01883ee328f4e1487171d59434dd912/users/9d0f0725e03b440db872cdb8d169374c/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.159404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96bf72-a889-4938-8d17-a092058b4bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01883ee328f4e1487171d59434dd912, user_id=9d0f0725e03b440db872cdb8d169374c, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:11.162062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96bf72-a889-4938-8d17-a092058b4bb1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:11.174560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1237/2515] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:11 2022] PUT /identity/v3/projects/a01883ee328f4e1487171d59434dd912/users/9d0f0725e03b440db872cdb8d169374c/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:11.185688 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68830b5-7c4d-4023-83b4-6589e4a40ea3 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.186861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68830b5-7c4d-4023-83b4-6589e4a40ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.186861 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68830b5-7c4d-4023-83b4-6589e4a40ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.214179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d68830b5-7c4d-4023-83b4-6589e4a40ea3 None None] MFA Rules not processed for user `9d0f0725e03b440db872cdb8d169374c`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:11.215385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d68830b5-7c4d-4023-83b4-6589e4a40ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:11.277931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1279/2516] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:11.282429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96bf72-a889-4938-8d17-a092058b4bb1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:11.288047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:11.346716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96bf72-a889-4938-8d17-a092058b4bb1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:11.351136 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fafeb-0ce0-4838-821b-a84a0d998c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.351731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fafeb-0ce0-4838-821b-a84a0d998c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.352036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fafeb-0ce0-4838-821b-a84a0d998c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.352310 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fafeb-0ce0-4838-821b-a84a0d998c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.352933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fafeb-0ce0-4838-821b-a84a0d998c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:11.354812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fafeb-0ce0-4838-821b-a84a0d998c9a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:11.382216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1238/2517] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:31:11 2022] POST /identity/v3/projects => generated 357 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:11.386405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68830b5-7c4d-4023-83b4-6589e4a40ea3 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:11.397237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68830b5-7c4d-4023-83b4-6589e4a40ea3 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:11.452932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb44a4b-1746-4817-a3c1-ca5a428b011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.453528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44a4b-1746-4817-a3c1-ca5a428b011a admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.453805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44a4b-1746-4817-a3c1-ca5a428b011a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.454075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb44a4b-1746-4817-a3c1-ca5a428b011a admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.454696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb44a4b-1746-4817-a3c1-ca5a428b011a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:11.456660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb44a4b-1746-4817-a3c1-ca5a428b011a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:11.477974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1280/2518] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:31:11 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:11.481979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fafeb-0ce0-4838-821b-a84a0d998c9a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:11.493037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fafeb-0ce0-4838-821b-a84a0d998c9a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:11.497660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781901-fb6d-4c40-9203-ab013efdb273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.498248 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781901-fb6d-4c40-9203-ab013efdb273 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.498588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781901-fb6d-4c40-9203-ab013efdb273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.499412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781901-fb6d-4c40-9203-ab013efdb273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.500090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8781901-fb6d-4c40-9203-ab013efdb273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:11.501672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8781901-fb6d-4c40-9203-ab013efdb273 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:11.512314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1239/2519] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:11.516727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb44a4b-1746-4817-a3c1-ca5a428b011a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:11.526615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb44a4b-1746-4817-a3c1-ca5a428b011a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:11.531302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a0f2-ea40-40b2-b443-5633542663ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.531982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a0f2-ea40-40b2-b443-5633542663ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.532249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a0f2-ea40-40b2-b443-5633542663ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.532571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a0f2-ea40-40b2-b443-5633542663ae admin admin] PATH_INFO: `/v3/projects/b298adcdcf0b4f6ea68b6ca902617dee/users/7f6e6e8004ce456285534c53605bd634/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.534878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:11.549473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99a0f2-ea40-40b2-b443-5633542663ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b298adcdcf0b4f6ea68b6ca902617dee, user_id=7f6e6e8004ce456285534c53605bd634, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:11.552129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99a0f2-ea40-40b2-b443-5633542663ae admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:11.565545 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1281/2520] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:11 2022] PUT /identity/v3/projects/b298adcdcf0b4f6ea68b6ca902617dee/users/7f6e6e8004ce456285534c53605bd634/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:11.569509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781901-fb6d-4c40-9203-ab013efdb273 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:11.579522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781901-fb6d-4c40-9203-ab013efdb273 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:11.634594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd682b2-28ae-41fb-8b05-66c3b31fad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.635223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd682b2-28ae-41fb-8b05-66c3b31fad54 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.635378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd682b2-28ae-41fb-8b05-66c3b31fad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.635644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd682b2-28ae-41fb-8b05-66c3b31fad54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.636312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd682b2-28ae-41fb-8b05-66c3b31fad54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:11.637900 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd682b2-28ae-41fb-8b05-66c3b31fad54 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:11.647679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1240/2521] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:31:11.651798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a0f2-ea40-40b2-b443-5633542663ae admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:11.662748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a0f2-ea40-40b2-b443-5633542663ae admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:11.667361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1d595-bfd9-4009-91a9-63094c697777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.668030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d595-bfd9-4009-91a9-63094c697777 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.668307 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d595-bfd9-4009-91a9-63094c697777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.668576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1d595-bfd9-4009-91a9-63094c697777 admin admin] PATH_INFO: `/v3/projects/b298adcdcf0b4f6ea68b6ca902617dee/users/7f6e6e8004ce456285534c53605bd634/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.670952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1d595-bfd9-4009-91a9-63094c697777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b298adcdcf0b4f6ea68b6ca902617dee, user_id=7f6e6e8004ce456285534c53605bd634, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:11.673987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1d595-bfd9-4009-91a9-63094c697777 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:11.684048 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1282/2522] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:11 2022] PUT /identity/v3/projects/b298adcdcf0b4f6ea68b6ca902617dee/users/7f6e6e8004ce456285534c53605bd634/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:11.694804 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b66000-53c5-424c-80b1-9a3ec8f28fa7 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.695095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b66000-53c5-424c-80b1-9a3ec8f28fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.695376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b66000-53c5-424c-80b1-9a3ec8f28fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.723610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c1b66000-53c5-424c-80b1-9a3ec8f28fa7 None None] MFA Rules not processed for user `7f6e6e8004ce456285534c53605bd634`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:11.724879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c1b66000-53c5-424c-80b1-9a3ec8f28fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:11.790220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:11.794606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1241/2523] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:11.806455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1d595-bfd9-4009-91a9-63094c697777 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:11.808230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-45f1d595-bfd9-4009-91a9-63094c697777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:11.867728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1d595-bfd9-4009-91a9-63094c697777 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:11.871506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672acda-f06c-4e5d-8c29-10bfd5689033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.872132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672acda-f06c-4e5d-8c29-10bfd5689033 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.872410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672acda-f06c-4e5d-8c29-10bfd5689033 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.872680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672acda-f06c-4e5d-8c29-10bfd5689033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:11.881602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672acda-f06c-4e5d-8c29-10bfd5689033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:11.883052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672acda-f06c-4e5d-8c29-10bfd5689033 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:11.892503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1283/2524] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:11.968247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b66000-53c5-424c-80b1-9a3ec8f28fa7 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:11.977728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b66000-53c5-424c-80b1-9a3ec8f28fa7 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:11.981297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9db8f-7541-4784-aec3-23ebf4016dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:11.981881 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9db8f-7541-4784-aec3-23ebf4016dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:11.982156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9db8f-7541-4784-aec3-23ebf4016dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:11.982426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9db8f-7541-4784-aec3-23ebf4016dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:12.038699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9db8f-7541-4784-aec3-23ebf4016dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:12.040262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9db8f-7541-4784-aec3-23ebf4016dc1 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:12.049738 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1242/2525] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:21.888151 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=38,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:22.045074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=28 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:25.764661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672acda-f06c-4e5d-8c29-10bfd5689033 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:25.766618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f672acda-f06c-4e5d-8c29-10bfd5689033 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:25.867421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672acda-f06c-4e5d-8c29-10bfd5689033 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:25.877868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed61a1-0b69-4db2-a1b0-bf681d186428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:25.877868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed61a1-0b69-4db2-a1b0-bf681d186428 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:25.877868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed61a1-0b69-4db2-a1b0-bf681d186428 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:25.878290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed61a1-0b69-4db2-a1b0-bf681d186428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:25.880043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-62ed61a1-0b69-4db2-a1b0-bf681d186428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:25.894605 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed61a1-0b69-4db2-a1b0-bf681d186428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:25.896391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed61a1-0b69-4db2-a1b0-bf681d186428 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:25.908900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1284/2526] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:26.996987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9db8f-7541-4784-aec3-23ebf4016dc1 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:27.072992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9db8f-7541-4784-aec3-23ebf4016dc1 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:27.078707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:27.079437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:27.079862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:27.080272 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] PATH_INFO: `/v3/users/9d0f0725e03b440db872cdb8d169374c` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:27.081632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0f0725e03b440db872cdb8d169374c)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:27.083611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:27.135757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0f0725e03b440db872cdb8d169374c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:27.144000 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0f0725e03b440db872cdb8d169374c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:27.144627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0f0725e03b440db872cdb8d169374c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:27.145233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0f0725e03b440db872cdb8d169374c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:27.152412 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0f0725e03b440db872cdb8d169374c'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:27.171363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1243/2527] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:26 2022] DELETE /identity/v3/users/9d0f0725e03b440db872cdb8d169374c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:27.175753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792e83c-b0af-4952-bd04-deeafd95d01f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:27.176277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792e83c-b0af-4952-bd04-deeafd95d01f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:27.176394 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792e83c-b0af-4952-bd04-deeafd95d01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:27.195602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0792e83c-b0af-4952-bd04-deeafd95d01f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:27.196780 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0792e83c-b0af-4952-bd04-deeafd95d01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:27.255333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1285/2528] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:27.265091 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:27.266534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:27.325379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9ef20-c75c-430a-939d-9372d5a58f73 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:27.329348 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd54393-e9fd-4c60-9590-96524de41009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:27.329941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54393-e9fd-4c60-9590-96524de41009 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:27.330216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54393-e9fd-4c60-9590-96524de41009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:27.330485 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd54393-e9fd-4c60-9590-96524de41009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:27.339301 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd54393-e9fd-4c60-9590-96524de41009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:27.340729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd54393-e9fd-4c60-9590-96524de41009 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:27.350501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1244/2529] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:27.690064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792e83c-b0af-4952-bd04-deeafd95d01f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:27.692095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0792e83c-b0af-4952-bd04-deeafd95d01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:27.715599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792e83c-b0af-4952-bd04-deeafd95d01f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:27.724674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:27.725893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:27.726532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:27.727163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] PATH_INFO: `/v3/projects/a01883ee328f4e1487171d59434dd912` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:27.729241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01883ee328f4e1487171d59434dd912)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:27.733470 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:27.792641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01883ee328f4e1487171d59434dd912', 'request_id': 'req-a002a713-6167-4dca-a99d-0f4e10bde3c5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:27.801428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01883ee328f4e1487171d59434dd912', 'request_id': 'req-a002a713-6167-4dca-a99d-0f4e10bde3c5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:27.810023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01883ee328f4e1487171d59434dd912', 'request_id': 'req-a002a713-6167-4dca-a99d-0f4e10bde3c5'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:27.827757 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] The token cache is being invalidate because project a01883ee328f4e1487171d59434dd912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:27.828083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:27.828840 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:27.831949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1286/2530] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:27 2022] DELETE /identity/v3/projects/a01883ee328f4e1487171d59434dd912 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:27.837725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd54393-e9fd-4c60-9590-96524de41009 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:27.855010 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd54393-e9fd-4c60-9590-96524de41009 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:27.882120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:27.948877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cd1cb-4cbb-4658-9215-627df845d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:27.949831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd1cb-4cbb-4658-9215-627df845d766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:27.951390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd1cb-4cbb-4658-9215-627df845d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:27.951390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd1cb-4cbb-4658-9215-627df845d766 admin admin] PATH_INFO: `/v3/users/7f6e6e8004ce456285534c53605bd634` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:27.956776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cd1cb-4cbb-4658-9215-627df845d766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6e6e8004ce456285534c53605bd634)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:27.958983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cd1cb-4cbb-4658-9215-627df845d766 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:28.057890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cc4cd1cb-4cbb-4658-9215-627df845d766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6e6e8004ce456285534c53605bd634'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:28.067222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cc4cd1cb-4cbb-4658-9215-627df845d766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6e6e8004ce456285534c53605bd634'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:28.067837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cc4cd1cb-4cbb-4658-9215-627df845d766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6e6e8004ce456285534c53605bd634'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:28.068939 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cc4cd1cb-4cbb-4658-9215-627df845d766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6e6e8004ce456285534c53605bd634'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:28.077299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cc4cd1cb-4cbb-4658-9215-627df845d766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6e6e8004ce456285534c53605bd634'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:28.108487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1245/2531] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:27 2022] DELETE /identity/v3/users/7f6e6e8004ce456285534c53605bd634 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:28.441442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:28.442906 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:28.456895 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002a713-6167-4dca-a99d-0f4e10bde3c5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:28.461979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:28.519781 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:28.520390 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:28.520668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:28.520940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] PATH_INFO: `/v3/projects/b298adcdcf0b4f6ea68b6ca902617dee` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:28.522051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b298adcdcf0b4f6ea68b6ca902617dee)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:28.524049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:28.571832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b298adcdcf0b4f6ea68b6ca902617dee', 'request_id': 'req-3fde357e-c03a-486b-883d-7ea4f4a88833'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:28.578516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b298adcdcf0b4f6ea68b6ca902617dee', 'request_id': 'req-3fde357e-c03a-486b-883d-7ea4f4a88833'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:28.585741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b298adcdcf0b4f6ea68b6ca902617dee', 'request_id': 'req-3fde357e-c03a-486b-883d-7ea4f4a88833'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:28.597339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] The token cache is being invalidate because project b298adcdcf0b4f6ea68b6ca902617dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:28.597626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:28.598257 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3fde357e-c03a-486b-883d-7ea4f4a88833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:28.599735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1287/2532] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:28 2022] DELETE /identity/v3/projects/b298adcdcf0b4f6ea68b6ca902617dee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:31:28.605587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa9c8d-95b7-42f7-bdc5-567c0a514b6a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:28.605860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa9c8d-95b7-42f7-bdc5-567c0a514b6a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:28.606135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa9c8d-95b7-42f7-bdc5-567c0a514b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:28.625805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-89aa9c8d-95b7-42f7-bdc5-567c0a514b6a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:28.627261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-89aa9c8d-95b7-42f7-bdc5-567c0a514b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:28.692391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1246/2533] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:28.701677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7375-7c4f-44f4-a39e-364d18a36715 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:28.701961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7375-7c4f-44f4-a39e-364d18a36715 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:28.702239 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7375-7c4f-44f4-a39e-364d18a36715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:28.724289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-bfed7375-7c4f-44f4-a39e-364d18a36715 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:28.725888 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bfed7375-7c4f-44f4-a39e-364d18a36715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:28.734032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1288/2534] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:28.738423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa9c8d-95b7-42f7-bdc5-567c0a514b6a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:28.748717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa9c8d-95b7-42f7-bdc5-567c0a514b6a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:28.754629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c37f-f7d3-45cf-a90e-ade74d066148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:28.755232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c37f-f7d3-45cf-a90e-ade74d066148 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:28.755541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c37f-f7d3-45cf-a90e-ade74d066148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:28.755817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c37f-f7d3-45cf-a90e-ade74d066148 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:28.756518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600c37f-f7d3-45cf-a90e-ade74d066148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:31:28.756820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600c37f-f7d3-45cf-a90e-ade74d066148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:28.758429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600c37f-f7d3-45cf-a90e-ade74d066148 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:28.770881 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1247/2535] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:31:28.775152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7375-7c4f-44f4-a39e-364d18a36715 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:28.785213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7375-7c4f-44f4-a39e-364d18a36715 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:28.789919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121ecaf-38ef-45b7-a9b0-be6ac8d5d2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:28.790505 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121ecaf-38ef-45b7-a9b0-be6ac8d5d2ee admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:28.790785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121ecaf-38ef-45b7-a9b0-be6ac8d5d2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:28.791055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121ecaf-38ef-45b7-a9b0-be6ac8d5d2ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:28.791670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121ecaf-38ef-45b7-a9b0-be6ac8d5d2ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:28.793605 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121ecaf-38ef-45b7-a9b0-be6ac8d5d2ee admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:28.820660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1289/2536] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:31:28 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:28.825072 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c37f-f7d3-45cf-a90e-ade74d066148 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:28.836121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c37f-f7d3-45cf-a90e-ade74d066148 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:28.863160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:28.895478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a8b25-579a-4fa9-98f3-51bd4336bc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:28.896103 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a8b25-579a-4fa9-98f3-51bd4336bc6e admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:28.896380 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a8b25-579a-4fa9-98f3-51bd4336bc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:28.896651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a8b25-579a-4fa9-98f3-51bd4336bc6e admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:28.897266 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a8b25-579a-4fa9-98f3-51bd4336bc6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:28.899173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a8b25-579a-4fa9-98f3-51bd4336bc6e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:28.926265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1248/2537] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:31:28 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:31:28.930347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121ecaf-38ef-45b7-a9b0-be6ac8d5d2ee admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:28.940866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121ecaf-38ef-45b7-a9b0-be6ac8d5d2ee admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:28.945348 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e87bcf-80aa-49f5-ae79-38e382247cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:28.945928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e87bcf-80aa-49f5-ae79-38e382247cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:28.946198 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e87bcf-80aa-49f5-ae79-38e382247cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:28.946466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e87bcf-80aa-49f5-ae79-38e382247cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:28.947088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e87bcf-80aa-49f5-ae79-38e382247cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:28.948756 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e87bcf-80aa-49f5-ae79-38e382247cc0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:28.959387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1290/2538] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:28.963282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a8b25-579a-4fa9-98f3-51bd4336bc6e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:28.974258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a8b25-579a-4fa9-98f3-51bd4336bc6e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:28.978888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be764a-c40c-4f40-bf91-a7903fc802f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:28.979473 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be764a-c40c-4f40-bf91-a7903fc802f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:28.979752 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be764a-c40c-4f40-bf91-a7903fc802f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:28.980055 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be764a-c40c-4f40-bf91-a7903fc802f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:28.980683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be764a-c40c-4f40-bf91-a7903fc802f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:28.982443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be764a-c40c-4f40-bf91-a7903fc802f9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:28.993062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1249/2539] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:31:28.996999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e87bcf-80aa-49f5-ae79-38e382247cc0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:29.007629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e87bcf-80aa-49f5-ae79-38e382247cc0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:29.012146 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ad56a-396c-4ee5-be3f-26d1c501fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:29.012776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad56a-396c-4ee5-be3f-26d1c501fbe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.013738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad56a-396c-4ee5-be3f-26d1c501fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.014236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad56a-396c-4ee5-be3f-26d1c501fbe3 admin admin] PATH_INFO: `/v3/projects/495024a4d0ea4ec199d85c516751881f/users/7994a40f12ba40b59433d94cc8841b58/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.028434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ad56a-396c-4ee5-be3f-26d1c501fbe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495024a4d0ea4ec199d85c516751881f, user_id=7994a40f12ba40b59433d94cc8841b58, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:29.031301 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ad56a-396c-4ee5-be3f-26d1c501fbe3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:29.043780 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1291/2540] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:28 2022] PUT /identity/v3/projects/495024a4d0ea4ec199d85c516751881f/users/7994a40f12ba40b59433d94cc8841b58/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:29.054404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e1075-213a-4c05-87a6-690bb8de6e53 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.054691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e1075-213a-4c05-87a6-690bb8de6e53 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.055018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e1075-213a-4c05-87a6-690bb8de6e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.084028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-f74e1075-213a-4c05-87a6-690bb8de6e53 None None] MFA Rules not processed for user `7994a40f12ba40b59433d94cc8841b58`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:29.085252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f74e1075-213a-4c05-87a6-690bb8de6e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:29.149377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1250/2541] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:31:29.153901 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ad56a-396c-4ee5-be3f-26d1c501fbe3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:29.191716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:29.218043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ad56a-396c-4ee5-be3f-26d1c501fbe3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:29.222749 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed512c8-ad1f-4875-b2d7-6e294fa7e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:29.223427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed512c8-ad1f-4875-b2d7-6e294fa7e05f admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.223721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed512c8-ad1f-4875-b2d7-6e294fa7e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.224028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed512c8-ad1f-4875-b2d7-6e294fa7e05f admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.224649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed512c8-ad1f-4875-b2d7-6e294fa7e05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:29.226579 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed512c8-ad1f-4875-b2d7-6e294fa7e05f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:29.255745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1292/2542] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:31:29 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:29.259161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e1075-213a-4c05-87a6-690bb8de6e53 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:29.270388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e1075-213a-4c05-87a6-690bb8de6e53 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:29.328618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6e8af-82a6-41bf-b632-d31af60de239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:29.329461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6e8af-82a6-41bf-b632-d31af60de239 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.329748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6e8af-82a6-41bf-b632-d31af60de239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.330022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6e8af-82a6-41bf-b632-d31af60de239 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.330651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6e8af-82a6-41bf-b632-d31af60de239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:29.332615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6e8af-82a6-41bf-b632-d31af60de239 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:29.355936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1251/2543] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:31:29 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:29.359849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed512c8-ad1f-4875-b2d7-6e294fa7e05f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:29.371018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed512c8-ad1f-4875-b2d7-6e294fa7e05f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:29.376588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4504047-d819-4706-b604-b8e46b026934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:29.377310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4504047-d819-4706-b604-b8e46b026934 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.377602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4504047-d819-4706-b604-b8e46b026934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.377866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4504047-d819-4706-b604-b8e46b026934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.378503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4504047-d819-4706-b604-b8e46b026934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:29.380256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4504047-d819-4706-b604-b8e46b026934 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:29.391996 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1293/2544] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:29.396054 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6e8af-82a6-41bf-b632-d31af60de239 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:29.423107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6e8af-82a6-41bf-b632-d31af60de239 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:29.428744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee979c29-91c8-41c6-96f2-95765d5fa204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:29.432094 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979c29-91c8-41c6-96f2-95765d5fa204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.432411 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979c29-91c8-41c6-96f2-95765d5fa204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.432695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979c29-91c8-41c6-96f2-95765d5fa204 admin admin] PATH_INFO: `/v3/projects/c798cdc6739b4619b335d7cda1d797d8/users/7f185a2811ce48918e0d9185292dfb69/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.452063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee979c29-91c8-41c6-96f2-95765d5fa204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c798cdc6739b4619b335d7cda1d797d8, user_id=7f185a2811ce48918e0d9185292dfb69, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:29.454702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee979c29-91c8-41c6-96f2-95765d5fa204 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:29.466051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4504047-d819-4706-b604-b8e46b026934 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:29.468602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b4504047-d819-4706-b604-b8e46b026934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:29.474964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1252/2545] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:29 2022] PUT /identity/v3/projects/c798cdc6739b4619b335d7cda1d797d8/users/7f185a2811ce48918e0d9185292dfb69/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:29.476002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee979c29-91c8-41c6-96f2-95765d5fa204 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:29.480395 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:29.536023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4504047-d819-4706-b604-b8e46b026934 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:29.545647 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee979c29-91c8-41c6-96f2-95765d5fa204 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:29.551516 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f65e3-a040-4816-90f5-8bba99dd7d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:29.552552 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f65e3-a040-4816-90f5-8bba99dd7d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.552933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f65e3-a040-4816-90f5-8bba99dd7d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.553275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f65e3-a040-4816-90f5-8bba99dd7d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.554033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f65e3-a040-4816-90f5-8bba99dd7d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:29.555993 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f65e3-a040-4816-90f5-8bba99dd7d59 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:29.573114 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1253/2546] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:31:29.575017 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f65e3-a040-4816-90f5-8bba99dd7d59 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:29.589265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f65e3-a040-4816-90f5-8bba99dd7d59 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:29.595980 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bcbf6-e653-4d2c-a752-0c6f3a4bbce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:29.596651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bcbf6-e653-4d2c-a752-0c6f3a4bbce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.596921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bcbf6-e653-4d2c-a752-0c6f3a4bbce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.597198 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bcbf6-e653-4d2c-a752-0c6f3a4bbce2 admin admin] PATH_INFO: `/v3/projects/c798cdc6739b4619b335d7cda1d797d8/users/7f185a2811ce48918e0d9185292dfb69/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.599174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bcbf6-e653-4d2c-a752-0c6f3a4bbce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c798cdc6739b4619b335d7cda1d797d8, user_id=7f185a2811ce48918e0d9185292dfb69, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:29.599928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e65fa-080a-4d72-8bc3-3f20c6bfffef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:29.600546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e65fa-080a-4d72-8bc3-3f20c6bfffef service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.600829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e65fa-080a-4d72-8bc3-3f20c6bfffef service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.601105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e65fa-080a-4d72-8bc3-3f20c6bfffef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.601962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bcbf6-e653-4d2c-a752-0c6f3a4bbce2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:29.603114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-013e65fa-080a-4d72-8bc3-3f20c6bfffef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:29.613218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1254/2547] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:29 2022] PUT /identity/v3/projects/c798cdc6739b4619b335d7cda1d797d8/users/7f185a2811ce48918e0d9185292dfb69/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:31:29.614523 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e65fa-080a-4d72-8bc3-3f20c6bfffef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:29.616179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e65fa-080a-4d72-8bc3-3f20c6bfffef service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:29.624474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eaa75-2be0-437d-bd0c-53e777983e77 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.624835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eaa75-2be0-437d-bd0c-53e777983e77 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.625039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eaa75-2be0-437d-bd0c-53e777983e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.626358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1294/2548] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:31:29.666725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-bc0eaa75-2be0-437d-bd0c-53e777983e77 None None] MFA Rules not processed for user `7f185a2811ce48918e0d9185292dfb69`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:29.668073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bc0eaa75-2be0-437d-bd0c-53e777983e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:29.760755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1255/2549] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:29.766786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cdf0-6706-4d39-98df-c4b8d5e23018 None None] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.766786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cdf0-6706-4d39-98df-c4b8d5e23018 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.766786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cdf0-6706-4d39-98df-c4b8d5e23018 None None] PATH_INFO: `/` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.767589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1295/2550] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:31:29.774551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eaa75-2be0-437d-bd0c-53e777983e77 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:29.775317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60b933-3330-4b75-8146-a9ba4dd5aa58 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.775600 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60b933-3330-4b75-8146-a9ba4dd5aa58 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.775876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60b933-3330-4b75-8146-a9ba4dd5aa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.776089 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bc0eaa75-2be0-437d-bd0c-53e777983e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:29.795528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1a60b933-3330-4b75-8146-a9ba4dd5aa58 None None] MFA Rules not processed for user `1d78e909fc894ddd9b35ead5fe68b898`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:29.796776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1a60b933-3330-4b75-8146-a9ba4dd5aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:29.844071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eaa75-2be0-437d-bd0c-53e777983e77 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:29.847928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b42bae-4b5a-472f-bf5d-7cbdbc76d841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:29.848543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42bae-4b5a-472f-bf5d-7cbdbc76d841 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.848890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42bae-4b5a-472f-bf5d-7cbdbc76d841 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.849108 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42bae-4b5a-472f-bf5d-7cbdbc76d841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.859597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b42bae-4b5a-472f-bf5d-7cbdbc76d841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:29.861057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b42bae-4b5a-472f-bf5d-7cbdbc76d841 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:29.862197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1296/2551] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:31:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:29.869423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60b933-3330-4b75-8146-a9ba4dd5aa58 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:29.870918 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1a60b933-3330-4b75-8146-a9ba4dd5aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:29.873359 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1256/2552] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:29.885453 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60b933-3330-4b75-8146-a9ba4dd5aa58 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:29.891718 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc4881-5f86-4432-b32f-030d91b589e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:29.892393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4881-5f86-4432-b32f-030d91b589e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:29.893187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4881-5f86-4432-b32f-030d91b589e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:29.893485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4881-5f86-4432-b32f-030d91b589e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:29.902255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc4881-5f86-4432-b32f-030d91b589e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:29.903779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc4881-5f86-4432-b32f-030d91b589e1 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:29.920085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1297/2553] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:31:30.007798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2053-35fe-4d03-a44b-597332d15cf9 None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:30.008443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2053-35fe-4d03-a44b-597332d15cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:30.008730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2053-35fe-4d03-a44b-597332d15cf9 None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:30.010098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1257/2554] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:31:30.016388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06100c-c641-4f50-978c-1d7965367728 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:30.016933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06100c-c641-4f50-978c-1d7965367728 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:30.017535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06100c-c641-4f50-978c-1d7965367728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:30.027792 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:30.040373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ce06100c-c641-4f50-978c-1d7965367728 None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:30.041586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ce06100c-c641-4f50-978c-1d7965367728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:30.115473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1298/2555] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:31:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:30.127614 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d2053-35fe-4d03-a44b-597332d15cf9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:30.139247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d2053-35fe-4d03-a44b-597332d15cf9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:30.143281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4470d5-5738-42b5-b453-72ac2af446e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:30.143875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4470d5-5738-42b5-b453-72ac2af446e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:30.144175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4470d5-5738-42b5-b453-72ac2af446e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:30.144449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4470d5-5738-42b5-b453-72ac2af446e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:30.155037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4470d5-5738-42b5-b453-72ac2af446e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:30.156499 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4470d5-5738-42b5-b453-72ac2af446e6 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:30.162329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:30.168455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1258/2556] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:30.217618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06100c-c641-4f50-978c-1d7965367728 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:30.228368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06100c-c641-4f50-978c-1d7965367728 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:30.233624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3944-5326-4ecc-9230-55488b66a871 tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f185a2811ce48918e0d9185292dfb69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c798cdc6739b4619b335d7cda1d797d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:30.234227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3944-5326-4ecc-9230-55488b66a871 tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:30.234508 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3944-5326-4ecc-9230-55488b66a871 tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:30.234782 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3944-5326-4ecc-9230-55488b66a871 tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:30.235422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3944-5326-4ecc-9230-55488b66a871 tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:31:30.235727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3944-5326-4ecc-9230-55488b66a871 tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:30.237371 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3944-5326-4ecc-9230-55488b66a871 tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:30.249798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1299/2557] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:31:30.254080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4470d5-5738-42b5-b453-72ac2af446e6 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:30.264682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4470d5-5738-42b5-b453-72ac2af446e6 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:30.269346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724a399-92d4-4fce-9365-7145e81518ac tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f185a2811ce48918e0d9185292dfb69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c798cdc6739b4619b335d7cda1d797d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:30.269945 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724a399-92d4-4fce-9365-7145e81518ac tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:30.270227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724a399-92d4-4fce-9365-7145e81518ac tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:30.270504 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724a399-92d4-4fce-9365-7145e81518ac tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:30.271121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724a399-92d4-4fce-9365-7145e81518ac tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:30.273160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724a399-92d4-4fce-9365-7145e81518ac tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:30.301634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1259/2558] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:31:30 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:31:30.305592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3944-5326-4ecc-9230-55488b66a871 tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:30.316816 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3944-5326-4ecc-9230-55488b66a871 tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:30.376376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7fcf6-4dab-4012-b9c3-75342930bb0a tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f185a2811ce48918e0d9185292dfb69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c798cdc6739b4619b335d7cda1d797d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:30.376905 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7fcf6-4dab-4012-b9c3-75342930bb0a tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:30.377182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7fcf6-4dab-4012-b9c3-75342930bb0a tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:30.377452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7fcf6-4dab-4012-b9c3-75342930bb0a tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:30.378081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7fcf6-4dab-4012-b9c3-75342930bb0a tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:31:30.378379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7fcf6-4dab-4012-b9c3-75342930bb0a tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:30.379992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7fcf6-4dab-4012-b9c3-75342930bb0a tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:30.391864 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1300/2559] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:31:30.430813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724a399-92d4-4fce-9365-7145e81518ac tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:30.442078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724a399-92d4-4fce-9365-7145e81518ac tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:30.446635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f185a2811ce48918e0d9185292dfb69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c798cdc6739b4619b335d7cda1d797d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:30.447254 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:30.447532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:30.447802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] PATH_INFO: `/v3/projects/6f41db3258d948d696e6bd42333a88a0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:30.448974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6f41db3258d948d696e6bd42333a88a0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:30.451267 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:30.499509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f41db3258d948d696e6bd42333a88a0', 'request_id': 'req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:30.505691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f41db3258d948d696e6bd42333a88a0', 'request_id': 'req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:30.513119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f41db3258d948d696e6bd42333a88a0', 'request_id': 'req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:30.527246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] The token cache is being invalidate because project 6f41db3258d948d696e6bd42333a88a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:30.527540 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:30.528247 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ae7ddd06-544a-4a19-9fe2-ee1477a46ade tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:30.530435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1260/2560] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:30 2022] DELETE /identity/v3/projects/6f41db3258d948d696e6bd42333a88a0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:30.723049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7fcf6-4dab-4012-b9c3-75342930bb0a tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:30.724845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-69a7fcf6-4dab-4012-b9c3-75342930bb0a tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:30.790950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7fcf6-4dab-4012-b9c3-75342930bb0a tempest-VolumeQuotaClassesTest-1429703754 tempest-VolumeQuotaClassesTest-1429703754-project-admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:30.814100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:30.856743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:30.857566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:30.857843 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:30.858115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] PATH_INFO: `/v3/users/7994a40f12ba40b59433d94cc8841b58` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:30.859292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7994a40f12ba40b59433d94cc8841b58)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:30.861252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:30.908718 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7994a40f12ba40b59433d94cc8841b58'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:30.916637 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7994a40f12ba40b59433d94cc8841b58'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:30.917303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7994a40f12ba40b59433d94cc8841b58'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:30.917929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7994a40f12ba40b59433d94cc8841b58'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:30.934819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7994a40f12ba40b59433d94cc8841b58'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:30.947061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1301/2561] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:30 2022] DELETE /identity/v3/users/7994a40f12ba40b59433d94cc8841b58 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:30.952237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ae78e-bf07-4449-8c9c-77256e48693d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:30.952648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ae78e-bf07-4449-8c9c-77256e48693d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:30.952809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ae78e-bf07-4449-8c9c-77256e48693d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:30.972731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-765ae78e-bf07-4449-8c9c-77256e48693d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:30.973955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-765ae78e-bf07-4449-8c9c-77256e48693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:31.034114 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1261/2562] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:31:31.045053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:31.046689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:31.107924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0f30e-6769-4091-84bf-f39b6c9c6180 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:31.111657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97448c2-a4e8-4b84-a10b-365ef5b33676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:31.112290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97448c2-a4e8-4b84-a10b-365ef5b33676 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:31.112569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97448c2-a4e8-4b84-a10b-365ef5b33676 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:31.112841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97448c2-a4e8-4b84-a10b-365ef5b33676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:31.121798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97448c2-a4e8-4b84-a10b-365ef5b33676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:31.123843 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97448c2-a4e8-4b84-a10b-365ef5b33676 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:31.133271 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1302/2563] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:31.409049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ae78e-bf07-4449-8c9c-77256e48693d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:31.410607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-765ae78e-bf07-4449-8c9c-77256e48693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:31.424342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ae78e-bf07-4449-8c9c-77256e48693d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:31.429148 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:31.429847 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:31.430707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:31.430707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] PATH_INFO: `/v3/projects/495024a4d0ea4ec199d85c516751881f` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:31.431719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=495024a4d0ea4ec199d85c516751881f)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:31.433651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:31.484745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495024a4d0ea4ec199d85c516751881f', 'request_id': 'req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:31.491121 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495024a4d0ea4ec199d85c516751881f', 'request_id': 'req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:31.494052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:31.499574 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495024a4d0ea4ec199d85c516751881f', 'request_id': 'req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:31.511334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] The token cache is being invalidate because project 495024a4d0ea4ec199d85c516751881f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:31.511624 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:31.512271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:31.513838 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1262/2564] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:31 2022] DELETE /identity/v3/projects/495024a4d0ea4ec199d85c516751881f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:31.517811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97448c2-a4e8-4b84-a10b-365ef5b33676 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:31.527350 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97448c2-a4e8-4b84-a10b-365ef5b33676 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:31.572157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:31.587563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef09fb-5049-405d-84da-cb7cc26d8e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:31.588251 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef09fb-5049-405d-84da-cb7cc26d8e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:31.588531 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef09fb-5049-405d-84da-cb7cc26d8e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:31.588881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef09fb-5049-405d-84da-cb7cc26d8e66 admin admin] PATH_INFO: `/v3/users/7f185a2811ce48918e0d9185292dfb69` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:31.590402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef09fb-5049-405d-84da-cb7cc26d8e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f185a2811ce48918e0d9185292dfb69)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:31.593294 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef09fb-5049-405d-84da-cb7cc26d8e66 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:31.642977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-68ef09fb-5049-405d-84da-cb7cc26d8e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f185a2811ce48918e0d9185292dfb69'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:31.651578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-68ef09fb-5049-405d-84da-cb7cc26d8e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f185a2811ce48918e0d9185292dfb69'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:31.652255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-68ef09fb-5049-405d-84da-cb7cc26d8e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f185a2811ce48918e0d9185292dfb69'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:31.652870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-68ef09fb-5049-405d-84da-cb7cc26d8e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f185a2811ce48918e0d9185292dfb69'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:31.665617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-68ef09fb-5049-405d-84da-cb7cc26d8e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f185a2811ce48918e0d9185292dfb69'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:31.677980 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1303/2565] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:31 2022] DELETE /identity/v3/users/7f185a2811ce48918e0d9185292dfb69 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:32.177863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:32.179348 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:32.198682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37acb0-45ea-41f1-81d3-eb46ab85eb8e admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:32.286622 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:32.287286 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:32.287534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:32.287813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] PATH_INFO: `/v3/projects/c798cdc6739b4619b335d7cda1d797d8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:32.288987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c798cdc6739b4619b335d7cda1d797d8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:32.291306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:32.357332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c798cdc6739b4619b335d7cda1d797d8', 'request_id': 'req-678984af-f47b-40b6-a36e-3f4499b5ad36'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:32.366126 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c798cdc6739b4619b335d7cda1d797d8', 'request_id': 'req-678984af-f47b-40b6-a36e-3f4499b5ad36'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:32.378965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c798cdc6739b4619b335d7cda1d797d8', 'request_id': 'req-678984af-f47b-40b6-a36e-3f4499b5ad36'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:32.396730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] The token cache is being invalidate because project c798cdc6739b4619b335d7cda1d797d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:32.397066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:32.397683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-678984af-f47b-40b6-a36e-3f4499b5ad36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:32.399233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1263/2566] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:32 2022] DELETE /identity/v3/projects/c798cdc6739b4619b335d7cda1d797d8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:32.404411 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f78b64-0035-45c6-be02-b073832494d1 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:32.404911 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f78b64-0035-45c6-be02-b073832494d1 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:32.405136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f78b64-0035-45c6-be02-b073832494d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:32.426066 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-35f78b64-0035-45c6-be02-b073832494d1 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:32.427341 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-35f78b64-0035-45c6-be02-b073832494d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:32.491091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1304/2567] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:32.499799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0b2b-5a42-4e0d-b991-7ed1335c12c9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:32.500341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0b2b-5a42-4e0d-b991-7ed1335c12c9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:32.500341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0b2b-5a42-4e0d-b991-7ed1335c12c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:32.522665 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-408a0b2b-5a42-4e0d-b991-7ed1335c12c9 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:32.523961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-408a0b2b-5a42-4e0d-b991-7ed1335c12c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:32.531998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1264/2568] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:31:32.536185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f78b64-0035-45c6-be02-b073832494d1 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:32.546244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f78b64-0035-45c6-be02-b073832494d1 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:32.550799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31288e1f-950b-4e4e-854b-65c601380018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:32.551386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31288e1f-950b-4e4e-854b-65c601380018 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:32.551664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31288e1f-950b-4e4e-854b-65c601380018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:32.551979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31288e1f-950b-4e4e-854b-65c601380018 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:32.552595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31288e1f-950b-4e4e-854b-65c601380018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:31:32.552896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31288e1f-950b-4e4e-854b-65c601380018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:32.554482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31288e1f-950b-4e4e-854b-65c601380018 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:32.566487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1305/2569] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:31:32.573000 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a0b2b-5a42-4e0d-b991-7ed1335c12c9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:32.585953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a0b2b-5a42-4e0d-b991-7ed1335c12c9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:32.591176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef830f72-fb41-426e-910c-4affce203010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:32.592057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef830f72-fb41-426e-910c-4affce203010 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:32.592347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef830f72-fb41-426e-910c-4affce203010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:32.592619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef830f72-fb41-426e-910c-4affce203010 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:32.593245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef830f72-fb41-426e-910c-4affce203010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:32.595183 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef830f72-fb41-426e-910c-4affce203010 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:32.626714 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1265/2570] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:31:32 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:32.631032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31288e1f-950b-4e4e-854b-65c601380018 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:32.641258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31288e1f-950b-4e4e-854b-65c601380018 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:32.695334 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:32.710596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4db9-7fdd-4543-b4ed-665d5cccd820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:32.711224 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4db9-7fdd-4543-b4ed-665d5cccd820 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:32.712000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4db9-7fdd-4543-b4ed-665d5cccd820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:32.712353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4db9-7fdd-4543-b4ed-665d5cccd820 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:32.713311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff4db9-7fdd-4543-b4ed-665d5cccd820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:32.717789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff4db9-7fdd-4543-b4ed-665d5cccd820 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:32.746952 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1306/2571] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:31:32 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:32.751135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef830f72-fb41-426e-910c-4affce203010 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:32.762795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef830f72-fb41-426e-910c-4affce203010 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:32.768471 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e801c-7b90-489e-91e1-1096269ba539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:32.769112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e801c-7b90-489e-91e1-1096269ba539 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:32.769391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e801c-7b90-489e-91e1-1096269ba539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:32.769897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e801c-7b90-489e-91e1-1096269ba539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:32.770710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e801c-7b90-489e-91e1-1096269ba539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:32.772372 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e801c-7b90-489e-91e1-1096269ba539 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:32.786142 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1266/2572] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:32.790632 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4db9-7fdd-4543-b4ed-665d5cccd820 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:32.803124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4db9-7fdd-4543-b4ed-665d5cccd820 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:32.808183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f09d7a-e949-4d9a-a021-3ea25aa4872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:32.808937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f09d7a-e949-4d9a-a021-3ea25aa4872a admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:32.809221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f09d7a-e949-4d9a-a021-3ea25aa4872a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:32.809565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f09d7a-e949-4d9a-a021-3ea25aa4872a admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:32.810222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f09d7a-e949-4d9a-a021-3ea25aa4872a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:32.812159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f09d7a-e949-4d9a-a021-3ea25aa4872a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:32.827462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1307/2573] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:32.832306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e801c-7b90-489e-91e1-1096269ba539 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:32.850069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e801c-7b90-489e-91e1-1096269ba539 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:32.855603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02da10-4e68-43de-883e-c38d453d8ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:32.856297 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02da10-4e68-43de-883e-c38d453d8ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:32.857235 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02da10-4e68-43de-883e-c38d453d8ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:32.857518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02da10-4e68-43de-883e-c38d453d8ec3 admin admin] PATH_INFO: `/v3/projects/dfa7411e77a240db8f304b8f8eda5491/users/2000f5fb068b43af8f8f9e09ab1172d6/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:32.873935 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02da10-4e68-43de-883e-c38d453d8ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa7411e77a240db8f304b8f8eda5491, user_id=2000f5fb068b43af8f8f9e09ab1172d6, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:32.876680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02da10-4e68-43de-883e-c38d453d8ec3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:32.893465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1267/2574] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:32 2022] PUT /identity/v3/projects/dfa7411e77a240db8f304b8f8eda5491/users/2000f5fb068b43af8f8f9e09ab1172d6/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:32.904974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c91f-6525-46ca-b5a4-c190940aa33d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:32.905268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c91f-6525-46ca-b5a4-c190940aa33d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:32.905543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c91f-6525-46ca-b5a4-c190940aa33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:32.935661 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b281c91f-6525-46ca-b5a4-c190940aa33d None None] MFA Rules not processed for user `2000f5fb068b43af8f8f9e09ab1172d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:32.936987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b281c91f-6525-46ca-b5a4-c190940aa33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:33.002096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1308/2575] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:33.006558 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02da10-4e68-43de-883e-c38d453d8ec3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:33.019011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:33.070063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02da10-4e68-43de-883e-c38d453d8ec3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:33.074634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec915a-cb43-497c-948f-209669d4c2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:33.075852 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec915a-cb43-497c-948f-209669d4c2af admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.076388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec915a-cb43-497c-948f-209669d4c2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.076701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec915a-cb43-497c-948f-209669d4c2af admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.077380 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec915a-cb43-497c-948f-209669d4c2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:33.079464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec915a-cb43-497c-948f-209669d4c2af admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:33.109299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1268/2576] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:31:33 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:33.113041 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c91f-6525-46ca-b5a4-c190940aa33d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:33.127359 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c91f-6525-46ca-b5a4-c190940aa33d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:33.199725 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d6e92-ade9-4c0e-a112-4b124dee2ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:33.201046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6e92-ade9-4c0e-a112-4b124dee2ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.201653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6e92-ade9-4c0e-a112-4b124dee2ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.202060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6e92-ade9-4c0e-a112-4b124dee2ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.202791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d6e92-ade9-4c0e-a112-4b124dee2ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:33.204894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d6e92-ade9-4c0e-a112-4b124dee2ad8 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:33.235553 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1309/2577] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:31:33 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:31:33.236854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec915a-cb43-497c-948f-209669d4c2af admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:33.247734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec915a-cb43-497c-948f-209669d4c2af admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:33.264065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c34b3f-2860-43ff-b2b2-0ac8a35b51ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:33.265037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c34b3f-2860-43ff-b2b2-0ac8a35b51ba admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.265333 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c34b3f-2860-43ff-b2b2-0ac8a35b51ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.265672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c34b3f-2860-43ff-b2b2-0ac8a35b51ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.266391 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c34b3f-2860-43ff-b2b2-0ac8a35b51ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:33.268258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c34b3f-2860-43ff-b2b2-0ac8a35b51ba admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:33.284893 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1269/2578] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:33.286304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d6e92-ade9-4c0e-a112-4b124dee2ad8 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:33.297136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d6e92-ade9-4c0e-a112-4b124dee2ad8 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:33.302428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592f6d2-41e6-47aa-b7ed-0bef6caef193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:33.303226 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592f6d2-41e6-47aa-b7ed-0bef6caef193 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.303592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592f6d2-41e6-47aa-b7ed-0bef6caef193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.303964 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592f6d2-41e6-47aa-b7ed-0bef6caef193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.304727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592f6d2-41e6-47aa-b7ed-0bef6caef193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:33.306653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592f6d2-41e6-47aa-b7ed-0bef6caef193 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:33.324339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1310/2579] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:33.325995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c34b3f-2860-43ff-b2b2-0ac8a35b51ba admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:33.336828 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c34b3f-2860-43ff-b2b2-0ac8a35b51ba admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:33.343109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c97e92-e31d-4b89-9496-6823df5f07d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:33.343837 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c97e92-e31d-4b89-9496-6823df5f07d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.344209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c97e92-e31d-4b89-9496-6823df5f07d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.344602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c97e92-e31d-4b89-9496-6823df5f07d2 admin admin] PATH_INFO: `/v3/projects/701db509a03347f483f1086bf1775c6a/users/587ba2e259de45aa9c577b107b073695/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.354648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60229-048e-48b4-81d3-07f908fa82c0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.354933 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60229-048e-48b4-81d3-07f908fa82c0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.355399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60229-048e-48b4-81d3-07f908fa82c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.367263 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c97e92-e31d-4b89-9496-6823df5f07d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=701db509a03347f483f1086bf1775c6a, user_id=587ba2e259de45aa9c577b107b073695, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:33.371534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c97e92-e31d-4b89-9496-6823df5f07d2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:33.382872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f6c60229-048e-48b4-81d3-07f908fa82c0 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:33.384265 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f6c60229-048e-48b4-81d3-07f908fa82c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:33.391951 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1270/2580] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:33 2022] PUT /identity/v3/projects/701db509a03347f483f1086bf1775c6a/users/587ba2e259de45aa9c577b107b073695/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:31:33.430172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:33.461617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50a260-f82d-4c9d-84ed-0d0746d28f3b None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.462515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50a260-f82d-4c9d-84ed-0d0746d28f3b None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.462515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50a260-f82d-4c9d-84ed-0d0746d28f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.474258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1311/2581] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 18 06:31:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:31:33.506155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-db50a260-f82d-4c9d-84ed-0d0746d28f3b None None] MFA Rules not processed for user `587ba2e259de45aa9c577b107b073695`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:33.507861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-db50a260-f82d-4c9d-84ed-0d0746d28f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:33.542340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c60229-048e-48b4-81d3-07f908fa82c0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:33.544055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f6c60229-048e-48b4-81d3-07f908fa82c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:33.587946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1271/2582] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:31:33.592836 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50a260-f82d-4c9d-84ed-0d0746d28f3b None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:33.634485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c60229-048e-48b4-81d3-07f908fa82c0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:33.640992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea0555-7aff-432e-bd01-f253f598fec5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:33.641599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea0555-7aff-432e-bd01-f253f598fec5 service swift] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.641876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea0555-7aff-432e-bd01-f253f598fec5 service swift] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.642222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea0555-7aff-432e-bd01-f253f598fec5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.643709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:33.651448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea0555-7aff-432e-bd01-f253f598fec5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:33.653061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea0555-7aff-432e-bd01-f253f598fec5 service swift] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:33.659861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50a260-f82d-4c9d-84ed-0d0746d28f3b None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:33.661326 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1312/2583] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:31:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 18 06:31:33.667530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51d21c-73f7-4ccb-af4e-76a950b3fd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:33.668271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d21c-73f7-4ccb-af4e-76a950b3fd7f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.668553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d21c-73f7-4ccb-af4e-76a950b3fd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.668956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d21c-73f7-4ccb-af4e-76a950b3fd7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.669649 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51d21c-73f7-4ccb-af4e-76a950b3fd7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:33.671741 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51d21c-73f7-4ccb-af4e-76a950b3fd7f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:33.701909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1272/2584] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:31:33 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:31:33.706065 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea0555-7aff-432e-bd01-f253f598fec5 service swift] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:33.717046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea0555-7aff-432e-bd01-f253f598fec5 service swift] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:33.780140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6f0b3-cca1-4267-9d3d-dec24bbd4e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:33.780746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6f0b3-cca1-4267-9d3d-dec24bbd4e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.781027 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6f0b3-cca1-4267-9d3d-dec24bbd4e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.781295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6f0b3-cca1-4267-9d3d-dec24bbd4e85 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.781908 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6f0b3-cca1-4267-9d3d-dec24bbd4e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:33.783810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6f0b3-cca1-4267-9d3d-dec24bbd4e85 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:33.806148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1313/2585] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:31:33 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:31:33.810988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51d21c-73f7-4ccb-af4e-76a950b3fd7f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:33.822245 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51d21c-73f7-4ccb-af4e-76a950b3fd7f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:33.828716 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b32b35-4d07-46f8-91cd-72d0b4d0b2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:33.829592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32b35-4d07-46f8-91cd-72d0b4d0b2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.829889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32b35-4d07-46f8-91cd-72d0b4d0b2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.830169 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32b35-4d07-46f8-91cd-72d0b4d0b2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.830827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b32b35-4d07-46f8-91cd-72d0b4d0b2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:33.832470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b32b35-4d07-46f8-91cd-72d0b4d0b2f1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:33.843927 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1273/2586] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:33.848012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6f0b3-cca1-4267-9d3d-dec24bbd4e85 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:33.859160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6f0b3-cca1-4267-9d3d-dec24bbd4e85 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:33.864462 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98815366-efac-4ca9-a821-13c91bc061c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:33.865118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98815366-efac-4ca9-a821-13c91bc061c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.865402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98815366-efac-4ca9-a821-13c91bc061c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.865679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98815366-efac-4ca9-a821-13c91bc061c0 admin admin] PATH_INFO: `/v3/projects/6e5a114b853e446aa027ba5fbcc622a0/users/2116a101fc0042cd8f12b25e574d64a0/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.882016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98815366-efac-4ca9-a821-13c91bc061c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5a114b853e446aa027ba5fbcc622a0, user_id=2116a101fc0042cd8f12b25e574d64a0, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:33.884709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98815366-efac-4ca9-a821-13c91bc061c0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:33.897727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1314/2587] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:33 2022] PUT /identity/v3/projects/6e5a114b853e446aa027ba5fbcc622a0/users/2116a101fc0042cd8f12b25e574d64a0/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:33.901733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b32b35-4d07-46f8-91cd-72d0b4d0b2f1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:33.912729 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b32b35-4d07-46f8-91cd-72d0b4d0b2f1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:33.971712 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a583f-8e15-414c-a114-4abaeb6d11eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:33.972337 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a583f-8e15-414c-a114-4abaeb6d11eb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:33.972612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a583f-8e15-414c-a114-4abaeb6d11eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:33.972880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a583f-8e15-414c-a114-4abaeb6d11eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:33.973511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a583f-8e15-414c-a114-4abaeb6d11eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:33.975088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a583f-8e15-414c-a114-4abaeb6d11eb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:33.989374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1274/2588] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:31:33.990550 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98815366-efac-4ca9-a821-13c91bc061c0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:34.001668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98815366-efac-4ca9-a821-13c91bc061c0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:34.006405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d103d4-f563-43c2-ad8b-7bd2cf319c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:34.007044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d103d4-f563-43c2-ad8b-7bd2cf319c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:34.007418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d103d4-f563-43c2-ad8b-7bd2cf319c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:34.007696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d103d4-f563-43c2-ad8b-7bd2cf319c41 admin admin] PATH_INFO: `/v3/projects/6e5a114b853e446aa027ba5fbcc622a0/users/2116a101fc0042cd8f12b25e574d64a0/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:34.012459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d103d4-f563-43c2-ad8b-7bd2cf319c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5a114b853e446aa027ba5fbcc622a0, user_id=2116a101fc0042cd8f12b25e574d64a0, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:34.012459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d103d4-f563-43c2-ad8b-7bd2cf319c41 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:34.026487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1315/2589] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:31:33 2022] PUT /identity/v3/projects/6e5a114b853e446aa027ba5fbcc622a0/users/2116a101fc0042cd8f12b25e574d64a0/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:34.036734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48537b-03f3-4a30-be7c-2b3f474f9611 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:34.037087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48537b-03f3-4a30-be7c-2b3f474f9611 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:34.037433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48537b-03f3-4a30-be7c-2b3f474f9611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:34.067059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ed48537b-03f3-4a30-be7c-2b3f474f9611 None None] MFA Rules not processed for user `2116a101fc0042cd8f12b25e574d64a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:34.068431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ed48537b-03f3-4a30-be7c-2b3f474f9611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:34.140378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1275/2590] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:31:34.151528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d103d4-f563-43c2-ad8b-7bd2cf319c41 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:34.153368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b4d103d4-f563-43c2-ad8b-7bd2cf319c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:34.185267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:34.213972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d103d4-f563-43c2-ad8b-7bd2cf319c41 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:34.218421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94605e-bc32-40c7-bac5-a7774bb23af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:34.219015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94605e-bc32-40c7-bac5-a7774bb23af1 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:34.219291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94605e-bc32-40c7-bac5-a7774bb23af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:34.219560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94605e-bc32-40c7-bac5-a7774bb23af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:34.276298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94605e-bc32-40c7-bac5-a7774bb23af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:34.277817 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94605e-bc32-40c7-bac5-a7774bb23af1 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:34.287603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1316/2591] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:35.881360 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48537b-03f3-4a30-be7c-2b3f474f9611 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:35.885132 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ed48537b-03f3-4a30-be7c-2b3f474f9611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:35.900222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48537b-03f3-4a30-be7c-2b3f474f9611 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:35.906418 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eabb9d-0dbe-4aa1-8d2b-8c0dbc9f2787 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:35.907111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eabb9d-0dbe-4aa1-8d2b-8c0dbc9f2787 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:35.907464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eabb9d-0dbe-4aa1-8d2b-8c0dbc9f2787 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:35.907807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eabb9d-0dbe-4aa1-8d2b-8c0dbc9f2787 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:35.957293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:35.977021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eabb9d-0dbe-4aa1-8d2b-8c0dbc9f2787 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:35.979292 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eabb9d-0dbe-4aa1-8d2b-8c0dbc9f2787 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:35.990216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1276/2592] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:36.604937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94605e-bc32-40c7-bac5-a7774bb23af1 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:36.614548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94605e-bc32-40c7-bac5-a7774bb23af1 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:36.618250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2891f7c-dc09-4953-afd5-9047770e8a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:36.619233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2891f7c-dc09-4953-afd5-9047770e8a8c service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:36.619233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2891f7c-dc09-4953-afd5-9047770e8a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:36.619433 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2891f7c-dc09-4953-afd5-9047770e8a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:36.630295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2891f7c-dc09-4953-afd5-9047770e8a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:36.631754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2891f7c-dc09-4953-afd5-9047770e8a8c service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:36.642938 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1317/2593] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:40.619456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eabb9d-0dbe-4aa1-8d2b-8c0dbc9f2787 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:40.686422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eabb9d-0dbe-4aa1-8d2b-8c0dbc9f2787 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:40.690955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:40.691570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:40.691843 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:40.692150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] PATH_INFO: `/v3/users/2000f5fb068b43af8f8f9e09ab1172d6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:40.693252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2000f5fb068b43af8f8f9e09ab1172d6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:40.695144 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:40.754839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2000f5fb068b43af8f8f9e09ab1172d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:40.764463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2000f5fb068b43af8f8f9e09ab1172d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:40.765469 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2000f5fb068b43af8f8f9e09ab1172d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:40.766460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2000f5fb068b43af8f8f9e09ab1172d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:40.776802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2000f5fb068b43af8f8f9e09ab1172d6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:40.811853 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1277/2594] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:40 2022] DELETE /identity/v3/users/2000f5fb068b43af8f8f9e09ab1172d6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:40.812686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d1563-47bc-482c-83c9-99c1faea83ed None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:40.813163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d1563-47bc-482c-83c9-99c1faea83ed None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:40.813298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d1563-47bc-482c-83c9-99c1faea83ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:40.842628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-644d1563-47bc-482c-83c9-99c1faea83ed None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:31:40.843851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-644d1563-47bc-482c-83c9-99c1faea83ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:40.918875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1318/2595] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:31:40.931874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:40.933325 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:40.998344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd7f1f-8879-49f1-abaa-68fd43437824 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:41.002486 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362bd0e-efd2-4350-8e3c-006721d46b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:41.003326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362bd0e-efd2-4350-8e3c-006721d46b1b service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:41.003535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362bd0e-efd2-4350-8e3c-006721d46b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:41.004060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362bd0e-efd2-4350-8e3c-006721d46b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:41.017706 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362bd0e-efd2-4350-8e3c-006721d46b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:41.019227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362bd0e-efd2-4350-8e3c-006721d46b1b service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:41.033908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1278/2596] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:31:41.090128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d1563-47bc-482c-83c9-99c1faea83ed None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:41.092741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-644d1563-47bc-482c-83c9-99c1faea83ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:41.108671 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d1563-47bc-482c-83c9-99c1faea83ed None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:41.116626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:41.117258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:41.117538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:41.117808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] PATH_INFO: `/v3/users/03b0ac401fa24aab91f20aaf08c44679` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:41.118954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b0ac401fa24aab91f20aaf08c44679)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:41.121163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:41.177656 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b0ac401fa24aab91f20aaf08c44679'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.185956 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b0ac401fa24aab91f20aaf08c44679'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.186777 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b0ac401fa24aab91f20aaf08c44679'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.187427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b0ac401fa24aab91f20aaf08c44679'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.195419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:41.201727 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b0ac401fa24aab91f20aaf08c44679'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.222023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1319/2597] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:41 2022] DELETE /identity/v3/users/03b0ac401fa24aab91f20aaf08c44679 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:41.490063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362bd0e-efd2-4350-8e3c-006721d46b1b service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:41.495839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:41.497878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:41.501937 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362bd0e-efd2-4350-8e3c-006721d46b1b service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:41.506155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:41.572322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:41.572950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:41.573226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:41.573498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] PATH_INFO: `/v3/projects/40e4cec50cb849fe9b9ea8b192c69f18` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:41.575127 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e4cec50cb849fe9b9ea8b192c69f18)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:41.577341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:41.582701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dec81-eec6-4253-89e6-87a33571d837 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:41.587323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:41.587980 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:41.588261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:41.588535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] PATH_INFO: `/v3/projects/dfa7411e77a240db8f304b8f8eda5491` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:41.589659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa7411e77a240db8f304b8f8eda5491)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:41.592395 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:41.628018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e4cec50cb849fe9b9ea8b192c69f18', 'request_id': 'req-d7649680-c134-4d7f-9396-0be56e6a096f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.634976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e4cec50cb849fe9b9ea8b192c69f18', 'request_id': 'req-d7649680-c134-4d7f-9396-0be56e6a096f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.641789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa7411e77a240db8f304b8f8eda5491', 'request_id': 'req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.644191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e4cec50cb849fe9b9ea8b192c69f18', 'request_id': 'req-d7649680-c134-4d7f-9396-0be56e6a096f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.648763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa7411e77a240db8f304b8f8eda5491', 'request_id': 'req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.656137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] The token cache is being invalidate because project 40e4cec50cb849fe9b9ea8b192c69f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:41.656437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.657215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.658959 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1279/2598] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:41 2022] DELETE /identity/v3/projects/40e4cec50cb849fe9b9ea8b192c69f18 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:41.659157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa7411e77a240db8f304b8f8eda5491', 'request_id': 'req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.663021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:41.664476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:41.670443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] The token cache is being invalidate because project dfa7411e77a240db8f304b8f8eda5491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:41.671241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.671385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.672955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1320/2599] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:41 2022] DELETE /identity/v3/projects/dfa7411e77a240db8f304b8f8eda5491 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:31:41.676758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:41.678085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:41.730454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7649680-c134-4d7f-9396-0be56e6a096f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:41.742567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f68d0-cbd9-4bc2-bb32-b9049fab8757 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:41.747972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:41.748595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:41.748875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:41.749157 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] PATH_INFO: `/v3/users/587ba2e259de45aa9c577b107b073695` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:41.750292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] RBAC: Authorizing `identity:delete_user(user_id=587ba2e259de45aa9c577b107b073695)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:41.752242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:41.765416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:41.773032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:41.792279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:41.792835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:41.793122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:41.793426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] PATH_INFO: `/v3/users/4e112ea9ae9c4695afce04f61df5804b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:41.794776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e112ea9ae9c4695afce04f61df5804b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:41.796747 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:41.800985 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587ba2e259de45aa9c577b107b073695'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.810136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587ba2e259de45aa9c577b107b073695'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.811167 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587ba2e259de45aa9c577b107b073695'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.812096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587ba2e259de45aa9c577b107b073695'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.825619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587ba2e259de45aa9c577b107b073695'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.842233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1321/2600] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:41 2022] DELETE /identity/v3/users/587ba2e259de45aa9c577b107b073695 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:41.856096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e112ea9ae9c4695afce04f61df5804b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.864031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e112ea9ae9c4695afce04f61df5804b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.864800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e112ea9ae9c4695afce04f61df5804b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.865415 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e112ea9ae9c4695afce04f61df5804b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.873831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e112ea9ae9c4695afce04f61df5804b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:41.893848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1280/2601] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:41 2022] DELETE /identity/v3/users/4e112ea9ae9c4695afce04f61df5804b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:42.096774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:42.099820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:42.152734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:42.154744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:42.181615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb40bf-67bb-4925-b615-53c3364f845f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:42.229387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4850b-a7e3-4c5b-94ad-d6d41b07da3c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:42.234976 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:42.235646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:42.235929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:42.236215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] PATH_INFO: `/v3/projects/701db509a03347f483f1086bf1775c6a` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:42.237331 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=701db509a03347f483f1086bf1775c6a)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:42.239265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:42.240291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:42.241029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:42.241410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:42.241766 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] PATH_INFO: `/v3/projects/908e169d82b748cb8e8a97f45718d4d6` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:42.242910 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=908e169d82b748cb8e8a97f45718d4d6)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:42.244915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:42.287058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:42.288028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701db509a03347f483f1086bf1775c6a', 'request_id': 'req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.294996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701db509a03347f483f1086bf1775c6a', 'request_id': 'req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.295761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908e169d82b748cb8e8a97f45718d4d6', 'request_id': 'req-d8114537-303a-4bc0-b870-d377a2254ada'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.304061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908e169d82b748cb8e8a97f45718d4d6', 'request_id': 'req-d8114537-303a-4bc0-b870-d377a2254ada'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.305406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701db509a03347f483f1086bf1775c6a', 'request_id': 'req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.309849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:42.312181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908e169d82b748cb8e8a97f45718d4d6', 'request_id': 'req-d8114537-303a-4bc0-b870-d377a2254ada'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.318807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] The token cache is being invalidate because project 701db509a03347f483f1086bf1775c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:42.319086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.320242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.323031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1281/2602] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:42 2022] DELETE /identity/v3/projects/701db509a03347f483f1086bf1775c6a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:42.327661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:42.329135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:42.330618 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] The token cache is being invalidate because project 908e169d82b748cb8e8a97f45718d4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:42.330972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.331726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.333449 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1322/2603] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:42 2022] DELETE /identity/v3/projects/908e169d82b748cb8e8a97f45718d4d6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:42.438591 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af87f3-8215-48e5-b2d1-c9d5d16a99dd admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:42.533834 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4de08-72ff-4834-9609-14003f6c7d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:42.534566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4de08-72ff-4834-9609-14003f6c7d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:42.535034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4de08-72ff-4834-9609-14003f6c7d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:42.535323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4de08-72ff-4834-9609-14003f6c7d6f admin admin] PATH_INFO: `/v3/users/2116a101fc0042cd8f12b25e574d64a0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:42.537742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4de08-72ff-4834-9609-14003f6c7d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2116a101fc0042cd8f12b25e574d64a0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:42.539847 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4de08-72ff-4834-9609-14003f6c7d6f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:42.632367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-70c4de08-72ff-4834-9609-14003f6c7d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2116a101fc0042cd8f12b25e574d64a0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.642222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-70c4de08-72ff-4834-9609-14003f6c7d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2116a101fc0042cd8f12b25e574d64a0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.642813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-70c4de08-72ff-4834-9609-14003f6c7d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2116a101fc0042cd8f12b25e574d64a0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.643479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-70c4de08-72ff-4834-9609-14003f6c7d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2116a101fc0042cd8f12b25e574d64a0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.651768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-70c4de08-72ff-4834-9609-14003f6c7d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2116a101fc0042cd8f12b25e574d64a0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:42.670918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1282/2604] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:31:42 2022] DELETE /identity/v3/users/2116a101fc0042cd8f12b25e574d64a0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:31:43.079897 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:31:43.081548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:31:43.097451 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8114537-303a-4bc0-b870-d377a2254ada admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:31:43.169179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:31:43.169833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:31:43.170107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:31:43.170379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] PATH_INFO: `/v3/projects/6e5a114b853e446aa027ba5fbcc622a0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:31:43.171581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5a114b853e446aa027ba5fbcc622a0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:31:43.173514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:31:43.221397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5a114b853e446aa027ba5fbcc622a0', 'request_id': 'req-b00b90cf-2641-460a-8727-7ca7aa2ff149'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:43.227495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5a114b853e446aa027ba5fbcc622a0', 'request_id': 'req-b00b90cf-2641-460a-8727-7ca7aa2ff149'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:43.234599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5a114b853e446aa027ba5fbcc622a0', 'request_id': 'req-b00b90cf-2641-460a-8727-7ca7aa2ff149'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:43.245241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] The token cache is being invalidate because project 6e5a114b853e446aa027ba5fbcc622a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:31:43.245528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:43.246173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-b00b90cf-2641-460a-8727-7ca7aa2ff149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:31:43.248631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1323/2605] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:31:43 2022] DELETE /identity/v3/projects/6e5a114b853e446aa027ba5fbcc622a0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:31:52.666510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=11,keystone:SELECT=79,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:31:53.242121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:32:12.071809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef4fce-43a1-40ae-8d65-0aa230122566 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:32:12.072358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef4fce-43a1-40ae-8d65-0aa230122566 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:32:12.072466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef4fce-43a1-40ae-8d65-0aa230122566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:32:12.092596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c1ef4fce-43a1-40ae-8d65-0aa230122566 None None] MFA Rules not processed for user `11898a78089f407aa67cae2c48f99d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:32:12.093839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c1ef4fce-43a1-40ae-8d65-0aa230122566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:32:12.148365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1283/2606] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:32:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:32:22.142689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=25 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:32:26.282183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b22240-8807-49d8-b7c1-7df5eee1d873 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:32:26.282745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b22240-8807-49d8-b7c1-7df5eee1d873 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:32:26.282745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b22240-8807-49d8-b7c1-7df5eee1d873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:32:26.305040 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e1b22240-8807-49d8-b7c1-7df5eee1d873 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:32:26.306284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e1b22240-8807-49d8-b7c1-7df5eee1d873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:32:26.375179 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1324/2607] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:32:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:32:26.388565 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef4fce-43a1-40ae-8d65-0aa230122566 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:32:26.390035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c1ef4fce-43a1-40ae-8d65-0aa230122566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:32:26.469736 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef4fce-43a1-40ae-8d65-0aa230122566 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:32:26.474793 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6c89a-4c86-438d-bf3e-83671a7d29a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:32:26.475399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6c89a-4c86-438d-bf3e-83671a7d29a2 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:32:26.475679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6c89a-4c86-438d-bf3e-83671a7d29a2 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:32:26.475980 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6c89a-4c86-438d-bf3e-83671a7d29a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:32:26.484732 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6c89a-4c86-438d-bf3e-83671a7d29a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:32:26.486322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6c89a-4c86-438d-bf3e-83671a7d29a2 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:32:26.494456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1284/2608] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:32:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:32:36.367567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=25 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:32:36.491394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=32 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:32:40.238559 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b22240-8807-49d8-b7c1-7df5eee1d873 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:32:40.240535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e1b22240-8807-49d8-b7c1-7df5eee1d873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:32:40.283365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6c89a-4c86-438d-bf3e-83671a7d29a2 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:32:40.285725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-27f6c89a-4c86-438d-bf3e-83671a7d29a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:32:40.401238 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6c89a-4c86-438d-bf3e-83671a7d29a2 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:32:40.406508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab01e7-37de-49e9-831b-10c004871d1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:32:40.406712 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b22240-8807-49d8-b7c1-7df5eee1d873 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:32:40.407112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab01e7-37de-49e9-831b-10c004871d1e service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:32:40.407400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab01e7-37de-49e9-831b-10c004871d1e service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:32:40.407753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab01e7-37de-49e9-831b-10c004871d1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:32:40.409430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-72ab01e7-37de-49e9-831b-10c004871d1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:32:40.411936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0fb30-5db8-49fc-8c28-63a9d64d2e56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:32:40.412523 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0fb30-5db8-49fc-8c28-63a9d64d2e56 service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:32:40.412800 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0fb30-5db8-49fc-8c28-63a9d64d2e56 service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:32:40.413072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0fb30-5db8-49fc-8c28-63a9d64d2e56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:32:40.420933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab01e7-37de-49e9-831b-10c004871d1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:32:40.421664 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0fb30-5db8-49fc-8c28-63a9d64d2e56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:32:40.422501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab01e7-37de-49e9-831b-10c004871d1e service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:32:40.423264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0fb30-5db8-49fc-8c28-63a9d64d2e56 service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:32:40.432408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1285/2609] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:32:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:32:40.433550 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1325/2610] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:32:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:32:41.731113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03539-29a3-44d1-bd8b-d929f2a1f25d None None] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:32:41.731617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03539-29a3-44d1-bd8b-d929f2a1f25d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:32:41.731715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03539-29a3-44d1-bd8b-d929f2a1f25d None None] PATH_INFO: `/` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:32:41.733009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1286/2611] 10.222.0.16 () {54 vars in 921 bytes} [Sun Sep 18 06:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 06:32:41.738113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8092-c64b-490a-80e4-8d60c2dcef78 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:32:41.738563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8092-c64b-490a-80e4-8d60c2dcef78 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:32:41.738689 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f8092-c64b-490a-80e4-8d60c2dcef78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:32:41.791436 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-247f8092-c64b-490a-80e4-8d60c2dcef78 None None] MFA Rules not processed for user `9b5585d29bcb4b03a1902fbf113f48e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:32:41.792898 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-247f8092-c64b-490a-80e4-8d60c2dcef78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:32:41.846373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:32:41.882846 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1326/2612] 10.222.0.16 () {58 vars in 1018 bytes} [Sun Sep 18 06:32:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:32:41.894526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd03539-29a3-44d1-bd8b-d929f2a1f25d None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:32:41.896205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-edd03539-29a3-44d1-bd8b-d929f2a1f25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:32:41.953914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd03539-29a3-44d1-bd8b-d929f2a1f25d None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:32:41.957419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a860ab4-1c15-49d7-8c70-8eb1eed7d3f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c498b5857f42f2ab84423f8f4ea11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:32:41.958003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a860ab4-1c15-49d7-8c70-8eb1eed7d3f3 service glance] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:32:41.958285 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a860ab4-1c15-49d7-8c70-8eb1eed7d3f3 service glance] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:32:41.958550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a860ab4-1c15-49d7-8c70-8eb1eed7d3f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:32:41.969517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a860ab4-1c15-49d7-8c70-8eb1eed7d3f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:32:41.971302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a860ab4-1c15-49d7-8c70-8eb1eed7d3f3 service glance] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:32:41.982938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1287/2613] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:32:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:32:44.564953 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b230-897d-432a-8d91-9ab513ee215a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:32:44.565458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b230-897d-432a-8d91-9ab513ee215a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:32:44.565564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b230-897d-432a-8d91-9ab513ee215a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:32:44.585691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e2d7b230-897d-432a-8d91-9ab513ee215a None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:32:44.586889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e2d7b230-897d-432a-8d91-9ab513ee215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:32:44.594852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1327/2614] 10.222.0.16 () {58 vars in 1009 bytes} [Sun Sep 18 06:32:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:32:44.606666 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a860ab4-1c15-49d7-8c70-8eb1eed7d3f3 service glance] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:32:44.617653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a860ab4-1c15-49d7-8c70-8eb1eed7d3f3 service glance] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:32:44.623220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a7254-963f-4215-8689-dba3402f91bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:32:44.623799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7254-963f-4215-8689-dba3402f91bb service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:32:44.624106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7254-963f-4215-8689-dba3402f91bb service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:32:44.624378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7254-963f-4215-8689-dba3402f91bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:32:44.632465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a7254-963f-4215-8689-dba3402f91bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:32:44.634015 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a7254-963f-4215-8689-dba3402f91bb service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:32:44.642554 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1288/2615] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:32:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 06:32:54.580080 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=17 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:32:54.639411 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=82 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:33:04.609181 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692f956-9c83-47ba-8405-a7c7afe309b6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:33:04.609679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692f956-9c83-47ba-8405-a7c7afe309b6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:33:04.609785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692f956-9c83-47ba-8405-a7c7afe309b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:33:04.629162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f692f956-9c83-47ba-8405-a7c7afe309b6 None None] MFA Rules not processed for user `4734057fc039462d8d04b5dbee141fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:33:04.630295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f692f956-9c83-47ba-8405-a7c7afe309b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:33:04.638561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1328/2616] 10.222.0.16 () {58 vars in 967 bytes} [Sun Sep 18 06:33:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:33:04.652435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a7254-963f-4215-8689-dba3402f91bb service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:33:04.663893 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a7254-963f-4215-8689-dba3402f91bb service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:33:04.669311 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a97ce5-639a-48ef-881e-1ee811981ba1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e0f04f474124698a46bed8dac01e30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:33:04.669908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97ce5-639a-48ef-881e-1ee811981ba1 service swift] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:33:04.670186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97ce5-639a-48ef-881e-1ee811981ba1 service swift] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:33:04.670461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97ce5-639a-48ef-881e-1ee811981ba1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:33:04.678657 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a97ce5-639a-48ef-881e-1ee811981ba1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:33:04.680265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a97ce5-639a-48ef-881e-1ee811981ba1 service swift] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:33:04.688757 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1289/2617] 10.222.0.16 () {60 vars in 1384 bytes} [Sun Sep 18 06:33:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 18 06:33:14.623720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:33:14.685378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:33:31.398677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692f956-9c83-47ba-8405-a7c7afe309b6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:33:31.400135 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f692f956-9c83-47ba-8405-a7c7afe309b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:33:31.477351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692f956-9c83-47ba-8405-a7c7afe309b6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:33:31.482517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751de02-845f-4079-94ce-40af9fe93043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:33:31.483188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751de02-845f-4079-94ce-40af9fe93043 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:33:31.483471 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751de02-845f-4079-94ce-40af9fe93043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:33:31.483746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751de02-845f-4079-94ce-40af9fe93043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:33:31.485529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0751de02-845f-4079-94ce-40af9fe93043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:33:31.543629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751de02-845f-4079-94ce-40af9fe93043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:33:31.545093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751de02-845f-4079-94ce-40af9fe93043 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:33:31.553819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1329/2618] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:33:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:33:37.639588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a97ce5-639a-48ef-881e-1ee811981ba1 service swift] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:33:37.641050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-64a97ce5-639a-48ef-881e-1ee811981ba1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:33:37.653873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a97ce5-639a-48ef-881e-1ee811981ba1 service swift] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:33:37.657660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c4fd3-69a7-471a-af71-43c44a0eee4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:33:37.658221 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4fd3-69a7-471a-af71-43c44a0eee4c service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:33:37.658498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4fd3-69a7-471a-af71-43c44a0eee4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:33:37.658781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4fd3-69a7-471a-af71-43c44a0eee4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:33:37.660509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e04c4fd3-69a7-471a-af71-43c44a0eee4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:33:37.746351 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c4fd3-69a7-471a-af71-43c44a0eee4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:33:37.747787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c4fd3-69a7-471a-af71-43c44a0eee4c service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:33:37.766982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1290/2619] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:33:41.549779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=57 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:33:43.757244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751de02-845f-4079-94ce-40af9fe93043 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:33:43.770594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751de02-845f-4079-94ce-40af9fe93043 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:33:43.775640 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb335e-1a8b-4d30-93df-bc956b17a134 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:33:43.776268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb335e-1a8b-4d30-93df-bc956b17a134 service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:33:43.776544 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb335e-1a8b-4d30-93df-bc956b17a134 service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:33:43.777923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb335e-1a8b-4d30-93df-bc956b17a134 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:33:43.779650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-8ffb335e-1a8b-4d30-93df-bc956b17a134 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:33:43.791236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb335e-1a8b-4d30-93df-bc956b17a134 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:33:43.794064 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb335e-1a8b-4d30-93df-bc956b17a134 service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:33:43.805117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1330/2620] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:33:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:33:43.824242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c4fd3-69a7-471a-af71-43c44a0eee4c service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:33:43.826145 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e04c4fd3-69a7-471a-af71-43c44a0eee4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:33:43.838900 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c4fd3-69a7-471a-af71-43c44a0eee4c service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:33:43.844488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:33:43.845113 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:33:43.845576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:33:43.846027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] PATH_INFO: `/v3/users/87bfa5ffd791423db5bd287e57318eb9` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:33:43.847344 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87bfa5ffd791423db5bd287e57318eb9)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:33:43.849319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:33:43.896856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87bfa5ffd791423db5bd287e57318eb9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:43.905317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87bfa5ffd791423db5bd287e57318eb9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:43.905910 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87bfa5ffd791423db5bd287e57318eb9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:43.906538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87bfa5ffd791423db5bd287e57318eb9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:43.913653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87bfa5ffd791423db5bd287e57318eb9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:43.931369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1291/2621] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:33:43 2022] DELETE /identity/v3/users/87bfa5ffd791423db5bd287e57318eb9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:33:44.108007 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb335e-1a8b-4d30-93df-bc956b17a134 service placement] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:33:44.120060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb335e-1a8b-4d30-93df-bc956b17a134 service placement] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:33:44.177098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:33:44.177724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:33:44.178002 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:33:44.178278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] PATH_INFO: `/v3/projects/366c4f65c9774d4c9096eb4c2be08aa3` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:33:44.179385 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=366c4f65c9774d4c9096eb4c2be08aa3)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:33:44.181438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:33:44.227786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366c4f65c9774d4c9096eb4c2be08aa3', 'request_id': 'req-61bf8ddf-1181-4812-bd90-02bd3715dbcd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.233884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366c4f65c9774d4c9096eb4c2be08aa3', 'request_id': 'req-61bf8ddf-1181-4812-bd90-02bd3715dbcd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.241420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366c4f65c9774d4c9096eb4c2be08aa3', 'request_id': 'req-61bf8ddf-1181-4812-bd90-02bd3715dbcd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.252115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] The token cache is being invalidate because project 366c4f65c9774d4c9096eb4c2be08aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:33:44.252398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.253012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.254471 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1331/2622] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:33:44 2022] DELETE /identity/v3/projects/366c4f65c9774d4c9096eb4c2be08aa3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:33:44.258466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:33:44.259918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:33:44.273791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37650347-44c5-4382-a7dd-c34b7f88f8e8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:33:44.306636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:33:44.331479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:33:44.332124 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:33:44.332401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:33:44.332673 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] PATH_INFO: `/v3/users/166c6d488fa548dd93e778e9e4804270` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:33:44.333780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166c6d488fa548dd93e778e9e4804270)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:33:44.335705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:33:44.380393 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166c6d488fa548dd93e778e9e4804270'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.389163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166c6d488fa548dd93e778e9e4804270'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.389795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166c6d488fa548dd93e778e9e4804270'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.390431 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166c6d488fa548dd93e778e9e4804270'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.397946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166c6d488fa548dd93e778e9e4804270'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.418345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1292/2623] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:33:44 2022] DELETE /identity/v3/users/166c6d488fa548dd93e778e9e4804270 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:33:44.593331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:33:44.594921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:33:44.614137 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf8ddf-1181-4812-bd90-02bd3715dbcd admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:33:44.673330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:33:44.673955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:33:44.674230 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:33:44.674498 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] PATH_INFO: `/v3/projects/71d269e4a52c4678a709406852a69af7` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:33:44.675595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d269e4a52c4678a709406852a69af7)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:33:44.677523 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:33:44.698421 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:33:44.725321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d269e4a52c4678a709406852a69af7', 'request_id': 'req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.731412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d269e4a52c4678a709406852a69af7', 'request_id': 'req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.738715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d269e4a52c4678a709406852a69af7', 'request_id': 'req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.749677 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] The token cache is being invalidate because project 71d269e4a52c4678a709406852a69af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:33:44.749959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.750591 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:33:44.752085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1332/2624] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:33:44 2022] DELETE /identity/v3/projects/71d269e4a52c4678a709406852a69af7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:33:54.414239 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:33:54.746586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:11.203122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:11.204577 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:11.268464 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72b703-74c4-4e1a-b8cf-8641515c8ff8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:11.319402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c6032-d617-4a4d-a9b3-7eef9922badb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:11.320055 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c6032-d617-4a4d-a9b3-7eef9922badb service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:11.320430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c6032-d617-4a4d-a9b3-7eef9922badb service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:11.320602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c6032-d617-4a4d-a9b3-7eef9922badb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:11.323006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b87c6032-d617-4a4d-a9b3-7eef9922badb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:11.389825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c6032-d617-4a4d-a9b3-7eef9922badb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:11.391253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c6032-d617-4a4d-a9b3-7eef9922badb service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:11.405119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1293/2625] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:15.075182 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:15.077266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:15.091430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaae0d7-5b72-4a1a-8cfb-e891cdd6a275 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:15.098384 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb96c-2eb1-4a43-a37e-be53f519f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:15.099116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb96c-2eb1-4a43-a37e-be53f519f8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:15.099464 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb96c-2eb1-4a43-a37e-be53f519f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:15.099835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb96c-2eb1-4a43-a37e-be53f519f8a4 admin admin] PATH_INFO: `/v3/users/11898a78089f407aa67cae2c48f99d7e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:15.101046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eb96c-2eb1-4a43-a37e-be53f519f8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11898a78089f407aa67cae2c48f99d7e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:15.103999 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eb96c-2eb1-4a43-a37e-be53f519f8a4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:15.154810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-443eb96c-2eb1-4a43-a37e-be53f519f8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11898a78089f407aa67cae2c48f99d7e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:15.166442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-443eb96c-2eb1-4a43-a37e-be53f519f8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11898a78089f407aa67cae2c48f99d7e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:15.167339 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-443eb96c-2eb1-4a43-a37e-be53f519f8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11898a78089f407aa67cae2c48f99d7e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:15.167979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-443eb96c-2eb1-4a43-a37e-be53f519f8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11898a78089f407aa67cae2c48f99d7e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:15.183457 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-443eb96c-2eb1-4a43-a37e-be53f519f8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11898a78089f407aa67cae2c48f99d7e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:15.196297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1333/2626] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:15 2022] DELETE /identity/v3/users/11898a78089f407aa67cae2c48f99d7e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:15.375843 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c6032-d617-4a4d-a9b3-7eef9922badb service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:15.386583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c6032-d617-4a4d-a9b3-7eef9922badb service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:15.475721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:15.476386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:15.476779 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:15.477062 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] PATH_INFO: `/v3/projects/17308b8e868549ad99dd2f65e801baf7` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:15.478486 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17308b8e868549ad99dd2f65e801baf7)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:15.480422 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:15.488999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:15.529685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17308b8e868549ad99dd2f65e801baf7', 'request_id': 'req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:15.536063 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17308b8e868549ad99dd2f65e801baf7', 'request_id': 'req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:15.544155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17308b8e868549ad99dd2f65e801baf7', 'request_id': 'req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:15.555511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] The token cache is being invalidate because project 17308b8e868549ad99dd2f65e801baf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:15.556288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:15.557128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2ddab0fa-c769-4bfc-98d7-0a0244fc0cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:15.558635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1294/2627] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:15 2022] DELETE /identity/v3/projects/17308b8e868549ad99dd2f65e801baf7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:15.563626 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2837e-55a7-46e7-9945-d6c5a10dbc0a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:15.563923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2837e-55a7-46e7-9945-d6c5a10dbc0a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:15.564193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2837e-55a7-46e7-9945-d6c5a10dbc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:15.613258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b6c2837e-55a7-46e7-9945-d6c5a10dbc0a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:15.614491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b6c2837e-55a7-46e7-9945-d6c5a10dbc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:15.676643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1334/2628] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:15.684872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30e07c-a987-4508-ae7e-6542127c1c94 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:15.685163 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30e07c-a987-4508-ae7e-6542127c1c94 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:15.685440 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30e07c-a987-4508-ae7e-6542127c1c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:15.705269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1e30e07c-a987-4508-ae7e-6542127c1c94 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:15.706496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1e30e07c-a987-4508-ae7e-6542127c1c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:15.715295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1295/2629] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:15.719589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2837e-55a7-46e7-9945-d6c5a10dbc0a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:15.729798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2837e-55a7-46e7-9945-d6c5a10dbc0a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:15.734808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692c2e1-6560-4da3-bfba-315537ad9035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:15.735413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c2e1-6560-4da3-bfba-315537ad9035 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:15.735694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c2e1-6560-4da3-bfba-315537ad9035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:15.735993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c2e1-6560-4da3-bfba-315537ad9035 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:15.736635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692c2e1-6560-4da3-bfba-315537ad9035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:34:15.736940 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692c2e1-6560-4da3-bfba-315537ad9035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:15.738530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692c2e1-6560-4da3-bfba-315537ad9035 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:15.751237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1335/2630] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:34:15.755410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30e07c-a987-4508-ae7e-6542127c1c94 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:15.765814 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30e07c-a987-4508-ae7e-6542127c1c94 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:15.770582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4341c3b-4ea6-4aa3-9108-f674e86dbd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:15.771176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4341c3b-4ea6-4aa3-9108-f674e86dbd15 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:15.771450 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4341c3b-4ea6-4aa3-9108-f674e86dbd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:15.771717 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4341c3b-4ea6-4aa3-9108-f674e86dbd15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:15.772399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4341c3b-4ea6-4aa3-9108-f674e86dbd15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:15.774314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4341c3b-4ea6-4aa3-9108-f674e86dbd15 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:15.812948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1296/2631] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:15 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:15.817220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692c2e1-6560-4da3-bfba-315537ad9035 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:15.833916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692c2e1-6560-4da3-bfba-315537ad9035 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:15.870643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:15.900850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdad440-8efc-45d5-9434-62abb70ec23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:15.901465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdad440-8efc-45d5-9434-62abb70ec23a admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:15.901743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdad440-8efc-45d5-9434-62abb70ec23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:15.902017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdad440-8efc-45d5-9434-62abb70ec23a admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:15.902646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdad440-8efc-45d5-9434-62abb70ec23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:15.904731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdad440-8efc-45d5-9434-62abb70ec23a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:15.933858 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1336/2632] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:15 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:15.935381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4341c3b-4ea6-4aa3-9108-f674e86dbd15 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:15.945999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4341c3b-4ea6-4aa3-9108-f674e86dbd15 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:15.950908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9db18-b80c-43c6-9981-ea3b26baa50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:15.951452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9db18-b80c-43c6-9981-ea3b26baa50d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:15.951763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9db18-b80c-43c6-9981-ea3b26baa50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:15.952070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9db18-b80c-43c6-9981-ea3b26baa50d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:15.952846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9db18-b80c-43c6-9981-ea3b26baa50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:15.954567 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9db18-b80c-43c6-9981-ea3b26baa50d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:15.968835 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1297/2633] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:15.970162 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdad440-8efc-45d5-9434-62abb70ec23a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:15.981236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdad440-8efc-45d5-9434-62abb70ec23a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:15.985936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf744351-4b5a-44d4-8a5c-d4e13d5b695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:15.986532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf744351-4b5a-44d4-8a5c-d4e13d5b695a admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:15.986812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf744351-4b5a-44d4-8a5c-d4e13d5b695a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:15.987083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf744351-4b5a-44d4-8a5c-d4e13d5b695a admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:15.987714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf744351-4b5a-44d4-8a5c-d4e13d5b695a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:15.989368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf744351-4b5a-44d4-8a5c-d4e13d5b695a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:16.001466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1337/2634] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:16.005775 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9db18-b80c-43c6-9981-ea3b26baa50d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:16.016799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9db18-b80c-43c6-9981-ea3b26baa50d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:16.021447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce27c6-7123-4759-801d-044a20db1244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:16.022098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce27c6-7123-4759-801d-044a20db1244 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:16.022435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce27c6-7123-4759-801d-044a20db1244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:16.022723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce27c6-7123-4759-801d-044a20db1244 admin admin] PATH_INFO: `/v3/projects/9ed1ad5d2fbf4e22b8d8369fa9f99590/users/00b12eaff436498f92d93595c8fc2729/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:16.038848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce27c6-7123-4759-801d-044a20db1244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed1ad5d2fbf4e22b8d8369fa9f99590, user_id=00b12eaff436498f92d93595c8fc2729, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:16.041931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce27c6-7123-4759-801d-044a20db1244 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:16.054106 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1298/2635] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:16 2022] PUT /identity/v3/projects/9ed1ad5d2fbf4e22b8d8369fa9f99590/users/00b12eaff436498f92d93595c8fc2729/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:34:16.065074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7258dc-4b2c-4695-8d73-d56a5d368605 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:16.065293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7258dc-4b2c-4695-8d73-d56a5d368605 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:16.065574 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7258dc-4b2c-4695-8d73-d56a5d368605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:16.093857 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fb7258dc-4b2c-4695-8d73-d56a5d368605 None None] MFA Rules not processed for user `00b12eaff436498f92d93595c8fc2729`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:16.095077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fb7258dc-4b2c-4695-8d73-d56a5d368605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:16.161923 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1338/2636] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:16.167308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce27c6-7123-4759-801d-044a20db1244 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:16.229969 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce27c6-7123-4759-801d-044a20db1244 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:16.234743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f98360-da37-4b89-acef-66d8bb8bdd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:16.235343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f98360-da37-4b89-acef-66d8bb8bdd8c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:16.235620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f98360-da37-4b89-acef-66d8bb8bdd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:16.235897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f98360-da37-4b89-acef-66d8bb8bdd8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:16.236551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f98360-da37-4b89-acef-66d8bb8bdd8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:16.238459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f98360-da37-4b89-acef-66d8bb8bdd8c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:16.265515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1299/2637] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:16 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:16.269555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7258dc-4b2c-4695-8d73-d56a5d368605 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:16.280407 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7258dc-4b2c-4695-8d73-d56a5d368605 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:16.336337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0bd1b-c897-464e-920e-f65a5b38a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:16.336905 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0bd1b-c897-464e-920e-f65a5b38a2ae admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:16.337278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0bd1b-c897-464e-920e-f65a5b38a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:16.337555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0bd1b-c897-464e-920e-f65a5b38a2ae admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:16.338174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0bd1b-c897-464e-920e-f65a5b38a2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:16.340107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0bd1b-c897-464e-920e-f65a5b38a2ae admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:16.363524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1339/2638] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:16 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:16.365645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f98360-da37-4b89-acef-66d8bb8bdd8c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:16.376356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f98360-da37-4b89-acef-66d8bb8bdd8c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:16.380952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc692-75af-4820-a21b-2f140378a5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:16.381532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc692-75af-4820-a21b-2f140378a5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:16.381804 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc692-75af-4820-a21b-2f140378a5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:16.382071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fc692-75af-4820-a21b-2f140378a5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:16.382695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fc692-75af-4820-a21b-2f140378a5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:16.384880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fc692-75af-4820-a21b-2f140378a5cb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:16.516566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1300/2639] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:16.520812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0bd1b-c897-464e-920e-f65a5b38a2ae admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:16.531552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0bd1b-c897-464e-920e-f65a5b38a2ae admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:16.537790 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ff3ee-4194-4560-8f51-74b1da7b20bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:16.538433 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ff3ee-4194-4560-8f51-74b1da7b20bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:16.538715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ff3ee-4194-4560-8f51-74b1da7b20bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:16.538994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ff3ee-4194-4560-8f51-74b1da7b20bc admin admin] PATH_INFO: `/v3/projects/b44b241a42e6488689edba223e0a6e80/users/d3bfa34607b44e978d065c5a05ee1e07/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:16.556383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ff3ee-4194-4560-8f51-74b1da7b20bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44b241a42e6488689edba223e0a6e80, user_id=d3bfa34607b44e978d065c5a05ee1e07, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:16.559044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ff3ee-4194-4560-8f51-74b1da7b20bc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:16.574531 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1340/2640] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:16 2022] PUT /identity/v3/projects/b44b241a42e6488689edba223e0a6e80/users/d3bfa34607b44e978d065c5a05ee1e07/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:16.578647 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc692-75af-4820-a21b-2f140378a5cb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:16.589371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fc692-75af-4820-a21b-2f140378a5cb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:16.592864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:16.647385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91093e-7a53-493d-b261-798adfb48349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:16.648036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91093e-7a53-493d-b261-798adfb48349 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:16.648315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91093e-7a53-493d-b261-798adfb48349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:16.648584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91093e-7a53-493d-b261-798adfb48349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:16.649214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91093e-7a53-493d-b261-798adfb48349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:16.650915 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91093e-7a53-493d-b261-798adfb48349 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:16.661389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1301/2641] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:16.667040 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ff3ee-4194-4560-8f51-74b1da7b20bc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:16.677362 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ff3ee-4194-4560-8f51-74b1da7b20bc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:16.682726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743059-80b5-49ec-9358-8b29466aba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:16.683367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743059-80b5-49ec-9358-8b29466aba7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:16.683652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743059-80b5-49ec-9358-8b29466aba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:16.683950 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743059-80b5-49ec-9358-8b29466aba7d admin admin] PATH_INFO: `/v3/projects/b44b241a42e6488689edba223e0a6e80/users/d3bfa34607b44e978d065c5a05ee1e07/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:16.685877 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af743059-80b5-49ec-9358-8b29466aba7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44b241a42e6488689edba223e0a6e80, user_id=d3bfa34607b44e978d065c5a05ee1e07, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:16.688550 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af743059-80b5-49ec-9358-8b29466aba7d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:16.693924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:16.699610 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1341/2642] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:16 2022] PUT /identity/v3/projects/b44b241a42e6488689edba223e0a6e80/users/d3bfa34607b44e978d065c5a05ee1e07/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:16.711588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c3b55-840f-47b3-90e9-bc54eddc10eb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:16.711880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c3b55-840f-47b3-90e9-bc54eddc10eb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:16.712232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c3b55-840f-47b3-90e9-bc54eddc10eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:16.739668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6c3c3b55-840f-47b3-90e9-bc54eddc10eb None None] MFA Rules not processed for user `d3bfa34607b44e978d065c5a05ee1e07`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:16.740921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6c3c3b55-840f-47b3-90e9-bc54eddc10eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:16.808271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1302/2643] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:16.819409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743059-80b5-49ec-9358-8b29466aba7d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:16.821119 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-af743059-80b5-49ec-9358-8b29466aba7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:16.904331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743059-80b5-49ec-9358-8b29466aba7d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:16.908024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7ddd0-cb7a-4f14-9024-899bc2e7a42b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:16.908620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ddd0-cb7a-4f14-9024-899bc2e7a42b service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:16.908896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ddd0-cb7a-4f14-9024-899bc2e7a42b service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:16.909163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ddd0-cb7a-4f14-9024-899bc2e7a42b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:16.918599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7ddd0-cb7a-4f14-9024-899bc2e7a42b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:16.920055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7ddd0-cb7a-4f14-9024-899bc2e7a42b service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:16.929308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1342/2644] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:17.003630 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c3b55-840f-47b3-90e9-bc54eddc10eb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:17.013256 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c3b55-840f-47b3-90e9-bc54eddc10eb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:17.016781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661429ab-a7ac-4cf4-bcc4-57ba78c79c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:17.017363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661429ab-a7ac-4cf4-bcc4-57ba78c79c38 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:17.017638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661429ab-a7ac-4cf4-bcc4-57ba78c79c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:17.017908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661429ab-a7ac-4cf4-bcc4-57ba78c79c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:17.079227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661429ab-a7ac-4cf4-bcc4-57ba78c79c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:17.080701 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661429ab-a7ac-4cf4-bcc4-57ba78c79c38 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:17.094622 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1303/2645] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:18.352202 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7ddd0-cb7a-4f14-9024-899bc2e7a42b service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:18.354279 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ddf7ddd0-cb7a-4f14-9024-899bc2e7a42b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:18.412206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7ddd0-cb7a-4f14-9024-899bc2e7a42b service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:18.416537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892b2c-d795-4413-be19-50490a9c5f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:18.417134 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892b2c-d795-4413-be19-50490a9c5f97 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:18.417415 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892b2c-d795-4413-be19-50490a9c5f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:18.417691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892b2c-d795-4413-be19-50490a9c5f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:18.419423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ed892b2c-d795-4413-be19-50490a9c5f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:18.485378 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892b2c-d795-4413-be19-50490a9c5f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:18.486823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892b2c-d795-4413-be19-50490a9c5f97 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:18.497284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1343/2646] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:21.593661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661429ab-a7ac-4cf4-bcc4-57ba78c79c38 service cinder] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:21.595371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-661429ab-a7ac-4cf4-bcc4-57ba78c79c38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:21.611402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661429ab-a7ac-4cf4-bcc4-57ba78c79c38 service cinder] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:21.615868 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0278aa-4916-496e-b95c-ad1135e2ee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:21.616526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0278aa-4916-496e-b95c-ad1135e2ee81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:21.616833 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0278aa-4916-496e-b95c-ad1135e2ee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:21.617107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0278aa-4916-496e-b95c-ad1135e2ee81 admin admin] PATH_INFO: `/v3/users/b805252c0e714dbcb305ad156ed58113` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:21.618487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0278aa-4916-496e-b95c-ad1135e2ee81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b805252c0e714dbcb305ad156ed58113)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:21.620451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0278aa-4916-496e-b95c-ad1135e2ee81 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:21.643703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:21.672608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cd0278aa-4916-496e-b95c-ad1135e2ee81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b805252c0e714dbcb305ad156ed58113'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:21.681124 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cd0278aa-4916-496e-b95c-ad1135e2ee81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b805252c0e714dbcb305ad156ed58113'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:21.681947 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cd0278aa-4916-496e-b95c-ad1135e2ee81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b805252c0e714dbcb305ad156ed58113'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:21.682612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cd0278aa-4916-496e-b95c-ad1135e2ee81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b805252c0e714dbcb305ad156ed58113'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:21.690302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-cd0278aa-4916-496e-b95c-ad1135e2ee81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b805252c0e714dbcb305ad156ed58113'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:21.708317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1304/2647] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:21 2022] DELETE /identity/v3/users/b805252c0e714dbcb305ad156ed58113 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:21.894549 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892b2c-d795-4413-be19-50490a9c5f97 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:21.911118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892b2c-d795-4413-be19-50490a9c5f97 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:21.944221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=100 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:21.973238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:21.973810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:21.974085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:21.974380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] PATH_INFO: `/v3/projects/1f85a3273b794df88b71558754163278` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:21.975468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f85a3273b794df88b71558754163278)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:21.978208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:22.024674 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f85a3273b794df88b71558754163278', 'request_id': 'req-fb0925ea-d582-404b-806a-819ca9580c14'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:22.032015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f85a3273b794df88b71558754163278', 'request_id': 'req-fb0925ea-d582-404b-806a-819ca9580c14'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:22.041758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f85a3273b794df88b71558754163278', 'request_id': 'req-fb0925ea-d582-404b-806a-819ca9580c14'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:22.053653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] The token cache is being invalidate because project 1f85a3273b794df88b71558754163278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:22.053982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:22.054775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-fb0925ea-d582-404b-806a-819ca9580c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:22.056642 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1344/2648] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:21 2022] DELETE /identity/v3/projects/1f85a3273b794df88b71558754163278 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:22.061594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf44e5-e5de-4936-99c0-b22550829ca5 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:22.061887 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf44e5-e5de-4936-99c0-b22550829ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:22.062150 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf44e5-e5de-4936-99c0-b22550829ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:22.081638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-dfbf44e5-e5de-4936-99c0-b22550829ca5 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:22.082831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-dfbf44e5-e5de-4936-99c0-b22550829ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:22.142078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1305/2649] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:34:22.151059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b51dc-1b0e-411f-8aa1-1acc20d7d5f9 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:22.151338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b51dc-1b0e-411f-8aa1-1acc20d7d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:22.151611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b51dc-1b0e-411f-8aa1-1acc20d7d5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:22.171670 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-264b51dc-1b0e-411f-8aa1-1acc20d7d5f9 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:22.172913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-264b51dc-1b0e-411f-8aa1-1acc20d7d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:22.181072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1345/2650] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:22.185284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf44e5-e5de-4936-99c0-b22550829ca5 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:22.194897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf44e5-e5de-4936-99c0-b22550829ca5 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:22.199742 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948bb6a-1b5f-4ebf-8696-b93966aa3cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:22.200377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948bb6a-1b5f-4ebf-8696-b93966aa3cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:22.200659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948bb6a-1b5f-4ebf-8696-b93966aa3cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:22.200934 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948bb6a-1b5f-4ebf-8696-b93966aa3cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:22.201575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948bb6a-1b5f-4ebf-8696-b93966aa3cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:34:22.201877 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948bb6a-1b5f-4ebf-8696-b93966aa3cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:22.203496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948bb6a-1b5f-4ebf-8696-b93966aa3cc6 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:22.215963 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1306/2651] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:34:22.220142 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b51dc-1b0e-411f-8aa1-1acc20d7d5f9 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:22.231685 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b51dc-1b0e-411f-8aa1-1acc20d7d5f9 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:22.237603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659706a-c6d6-4a79-936c-2fb716b27658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:22.238488 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659706a-c6d6-4a79-936c-2fb716b27658 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:22.238767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659706a-c6d6-4a79-936c-2fb716b27658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:22.239038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659706a-c6d6-4a79-936c-2fb716b27658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:22.239663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659706a-c6d6-4a79-936c-2fb716b27658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:22.241707 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659706a-c6d6-4a79-936c-2fb716b27658 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:22.270071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1346/2652] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:22 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:34:22.274755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948bb6a-1b5f-4ebf-8696-b93966aa3cc6 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:22.284689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948bb6a-1b5f-4ebf-8696-b93966aa3cc6 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:22.341046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80366cd4-598b-4d55-9a4f-cf24340da975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:22.341638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80366cd4-598b-4d55-9a4f-cf24340da975 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:22.341917 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80366cd4-598b-4d55-9a4f-cf24340da975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:22.342191 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80366cd4-598b-4d55-9a4f-cf24340da975 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:22.342818 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80366cd4-598b-4d55-9a4f-cf24340da975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:22.344754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80366cd4-598b-4d55-9a4f-cf24340da975 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:22.366146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1307/2653] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:22 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:34:22.370705 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659706a-c6d6-4a79-936c-2fb716b27658 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:22.380947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659706a-c6d6-4a79-936c-2fb716b27658 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:22.386228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f019-e275-4d0d-9f43-3224809fbd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:22.386811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f019-e275-4d0d-9f43-3224809fbd61 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:22.387090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f019-e275-4d0d-9f43-3224809fbd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:22.387366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f019-e275-4d0d-9f43-3224809fbd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:22.388063 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723f019-e275-4d0d-9f43-3224809fbd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:22.389654 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723f019-e275-4d0d-9f43-3224809fbd61 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:22.400199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1347/2654] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:22.404455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80366cd4-598b-4d55-9a4f-cf24340da975 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:22.414513 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80366cd4-598b-4d55-9a4f-cf24340da975 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:22.419453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3288-2a76-4082-a6aa-8e57922ddb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:22.420369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3288-2a76-4082-a6aa-8e57922ddb36 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:22.420651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3288-2a76-4082-a6aa-8e57922ddb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:22.420942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3288-2a76-4082-a6aa-8e57922ddb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:22.421575 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e3288-2a76-4082-a6aa-8e57922ddb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:22.423171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e3288-2a76-4082-a6aa-8e57922ddb36 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:22.434131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1308/2655] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:34:22.438494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f019-e275-4d0d-9f43-3224809fbd61 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:22.449599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f019-e275-4d0d-9f43-3224809fbd61 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:22.455061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb6158-d3a4-4fda-ad9f-97b1d21ed990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:22.455715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb6158-d3a4-4fda-ad9f-97b1d21ed990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:22.456023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb6158-d3a4-4fda-ad9f-97b1d21ed990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:22.456300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb6158-d3a4-4fda-ad9f-97b1d21ed990 admin admin] PATH_INFO: `/v3/projects/41c783adabb94ed3bceb5886523673f8/users/64f720a590ec49889830b72487d390bf/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:22.472476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb6158-d3a4-4fda-ad9f-97b1d21ed990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c783adabb94ed3bceb5886523673f8, user_id=64f720a590ec49889830b72487d390bf, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:22.475143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb6158-d3a4-4fda-ad9f-97b1d21ed990 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:22.488133 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1348/2656] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:22 2022] PUT /identity/v3/projects/41c783adabb94ed3bceb5886523673f8/users/64f720a590ec49889830b72487d390bf/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:34:22.493161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7bc3b-db3a-4de1-a5d3-c47d840326ed None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:22.493474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7bc3b-db3a-4de1-a5d3-c47d840326ed None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:22.493744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7bc3b-db3a-4de1-a5d3-c47d840326ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:22.501686 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:22.515101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d6a7bc3b-db3a-4de1-a5d3-c47d840326ed None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:22.516777 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d6a7bc3b-db3a-4de1-a5d3-c47d840326ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:22.578515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1309/2657] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:22.589344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb6158-d3a4-4fda-ad9f-97b1d21ed990 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:22.591097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4fdb6158-d3a4-4fda-ad9f-97b1d21ed990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:22.651268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb6158-d3a4-4fda-ad9f-97b1d21ed990 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:22.654919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2c699-fb06-4a7f-988e-667f133ccdd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:22.655522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2c699-fb06-4a7f-988e-667f133ccdd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:22.655798 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2c699-fb06-4a7f-988e-667f133ccdd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:22.656098 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2c699-fb06-4a7f-988e-667f133ccdd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:22.666295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2c699-fb06-4a7f-988e-667f133ccdd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:22.667756 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2c699-fb06-4a7f-988e-667f133ccdd0 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:22.672840 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:22.677970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1349/2658] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:34:24.377710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7bc3b-db3a-4de1-a5d3-c47d840326ed None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:24.379223 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d6a7bc3b-db3a-4de1-a5d3-c47d840326ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:24.392633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7bc3b-db3a-4de1-a5d3-c47d840326ed None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:24.397426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:24.398094 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:24.398371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:24.398641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] PATH_INFO: `/v3/users/00b12eaff436498f92d93595c8fc2729` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:24.400098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b12eaff436498f92d93595c8fc2729)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:24.402032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:24.467863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b12eaff436498f92d93595c8fc2729'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:24.481250 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b12eaff436498f92d93595c8fc2729'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:24.481916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b12eaff436498f92d93595c8fc2729'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:24.482530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b12eaff436498f92d93595c8fc2729'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:24.491387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b12eaff436498f92d93595c8fc2729'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:24.514276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1310/2659] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:24 2022] DELETE /identity/v3/users/00b12eaff436498f92d93595c8fc2729 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:24.518893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed85ff-97ee-4f9b-9f6e-f3214f3c6b6b None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:24.519477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed85ff-97ee-4f9b-9f6e-f3214f3c6b6b None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:24.520021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed85ff-97ee-4f9b-9f6e-f3214f3c6b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:24.543560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-0bed85ff-97ee-4f9b-9f6e-f3214f3c6b6b None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:24.544831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0bed85ff-97ee-4f9b-9f6e-f3214f3c6b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:24.617284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1350/2660] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:34:24.628988 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:24.630728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:24.715067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b67cb-c34d-418d-9c1c-54b094054931 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:24.724046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa94733-779d-4d4c-8fb8-e9e8d8e29a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:24.724743 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa94733-779d-4d4c-8fb8-e9e8d8e29a95 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:24.725030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa94733-779d-4d4c-8fb8-e9e8d8e29a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:24.725305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa94733-779d-4d4c-8fb8-e9e8d8e29a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:24.742805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa94733-779d-4d4c-8fb8-e9e8d8e29a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:24.744414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa94733-779d-4d4c-8fb8-e9e8d8e29a95 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:24.759400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1311/2661] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:25.189506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed85ff-97ee-4f9b-9f6e-f3214f3c6b6b None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:25.191333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0bed85ff-97ee-4f9b-9f6e-f3214f3c6b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:25.216471 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed85ff-97ee-4f9b-9f6e-f3214f3c6b6b None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:25.222244 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:25.222882 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:25.223165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:25.223439 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] PATH_INFO: `/v3/projects/9ed1ad5d2fbf4e22b8d8369fa9f99590` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:25.224699 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed1ad5d2fbf4e22b8d8369fa9f99590)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:25.226944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:25.294106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed1ad5d2fbf4e22b8d8369fa9f99590', 'request_id': 'req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:25.305870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed1ad5d2fbf4e22b8d8369fa9f99590', 'request_id': 'req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:25.320398 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed1ad5d2fbf4e22b8d8369fa9f99590', 'request_id': 'req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:25.332987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] The token cache is being invalidate because project 9ed1ad5d2fbf4e22b8d8369fa9f99590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:25.333450 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:25.334121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:25.336982 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1351/2662] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:25 2022] DELETE /identity/v3/projects/9ed1ad5d2fbf4e22b8d8369fa9f99590 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:25.341192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa94733-779d-4d4c-8fb8-e9e8d8e29a95 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:25.353407 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa94733-779d-4d4c-8fb8-e9e8d8e29a95 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:25.371788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:25.417012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef369b-61e6-4506-ad3d-427e06d0573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:25.417748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef369b-61e6-4506-ad3d-427e06d0573f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:25.418074 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef369b-61e6-4506-ad3d-427e06d0573f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:25.418414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef369b-61e6-4506-ad3d-427e06d0573f admin admin] PATH_INFO: `/v3/users/d3bfa34607b44e978d065c5a05ee1e07` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:25.419751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef369b-61e6-4506-ad3d-427e06d0573f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3bfa34607b44e978d065c5a05ee1e07)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:25.421778 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef369b-61e6-4506-ad3d-427e06d0573f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:25.488024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8bef369b-61e6-4506-ad3d-427e06d0573f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3bfa34607b44e978d065c5a05ee1e07'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:25.500116 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8bef369b-61e6-4506-ad3d-427e06d0573f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3bfa34607b44e978d065c5a05ee1e07'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:25.500899 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8bef369b-61e6-4506-ad3d-427e06d0573f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3bfa34607b44e978d065c5a05ee1e07'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:25.501608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8bef369b-61e6-4506-ad3d-427e06d0573f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3bfa34607b44e978d065c5a05ee1e07'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:25.509949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8bef369b-61e6-4506-ad3d-427e06d0573f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3bfa34607b44e978d065c5a05ee1e07'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:25.530489 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1312/2663] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:25 2022] DELETE /identity/v3/users/d3bfa34607b44e978d065c5a05ee1e07 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:25.853575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:25.855109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:25.874851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bd057-cfae-487e-b5fa-32cac32d8ea6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:25.947587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:25.948602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:25.949137 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:25.949620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] PATH_INFO: `/v3/projects/b44b241a42e6488689edba223e0a6e80` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:25.951087 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44b241a42e6488689edba223e0a6e80)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:25.953464 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:25.988414 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:26.009132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44b241a42e6488689edba223e0a6e80', 'request_id': 'req-f12f7bb6-5c5f-48ce-9378-9674f42be631'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:26.016261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44b241a42e6488689edba223e0a6e80', 'request_id': 'req-f12f7bb6-5c5f-48ce-9378-9674f42be631'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:26.028420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44b241a42e6488689edba223e0a6e80', 'request_id': 'req-f12f7bb6-5c5f-48ce-9378-9674f42be631'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:26.043055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] The token cache is being invalidate because project b44b241a42e6488689edba223e0a6e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:26.043333 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:26.044051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f12f7bb6-5c5f-48ce-9378-9674f42be631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:26.045838 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1352/2664] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:25 2022] DELETE /identity/v3/projects/b44b241a42e6488689edba223e0a6e80 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:26.051117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbed0cd-1ee4-43c4-ae81-f49f9e3564d4 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:26.051425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbed0cd-1ee4-43c4-ae81-f49f9e3564d4 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:26.051762 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbed0cd-1ee4-43c4-ae81-f49f9e3564d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:26.074236 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-5cbed0cd-1ee4-43c4-ae81-f49f9e3564d4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:26.075526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5cbed0cd-1ee4-43c4-ae81-f49f9e3564d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:26.175403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1313/2665] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:26.178143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12dd02-acf0-4abe-96a1-67c2cd63e8c0 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:26.178592 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12dd02-acf0-4abe-96a1-67c2cd63e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:26.179040 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12dd02-acf0-4abe-96a1-67c2cd63e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:26.208314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fd12dd02-acf0-4abe-96a1-67c2cd63e8c0 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:26.209569 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fd12dd02-acf0-4abe-96a1-67c2cd63e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:26.225517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1353/2666] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:26.227209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbed0cd-1ee4-43c4-ae81-f49f9e3564d4 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:26.240654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbed0cd-1ee4-43c4-ae81-f49f9e3564d4 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:26.252913 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418c402-6e59-41fe-b2af-236c10453705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:26.253541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c402-6e59-41fe-b2af-236c10453705 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:26.253936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c402-6e59-41fe-b2af-236c10453705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:26.254328 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418c402-6e59-41fe-b2af-236c10453705 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:26.254991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418c402-6e59-41fe-b2af-236c10453705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:34:26.255296 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418c402-6e59-41fe-b2af-236c10453705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:26.257209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418c402-6e59-41fe-b2af-236c10453705 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:26.280522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12dd02-acf0-4abe-96a1-67c2cd63e8c0 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:26.281214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1314/2667] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:34:26.290970 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12dd02-acf0-4abe-96a1-67c2cd63e8c0 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:26.301841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71fe6-f463-48d7-b198-e892eb1f1c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:26.302484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71fe6-f463-48d7-b198-e892eb1f1c4a admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:26.302771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71fe6-f463-48d7-b198-e892eb1f1c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:26.303044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada71fe6-f463-48d7-b198-e892eb1f1c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:26.303683 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada71fe6-f463-48d7-b198-e892eb1f1c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:26.305789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada71fe6-f463-48d7-b198-e892eb1f1c4a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:26.341212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1354/2668] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:26 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:26.345196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418c402-6e59-41fe-b2af-236c10453705 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:26.357578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418c402-6e59-41fe-b2af-236c10453705 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:26.389554 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:26.430042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057327ff-f3ae-484c-9a5f-b5489142329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:26.431029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057327ff-f3ae-484c-9a5f-b5489142329d admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:26.431317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057327ff-f3ae-484c-9a5f-b5489142329d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:26.431681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057327ff-f3ae-484c-9a5f-b5489142329d admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:26.432588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057327ff-f3ae-484c-9a5f-b5489142329d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:26.435316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057327ff-f3ae-484c-9a5f-b5489142329d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:26.469174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1315/2669] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:26 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:26.478740 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71fe6-f463-48d7-b198-e892eb1f1c4a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:26.497035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada71fe6-f463-48d7-b198-e892eb1f1c4a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:26.502577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594e7ce-939a-445d-9f04-cd69effcf9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:26.503267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594e7ce-939a-445d-9f04-cd69effcf9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:26.503531 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594e7ce-939a-445d-9f04-cd69effcf9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:26.503855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594e7ce-939a-445d-9f04-cd69effcf9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:26.504778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594e7ce-939a-445d-9f04-cd69effcf9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:26.508001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594e7ce-939a-445d-9f04-cd69effcf9b4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:26.520585 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1355/2670] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:26.525445 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057327ff-f3ae-484c-9a5f-b5489142329d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:26.537404 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057327ff-f3ae-484c-9a5f-b5489142329d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:26.545052 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd45c5b-78c4-44e9-9378-03d94cdabd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:26.545791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd45c5b-78c4-44e9-9378-03d94cdabd5a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:26.546072 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd45c5b-78c4-44e9-9378-03d94cdabd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:26.546345 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd45c5b-78c4-44e9-9378-03d94cdabd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:26.546985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd45c5b-78c4-44e9-9378-03d94cdabd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:26.548604 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd45c5b-78c4-44e9-9378-03d94cdabd5a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:26.561072 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1316/2671] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:34:26.565242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594e7ce-939a-445d-9f04-cd69effcf9b4 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:26.578540 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594e7ce-939a-445d-9f04-cd69effcf9b4 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:26.583833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa371-f6b5-4e51-9cda-f9908cec9832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:26.584531 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa371-f6b5-4e51-9cda-f9908cec9832 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:26.585077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa371-f6b5-4e51-9cda-f9908cec9832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:26.585354 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa371-f6b5-4e51-9cda-f9908cec9832 admin admin] PATH_INFO: `/v3/projects/95f93e87a921409394b7b8d401e7c392/users/d3d058d6040a4610897be10eb0bb3ab3/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:26.603518 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aa371-f6b5-4e51-9cda-f9908cec9832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f93e87a921409394b7b8d401e7c392, user_id=d3d058d6040a4610897be10eb0bb3ab3, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:26.606402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aa371-f6b5-4e51-9cda-f9908cec9832 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:26.622173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1356/2672] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:26 2022] PUT /identity/v3/projects/95f93e87a921409394b7b8d401e7c392/users/d3d058d6040a4610897be10eb0bb3ab3/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:26.632394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374cf1d-660b-4cf8-a8d8-adfa4fdee363 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:26.632685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374cf1d-660b-4cf8-a8d8-adfa4fdee363 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:26.632966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374cf1d-660b-4cf8-a8d8-adfa4fdee363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:26.669287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2374cf1d-660b-4cf8-a8d8-adfa4fdee363 None None] MFA Rules not processed for user `d3d058d6040a4610897be10eb0bb3ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:26.670524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2374cf1d-660b-4cf8-a8d8-adfa4fdee363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:26.743323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1317/2673] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:26.748365 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa371-f6b5-4e51-9cda-f9908cec9832 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:26.854634 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa371-f6b5-4e51-9cda-f9908cec9832 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:26.861810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6cbcc-b833-4d9e-9e8d-7f0b359e715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:26.862885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6cbcc-b833-4d9e-9e8d-7f0b359e715e admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:26.863272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6cbcc-b833-4d9e-9e8d-7f0b359e715e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:26.863885 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6cbcc-b833-4d9e-9e8d-7f0b359e715e admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:26.864662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6cbcc-b833-4d9e-9e8d-7f0b359e715e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:26.866716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6cbcc-b833-4d9e-9e8d-7f0b359e715e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:26.904323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1357/2674] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:26 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:26.905520 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374cf1d-660b-4cf8-a8d8-adfa4fdee363 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:26.918220 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374cf1d-660b-4cf8-a8d8-adfa4fdee363 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:26.998682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b23efa-bdd0-439a-a634-dd388e2a19ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:26.999402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23efa-bdd0-439a-a634-dd388e2a19ea admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:26.999778 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23efa-bdd0-439a-a634-dd388e2a19ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:27.000175 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23efa-bdd0-439a-a634-dd388e2a19ea admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:27.000912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b23efa-bdd0-439a-a634-dd388e2a19ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:27.003065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b23efa-bdd0-439a-a634-dd388e2a19ea admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:27.029038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1318/2675] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:26 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:27.033030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6cbcc-b833-4d9e-9e8d-7f0b359e715e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:27.049555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6cbcc-b833-4d9e-9e8d-7f0b359e715e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:27.051672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bafe3b-7ad6-4811-a1ed-1db7848085bb None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:27.051974 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bafe3b-7ad6-4811-a1ed-1db7848085bb None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:27.052246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bafe3b-7ad6-4811-a1ed-1db7848085bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:27.057013 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f48a0-fa2b-4bcf-be35-df055518b2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:27.057943 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f48a0-fa2b-4bcf-be35-df055518b2fe admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:27.058223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f48a0-fa2b-4bcf-be35-df055518b2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:27.058919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f48a0-fa2b-4bcf-be35-df055518b2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:27.059636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f48a0-fa2b-4bcf-be35-df055518b2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:27.061397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f48a0-fa2b-4bcf-be35-df055518b2fe admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:27.073761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1358/2676] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:34:27.078022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f48a0-fa2b-4bcf-be35-df055518b2fe admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:27.083208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b8bafe3b-7ad6-4811-a1ed-1db7848085bb None None] MFA Rules not processed for user `64f720a590ec49889830b72487d390bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:27.084455 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b8bafe3b-7ad6-4811-a1ed-1db7848085bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:27.089758 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f48a0-fa2b-4bcf-be35-df055518b2fe admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:27.097528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcd9b0-f9a5-4781-b5c4-5a14aa1a388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:27.098034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:27.098345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcd9b0-f9a5-4781-b5c4-5a14aa1a388a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:27.098690 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcd9b0-f9a5-4781-b5c4-5a14aa1a388a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:27.099034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcd9b0-f9a5-4781-b5c4-5a14aa1a388a admin admin] PATH_INFO: `/v3/projects/e9cc229ab5364865a8b8572b19ed887f/users/bd05cd3456504a0485d28757e9154529/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:27.118928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcd9b0-f9a5-4781-b5c4-5a14aa1a388a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9cc229ab5364865a8b8572b19ed887f, user_id=bd05cd3456504a0485d28757e9154529, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:27.122969 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcd9b0-f9a5-4781-b5c4-5a14aa1a388a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:27.136308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:27.148083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1359/2677] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:27 2022] PUT /identity/v3/projects/e9cc229ab5364865a8b8572b19ed887f/users/bd05cd3456504a0485d28757e9154529/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:27.149556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcd9b0-f9a5-4781-b5c4-5a14aa1a388a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:27.188465 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1319/2678] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:34:27.202842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bafe3b-7ad6-4811-a1ed-1db7848085bb None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:27.204234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b8bafe3b-7ad6-4811-a1ed-1db7848085bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:27.248252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcd9b0-f9a5-4781-b5c4-5a14aa1a388a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:27.256736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee252b1-2ff8-46db-be24-051f6ced56a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:27.257313 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee252b1-2ff8-46db-be24-051f6ced56a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:27.257593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee252b1-2ff8-46db-be24-051f6ced56a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:27.257912 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee252b1-2ff8-46db-be24-051f6ced56a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:27.258721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee252b1-2ff8-46db-be24-051f6ced56a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:27.260412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee252b1-2ff8-46db-be24-051f6ced56a0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:27.274787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1360/2679] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:27.278978 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee252b1-2ff8-46db-be24-051f6ced56a0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:27.290692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee252b1-2ff8-46db-be24-051f6ced56a0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:27.301839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cc1d2-6df9-4f91-961d-d38099f31a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:27.302627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc1d2-6df9-4f91-961d-d38099f31a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:27.302971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc1d2-6df9-4f91-961d-d38099f31a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:27.303321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cc1d2-6df9-4f91-961d-d38099f31a1f admin admin] PATH_INFO: `/v3/projects/e9cc229ab5364865a8b8572b19ed887f/users/bd05cd3456504a0485d28757e9154529/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:27.305623 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cc1d2-6df9-4f91-961d-d38099f31a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9cc229ab5364865a8b8572b19ed887f, user_id=bd05cd3456504a0485d28757e9154529, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:27.308643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cc1d2-6df9-4f91-961d-d38099f31a1f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:27.319731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bafe3b-7ad6-4811-a1ed-1db7848085bb None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:27.324580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1361/2680] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:27 2022] PUT /identity/v3/projects/e9cc229ab5364865a8b8572b19ed887f/users/bd05cd3456504a0485d28757e9154529/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:34:27.336721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213d26-1434-4add-b35f-ca3568711080 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:27.337058 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213d26-1434-4add-b35f-ca3568711080 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:27.337308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213d26-1434-4add-b35f-ca3568711080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:27.368924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-5b213d26-1434-4add-b35f-ca3568711080 None None] MFA Rules not processed for user `bd05cd3456504a0485d28757e9154529`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:27.370403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5b213d26-1434-4add-b35f-ca3568711080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:27.400125 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8168846-054b-4aa9-9889-37d8b5fbefbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:27.401021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8168846-054b-4aa9-9889-37d8b5fbefbe service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:27.401771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8168846-054b-4aa9-9889-37d8b5fbefbe service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:27.402008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8168846-054b-4aa9-9889-37d8b5fbefbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:27.452335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1362/2681] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:34:27.462410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b213d26-1434-4add-b35f-ca3568711080 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:27.463032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=100 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:27.464233 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5b213d26-1434-4add-b35f-ca3568711080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:27.474573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8168846-054b-4aa9-9889-37d8b5fbefbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:27.476227 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8168846-054b-4aa9-9889-37d8b5fbefbe service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:27.488135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1320/2682] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:34:27.536710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b213d26-1434-4add-b35f-ca3568711080 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:27.541719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdd8c6-28e1-476f-927c-5cff1b89741e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:27.542555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdd8c6-28e1-476f-927c-5cff1b89741e service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:27.542797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdd8c6-28e1-476f-927c-5cff1b89741e service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:27.543083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdd8c6-28e1-476f-927c-5cff1b89741e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:27.572440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:27.621974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdd8c6-28e1-476f-927c-5cff1b89741e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:27.623535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdd8c6-28e1-476f-927c-5cff1b89741e service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:27.678567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1363/2683] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:34:28.896369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d93cd-7031-4b66-bdad-3c9316a21d4e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:28.896897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d93cd-7031-4b66-bdad-3c9316a21d4e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:28.896897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d93cd-7031-4b66-bdad-3c9316a21d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:28.916314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2f2d93cd-7031-4b66-bdad-3c9316a21d4e None None] MFA Rules not processed for user `64f720a590ec49889830b72487d390bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:28.917951 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2f2d93cd-7031-4b66-bdad-3c9316a21d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:28.925228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1321/2684] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:30.393353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdd8c6-28e1-476f-927c-5cff1b89741e service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:30.403252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdd8c6-28e1-476f-927c-5cff1b89741e service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:30.407633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5072ee3-72c2-4991-8cf4-10f869340c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:30.408426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072ee3-72c2-4991-8cf4-10f869340c01 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:30.408946 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072ee3-72c2-4991-8cf4-10f869340c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:30.409075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072ee3-72c2-4991-8cf4-10f869340c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:30.420634 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072ee3-72c2-4991-8cf4-10f869340c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:30.422218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5072ee3-72c2-4991-8cf4-10f869340c01 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:30.439001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1364/2685] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:38.910313 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=8 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:40.429461 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=23 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:43.193268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d93cd-7031-4b66-bdad-3c9316a21d4e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:43.254182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d93cd-7031-4b66-bdad-3c9316a21d4e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:43.259315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:43.259949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:43.260228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:43.260498 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] PATH_INFO: `/v3/users/d3d058d6040a4610897be10eb0bb3ab3` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:43.261599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d058d6040a4610897be10eb0bb3ab3)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:43.263496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:43.308028 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d058d6040a4610897be10eb0bb3ab3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:43.315545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d058d6040a4610897be10eb0bb3ab3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:43.316197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d058d6040a4610897be10eb0bb3ab3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:43.316820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d058d6040a4610897be10eb0bb3ab3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:43.324269 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d058d6040a4610897be10eb0bb3ab3'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:43.341443 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1322/2686] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:43 2022] DELETE /identity/v3/users/d3d058d6040a4610897be10eb0bb3ab3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:43.345901 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed36cc9-e9d4-4756-a456-4c1445646211 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:43.346382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed36cc9-e9d4-4756-a456-4c1445646211 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:43.346486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed36cc9-e9d4-4756-a456-4c1445646211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:43.365726 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6ed36cc9-e9d4-4756-a456-4c1445646211 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:43.366925 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6ed36cc9-e9d4-4756-a456-4c1445646211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:43.426641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1365/2687] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:34:43.437502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:43.439007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:43.495562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c32e0d-3d35-4c6d-ac73-a2bf4d4508c2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:43.499212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55269b68-963a-4f6f-b87d-21ac2052bc41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:43.499811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55269b68-963a-4f6f-b87d-21ac2052bc41 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:43.500117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55269b68-963a-4f6f-b87d-21ac2052bc41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:43.500395 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55269b68-963a-4f6f-b87d-21ac2052bc41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:43.509393 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55269b68-963a-4f6f-b87d-21ac2052bc41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:43.510812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55269b68-963a-4f6f-b87d-21ac2052bc41 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:43.520237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1323/2688] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:43.782715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed36cc9-e9d4-4756-a456-4c1445646211 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:43.784291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6ed36cc9-e9d4-4756-a456-4c1445646211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:43.797106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed36cc9-e9d4-4756-a456-4c1445646211 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:43.802366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:43.802993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:43.803270 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:43.803538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] PATH_INFO: `/v3/projects/95f93e87a921409394b7b8d401e7c392` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:43.804680 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f93e87a921409394b7b8d401e7c392)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:43.807163 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:43.856053 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f93e87a921409394b7b8d401e7c392', 'request_id': 'req-7105429f-881c-4237-8d41-bd8e16cfd156'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:43.862145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f93e87a921409394b7b8d401e7c392', 'request_id': 'req-7105429f-881c-4237-8d41-bd8e16cfd156'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:43.869207 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f93e87a921409394b7b8d401e7c392', 'request_id': 'req-7105429f-881c-4237-8d41-bd8e16cfd156'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:43.880159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] The token cache is being invalidate because project 95f93e87a921409394b7b8d401e7c392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:43.880447 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:43.881097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:43.882565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1366/2689] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:43 2022] DELETE /identity/v3/projects/95f93e87a921409394b7b8d401e7c392 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:43.886672 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55269b68-963a-4f6f-b87d-21ac2052bc41 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:43.896315 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55269b68-963a-4f6f-b87d-21ac2052bc41 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:43.914720 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:43.953619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f63e-bb97-4d2e-80aa-86414e92ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:43.954147 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f63e-bb97-4d2e-80aa-86414e92ba54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:43.954423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f63e-bb97-4d2e-80aa-86414e92ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:43.954699 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f63e-bb97-4d2e-80aa-86414e92ba54 admin admin] PATH_INFO: `/v3/users/bd05cd3456504a0485d28757e9154529` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:43.955819 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96f63e-bb97-4d2e-80aa-86414e92ba54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd05cd3456504a0485d28757e9154529)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:43.957737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96f63e-bb97-4d2e-80aa-86414e92ba54 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:44.002778 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ee96f63e-bb97-4d2e-80aa-86414e92ba54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd05cd3456504a0485d28757e9154529'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:44.009895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ee96f63e-bb97-4d2e-80aa-86414e92ba54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd05cd3456504a0485d28757e9154529'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:44.010511 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ee96f63e-bb97-4d2e-80aa-86414e92ba54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd05cd3456504a0485d28757e9154529'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:44.011108 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ee96f63e-bb97-4d2e-80aa-86414e92ba54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd05cd3456504a0485d28757e9154529'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:44.017861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ee96f63e-bb97-4d2e-80aa-86414e92ba54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd05cd3456504a0485d28757e9154529'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:44.035200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1324/2690] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:43 2022] DELETE /identity/v3/users/bd05cd3456504a0485d28757e9154529 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:34:44.311420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:44.312894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:44.331793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105429f-881c-4237-8d41-bd8e16cfd156 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:44.389264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:44.389951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:44.390148 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:44.390416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] PATH_INFO: `/v3/projects/e9cc229ab5364865a8b8572b19ed887f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:44.391515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9cc229ab5364865a8b8572b19ed887f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:44.393444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:44.424733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:44.442901 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9cc229ab5364865a8b8572b19ed887f', 'request_id': 'req-73f7a293-f335-4555-ab40-abd2192bcb60'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:44.449452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9cc229ab5364865a8b8572b19ed887f', 'request_id': 'req-73f7a293-f335-4555-ab40-abd2192bcb60'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:44.456083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9cc229ab5364865a8b8572b19ed887f', 'request_id': 'req-73f7a293-f335-4555-ab40-abd2192bcb60'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:44.467247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] The token cache is being invalidate because project e9cc229ab5364865a8b8572b19ed887f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:44.467535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:44.468184 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-73f7a293-f335-4555-ab40-abd2192bcb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:44.469666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1367/2691] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:44 2022] DELETE /identity/v3/projects/e9cc229ab5364865a8b8572b19ed887f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:44.474840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249049-7caa-4349-8d79-7886901ee40e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:44.475312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249049-7caa-4349-8d79-7886901ee40e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:44.475525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249049-7caa-4349-8d79-7886901ee40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:44.497087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b0249049-7caa-4349-8d79-7886901ee40e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:44.498209 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b0249049-7caa-4349-8d79-7886901ee40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:44.554615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1325/2692] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:34:44.562649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974170cb-584d-4135-831a-f72d12c62f8d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:44.562934 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974170cb-584d-4135-831a-f72d12c62f8d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:44.563210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974170cb-584d-4135-831a-f72d12c62f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:44.583831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-974170cb-584d-4135-831a-f72d12c62f8d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:44.585323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-974170cb-584d-4135-831a-f72d12c62f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:44.594227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1368/2693] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:44.598339 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0249049-7caa-4349-8d79-7886901ee40e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:44.608652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0249049-7caa-4349-8d79-7886901ee40e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:44.613177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e8f3b-d20f-4480-a1cb-217920925e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:44.613763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e8f3b-d20f-4480-a1cb-217920925e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:44.614039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e8f3b-d20f-4480-a1cb-217920925e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:44.614330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e8f3b-d20f-4480-a1cb-217920925e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:44.614967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e8f3b-d20f-4480-a1cb-217920925e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:34:44.615270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e8f3b-d20f-4480-a1cb-217920925e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:44.616870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e8f3b-d20f-4480-a1cb-217920925e29 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:44.628120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1326/2694] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:34:44.632084 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974170cb-584d-4135-831a-f72d12c62f8d None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:44.641374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974170cb-584d-4135-831a-f72d12c62f8d None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:44.646055 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a29d5f-2e1c-4ca2-8b9e-513ec6327729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:44.646643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29d5f-2e1c-4ca2-8b9e-513ec6327729 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:44.646921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29d5f-2e1c-4ca2-8b9e-513ec6327729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:44.647196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29d5f-2e1c-4ca2-8b9e-513ec6327729 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:44.647824 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a29d5f-2e1c-4ca2-8b9e-513ec6327729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:44.650287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a29d5f-2e1c-4ca2-8b9e-513ec6327729 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:44.687183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1369/2695] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:44 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:44.691307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e8f3b-d20f-4480-a1cb-217920925e29 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:44.701322 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e8f3b-d20f-4480-a1cb-217920925e29 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:44.727484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:44.759885 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27590e4-df6e-40f7-9fc0-ef714b2611ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:44.760436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27590e4-df6e-40f7-9fc0-ef714b2611ad admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:44.760714 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27590e4-df6e-40f7-9fc0-ef714b2611ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:44.760985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27590e4-df6e-40f7-9fc0-ef714b2611ad admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:44.761595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27590e4-df6e-40f7-9fc0-ef714b2611ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:44.763487 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27590e4-df6e-40f7-9fc0-ef714b2611ad admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:44.785007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1327/2696] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:44 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:34:44.789091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a29d5f-2e1c-4ca2-8b9e-513ec6327729 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:44.799803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a29d5f-2e1c-4ca2-8b9e-513ec6327729 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:44.804485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e912f-8a1a-4024-b353-30feb4e3ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:44.805076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e912f-8a1a-4024-b353-30feb4e3ba9e admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:44.805351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e912f-8a1a-4024-b353-30feb4e3ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:44.805622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e912f-8a1a-4024-b353-30feb4e3ba9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:44.806253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e912f-8a1a-4024-b353-30feb4e3ba9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:44.807860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e912f-8a1a-4024-b353-30feb4e3ba9e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:44.817622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1370/2697] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:44.821423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27590e4-df6e-40f7-9fc0-ef714b2611ad admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:44.831423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27590e4-df6e-40f7-9fc0-ef714b2611ad admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:44.836454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13ecdc-481c-49d8-b000-70d4100a3b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:44.837568 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13ecdc-481c-49d8-b000-70d4100a3b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:44.838032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13ecdc-481c-49d8-b000-70d4100a3b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:44.838329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13ecdc-481c-49d8-b000-70d4100a3b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:44.838965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13ecdc-481c-49d8-b000-70d4100a3b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:44.840594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13ecdc-481c-49d8-b000-70d4100a3b20 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:44.851137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1328/2698] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:44.856022 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e912f-8a1a-4024-b353-30feb4e3ba9e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:44.865865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e912f-8a1a-4024-b353-30feb4e3ba9e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:44.870712 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f41022-1493-4edf-a51c-4433a23042f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:44.871347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41022-1493-4edf-a51c-4433a23042f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:44.871627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41022-1493-4edf-a51c-4433a23042f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:44.871942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41022-1493-4edf-a51c-4433a23042f3 admin admin] PATH_INFO: `/v3/projects/bc32caaf017d41e7bd8199cfa5394d71/users/88fb52169a7942ee8c85327b2824e999/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:44.886953 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f41022-1493-4edf-a51c-4433a23042f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc32caaf017d41e7bd8199cfa5394d71, user_id=88fb52169a7942ee8c85327b2824e999, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:44.889627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f41022-1493-4edf-a51c-4433a23042f3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:44.903212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1371/2699] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:44 2022] PUT /identity/v3/projects/bc32caaf017d41e7bd8199cfa5394d71/users/88fb52169a7942ee8c85327b2824e999/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:44.914600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aee46b-b6c4-4357-a9b9-6a7d4dfe415a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:44.914884 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aee46b-b6c4-4357-a9b9-6a7d4dfe415a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:44.915186 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aee46b-b6c4-4357-a9b9-6a7d4dfe415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:44.942031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-89aee46b-b6c4-4357-a9b9-6a7d4dfe415a None None] MFA Rules not processed for user `88fb52169a7942ee8c85327b2824e999`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:44.943214 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-89aee46b-b6c4-4357-a9b9-6a7d4dfe415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:45.005985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1329/2700] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:45.011122 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f41022-1493-4edf-a51c-4433a23042f3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:45.069853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f41022-1493-4edf-a51c-4433a23042f3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:45.075005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ac490-8050-4822-9c44-c728293d49a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:45.075584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ac490-8050-4822-9c44-c728293d49a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:45.075860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ac490-8050-4822-9c44-c728293d49a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:45.076158 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ac490-8050-4822-9c44-c728293d49a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:45.076767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ac490-8050-4822-9c44-c728293d49a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:45.078655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ac490-8050-4822-9c44-c728293d49a1 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:45.105547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1372/2701] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:45 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:45.109598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aee46b-b6c4-4357-a9b9-6a7d4dfe415a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:45.120548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aee46b-b6c4-4357-a9b9-6a7d4dfe415a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:45.175522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac4c44-e13a-4f2c-bb51-d87d6ff8f3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:45.176149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac4c44-e13a-4f2c-bb51-d87d6ff8f3ed admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:45.176451 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac4c44-e13a-4f2c-bb51-d87d6ff8f3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:45.176734 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac4c44-e13a-4f2c-bb51-d87d6ff8f3ed admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:45.177385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac4c44-e13a-4f2c-bb51-d87d6ff8f3ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:45.179284 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac4c44-e13a-4f2c-bb51-d87d6ff8f3ed admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:45.200636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1330/2702] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:45 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:45.204631 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ac490-8050-4822-9c44-c728293d49a1 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:45.215789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ac490-8050-4822-9c44-c728293d49a1 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:45.220397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9303-bf5d-4a20-8a9f-e255dbe051ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:45.220987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9303-bf5d-4a20-8a9f-e255dbe051ee admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:45.221259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9303-bf5d-4a20-8a9f-e255dbe051ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:45.221528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea9303-bf5d-4a20-8a9f-e255dbe051ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:45.222155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea9303-bf5d-4a20-8a9f-e255dbe051ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:45.223725 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea9303-bf5d-4a20-8a9f-e255dbe051ee admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:45.234042 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1373/2703] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:45.237940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac4c44-e13a-4f2c-bb51-d87d6ff8f3ed admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:45.248280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac4c44-e13a-4f2c-bb51-d87d6ff8f3ed admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:45.252829 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67544bfd-0239-4a17-95bb-7152d5ce0b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:45.253463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67544bfd-0239-4a17-95bb-7152d5ce0b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:45.253740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67544bfd-0239-4a17-95bb-7152d5ce0b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:45.254037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67544bfd-0239-4a17-95bb-7152d5ce0b99 admin admin] PATH_INFO: `/v3/projects/c31b5906952e43e5ade907805271f12d/users/de221e99c38d46b3969594a48d458b42/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:45.268713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67544bfd-0239-4a17-95bb-7152d5ce0b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31b5906952e43e5ade907805271f12d, user_id=de221e99c38d46b3969594a48d458b42, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:45.271271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67544bfd-0239-4a17-95bb-7152d5ce0b99 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:45.284099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1331/2704] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:45 2022] PUT /identity/v3/projects/c31b5906952e43e5ade907805271f12d/users/de221e99c38d46b3969594a48d458b42/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:45.288074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9303-bf5d-4a20-8a9f-e255dbe051ee admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:45.298256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea9303-bf5d-4a20-8a9f-e255dbe051ee admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:45.310011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:45.357093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1761c3-440d-4b2b-8d15-28b3e8f7a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:45.357692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1761c3-440d-4b2b-8d15-28b3e8f7a72d admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:45.357974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1761c3-440d-4b2b-8d15-28b3e8f7a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:45.358250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1761c3-440d-4b2b-8d15-28b3e8f7a72d admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:45.358884 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1761c3-440d-4b2b-8d15-28b3e8f7a72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:45.360529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1761c3-440d-4b2b-8d15-28b3e8f7a72d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:45.370615 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1374/2705] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:45.374998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67544bfd-0239-4a17-95bb-7152d5ce0b99 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:45.380570 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:45.387778 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67544bfd-0239-4a17-95bb-7152d5ce0b99 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:45.392579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ce029-fd6d-4c4d-8dd8-faeef53d0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:45.393231 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce029-fd6d-4c4d-8dd8-faeef53d0b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:45.393495 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce029-fd6d-4c4d-8dd8-faeef53d0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:45.393766 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce029-fd6d-4c4d-8dd8-faeef53d0b58 admin admin] PATH_INFO: `/v3/projects/c31b5906952e43e5ade907805271f12d/users/de221e99c38d46b3969594a48d458b42/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:45.395660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ce029-fd6d-4c4d-8dd8-faeef53d0b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31b5906952e43e5ade907805271f12d, user_id=de221e99c38d46b3969594a48d458b42, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:45.398334 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ce029-fd6d-4c4d-8dd8-faeef53d0b58 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:45.408508 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1332/2706] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:45 2022] PUT /identity/v3/projects/c31b5906952e43e5ade907805271f12d/users/de221e99c38d46b3969594a48d458b42/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:45.418604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c28b2c-d38b-44f8-894f-84a2abb60416 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:45.419088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c28b2c-d38b-44f8-894f-84a2abb60416 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:45.419187 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c28b2c-d38b-44f8-894f-84a2abb60416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:45.448494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-80c28b2c-d38b-44f8-894f-84a2abb60416 None None] MFA Rules not processed for user `de221e99c38d46b3969594a48d458b42`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:45.449698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-80c28b2c-d38b-44f8-894f-84a2abb60416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:45.517032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1375/2707] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:34:45.528327 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ce029-fd6d-4c4d-8dd8-faeef53d0b58 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:45.530090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-f79ce029-fd6d-4c4d-8dd8-faeef53d0b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:45.586753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ce029-fd6d-4c4d-8dd8-faeef53d0b58 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:45.590445 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d561cc-de93-4bb1-9a0d-7767466904f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:45.591036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d561cc-de93-4bb1-9a0d-7767466904f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:45.591314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d561cc-de93-4bb1-9a0d-7767466904f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:45.591587 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d561cc-de93-4bb1-9a0d-7767466904f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:45.600402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d561cc-de93-4bb1-9a0d-7767466904f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:45.601820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d561cc-de93-4bb1-9a0d-7767466904f6 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:45.611585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1333/2708] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:45.678776 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c28b2c-d38b-44f8-894f-84a2abb60416 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:45.746863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c28b2c-d38b-44f8-894f-84a2abb60416 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:45.751433 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:45.752100 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:45.752382 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:45.752655 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] PATH_INFO: `/v3/users/88fb52169a7942ee8c85327b2824e999` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:45.753782 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=88fb52169a7942ee8c85327b2824e999)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:45.755755 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:45.798676 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:45.805864 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88fb52169a7942ee8c85327b2824e999'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:45.812806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88fb52169a7942ee8c85327b2824e999'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:45.813416 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88fb52169a7942ee8c85327b2824e999'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:45.814062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88fb52169a7942ee8c85327b2824e999'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:45.825944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88fb52169a7942ee8c85327b2824e999'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:45.838649 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1376/2709] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:45 2022] DELETE /identity/v3/users/88fb52169a7942ee8c85327b2824e999 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:45.843152 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11c2d1-1114-486c-ad2f-31e03874aa4a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:45.843435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11c2d1-1114-486c-ad2f-31e03874aa4a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:45.843709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11c2d1-1114-486c-ad2f-31e03874aa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:45.862858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-2f11c2d1-1114-486c-ad2f-31e03874aa4a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:45.864099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2f11c2d1-1114-486c-ad2f-31e03874aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:45.922243 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1334/2710] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:45.932797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:45.934215 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:45.990517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d4984-abd2-4265-904c-cdd0ab3ad12b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:45.994178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552978d-a7fa-4b72-a0ad-7c4ff27eae08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:45.994772 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552978d-a7fa-4b72-a0ad-7c4ff27eae08 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:45.995050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552978d-a7fa-4b72-a0ad-7c4ff27eae08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:45.995324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552978d-a7fa-4b72-a0ad-7c4ff27eae08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:46.004303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552978d-a7fa-4b72-a0ad-7c4ff27eae08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:46.005731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552978d-a7fa-4b72-a0ad-7c4ff27eae08 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:46.015049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1377/2711] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:46.281936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11c2d1-1114-486c-ad2f-31e03874aa4a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:46.283446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2f11c2d1-1114-486c-ad2f-31e03874aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:46.297102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11c2d1-1114-486c-ad2f-31e03874aa4a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:46.301677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:46.302306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:46.302583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:46.302854 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] PATH_INFO: `/v3/projects/bc32caaf017d41e7bd8199cfa5394d71` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:46.303997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc32caaf017d41e7bd8199cfa5394d71)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:46.305883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:46.353080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc32caaf017d41e7bd8199cfa5394d71', 'request_id': 'req-bd855856-842c-469a-8dac-baeb94c84674'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.359696 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc32caaf017d41e7bd8199cfa5394d71', 'request_id': 'req-bd855856-842c-469a-8dac-baeb94c84674'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.367354 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc32caaf017d41e7bd8199cfa5394d71', 'request_id': 'req-bd855856-842c-469a-8dac-baeb94c84674'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.378385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] The token cache is being invalidate because project bc32caaf017d41e7bd8199cfa5394d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:46.378670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.379308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.380893 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1335/2712] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:46 2022] DELETE /identity/v3/projects/bc32caaf017d41e7bd8199cfa5394d71 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:46.384839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552978d-a7fa-4b72-a0ad-7c4ff27eae08 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:46.394353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552978d-a7fa-4b72-a0ad-7c4ff27eae08 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:46.450418 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447571-3d50-4d12-bf18-42b239284c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:46.451078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447571-3d50-4d12-bf18-42b239284c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:46.451309 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447571-3d50-4d12-bf18-42b239284c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:46.451584 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447571-3d50-4d12-bf18-42b239284c2d admin admin] PATH_INFO: `/v3/users/de221e99c38d46b3969594a48d458b42` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:46.452736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447571-3d50-4d12-bf18-42b239284c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de221e99c38d46b3969594a48d458b42)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:46.454639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447571-3d50-4d12-bf18-42b239284c2d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:46.500428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a6447571-3d50-4d12-bf18-42b239284c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de221e99c38d46b3969594a48d458b42'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.508896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a6447571-3d50-4d12-bf18-42b239284c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de221e99c38d46b3969594a48d458b42'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.509619 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a6447571-3d50-4d12-bf18-42b239284c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de221e99c38d46b3969594a48d458b42'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.510442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a6447571-3d50-4d12-bf18-42b239284c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de221e99c38d46b3969594a48d458b42'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.515859 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:46.524637 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-a6447571-3d50-4d12-bf18-42b239284c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de221e99c38d46b3969594a48d458b42'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.536657 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1378/2713] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:46 2022] DELETE /identity/v3/users/de221e99c38d46b3969594a48d458b42 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:46.809702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:46.811160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:46.824762 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd855856-842c-469a-8dac-baeb94c84674 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:46.848614 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:46.895072 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:46.895605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:46.895886 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:46.896197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] PATH_INFO: `/v3/projects/c31b5906952e43e5ade907805271f12d` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:46.897307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31b5906952e43e5ade907805271f12d)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:46.899319 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:46.945441 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31b5906952e43e5ade907805271f12d', 'request_id': 'req-67f9db60-974a-4325-a021-71be15b3d65b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.951450 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31b5906952e43e5ade907805271f12d', 'request_id': 'req-67f9db60-974a-4325-a021-71be15b3d65b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.958802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31b5906952e43e5ade907805271f12d', 'request_id': 'req-67f9db60-974a-4325-a021-71be15b3d65b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.969902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] The token cache is being invalidate because project c31b5906952e43e5ade907805271f12d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:46.970185 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.970798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-67f9db60-974a-4325-a021-71be15b3d65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:46.972277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1336/2714] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:46 2022] DELETE /identity/v3/projects/c31b5906952e43e5ade907805271f12d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:46.978016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd44fe-5bfa-46d4-8778-194ecd06b050 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:46.978300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd44fe-5bfa-46d4-8778-194ecd06b050 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:46.978800 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd44fe-5bfa-46d4-8778-194ecd06b050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:46.998942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-d7fd44fe-5bfa-46d4-8778-194ecd06b050 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:47.000166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-d7fd44fe-5bfa-46d4-8778-194ecd06b050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:47.058261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1379/2715] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:47.066081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e062f6c-3874-462b-8722-8fcbb92d848f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.066363 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e062f6c-3874-462b-8722-8fcbb92d848f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.066636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e062f6c-3874-462b-8722-8fcbb92d848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.086860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0e062f6c-3874-462b-8722-8fcbb92d848f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:47.088102 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0e062f6c-3874-462b-8722-8fcbb92d848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:47.096749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1337/2716] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:47.100968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd44fe-5bfa-46d4-8778-194ecd06b050 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:47.110787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd44fe-5bfa-46d4-8778-194ecd06b050 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:47.115373 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db785aa9-dfc9-4235-949c-a1e95ea53b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:47.116002 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db785aa9-dfc9-4235-949c-a1e95ea53b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.116283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db785aa9-dfc9-4235-949c-a1e95ea53b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.116556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db785aa9-dfc9-4235-949c-a1e95ea53b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.117190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db785aa9-dfc9-4235-949c-a1e95ea53b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:34:47.117491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db785aa9-dfc9-4235-949c-a1e95ea53b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:47.119076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db785aa9-dfc9-4235-949c-a1e95ea53b18 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:47.130913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1380/2717] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:34:47.135048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e062f6c-3874-462b-8722-8fcbb92d848f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:47.144853 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e062f6c-3874-462b-8722-8fcbb92d848f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:47.149515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17023cd4-6dea-4cb6-9413-235bd5764f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:47.150098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023cd4-6dea-4cb6-9413-235bd5764f28 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.150375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023cd4-6dea-4cb6-9413-235bd5764f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.150648 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023cd4-6dea-4cb6-9413-235bd5764f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.151820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17023cd4-6dea-4cb6-9413-235bd5764f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:47.153746 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17023cd4-6dea-4cb6-9413-235bd5764f28 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:47.180027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1338/2718] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:47 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:34:47.184496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db785aa9-dfc9-4235-949c-a1e95ea53b18 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:47.194269 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db785aa9-dfc9-4235-949c-a1e95ea53b18 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:47.252575 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb2a5a-e832-4dac-b5a1-487f938c31b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:47.253177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb2a5a-e832-4dac-b5a1-487f938c31b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.253455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb2a5a-e832-4dac-b5a1-487f938c31b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.253728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb2a5a-e832-4dac-b5a1-487f938c31b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.254346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb2a5a-e832-4dac-b5a1-487f938c31b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:47.256297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb2a5a-e832-4dac-b5a1-487f938c31b3 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:47.278335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1381/2719] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:47 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:34:47.282448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17023cd4-6dea-4cb6-9413-235bd5764f28 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:47.293329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17023cd4-6dea-4cb6-9413-235bd5764f28 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:47.297888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671214e-8627-415a-8099-c91282739e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:47.298472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671214e-8627-415a-8099-c91282739e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.298750 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671214e-8627-415a-8099-c91282739e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.299018 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671214e-8627-415a-8099-c91282739e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.299647 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671214e-8627-415a-8099-c91282739e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:47.301268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671214e-8627-415a-8099-c91282739e12 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:47.311419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1339/2720] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:34:47.315322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb2a5a-e832-4dac-b5a1-487f938c31b3 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:47.325756 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb2a5a-e832-4dac-b5a1-487f938c31b3 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:47.330299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf1c3c-7f07-4052-a4c5-437dc0c56185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:47.330888 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf1c3c-7f07-4052-a4c5-437dc0c56185 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.331166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf1c3c-7f07-4052-a4c5-437dc0c56185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.331440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf1c3c-7f07-4052-a4c5-437dc0c56185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.332134 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf1c3c-7f07-4052-a4c5-437dc0c56185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:47.333728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf1c3c-7f07-4052-a4c5-437dc0c56185 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:47.345217 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1382/2721] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:47.349280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671214e-8627-415a-8099-c91282739e12 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:47.359515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671214e-8627-415a-8099-c91282739e12 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:47.364772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c24df8-591e-408b-9b46-ccf0ec50cdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:47.365450 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c24df8-591e-408b-9b46-ccf0ec50cdb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.365733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c24df8-591e-408b-9b46-ccf0ec50cdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.366011 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c24df8-591e-408b-9b46-ccf0ec50cdb3 admin admin] PATH_INFO: `/v3/projects/039973977a954285a57b4c5118458c61/users/9cd1cd0879044238a3346c6a82d9d218/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.380824 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c24df8-591e-408b-9b46-ccf0ec50cdb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039973977a954285a57b4c5118458c61, user_id=9cd1cd0879044238a3346c6a82d9d218, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:47.383461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c24df8-591e-408b-9b46-ccf0ec50cdb3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:47.396844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1340/2722] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:47 2022] PUT /identity/v3/projects/039973977a954285a57b4c5118458c61/users/9cd1cd0879044238a3346c6a82d9d218/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:34:47.408928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e709-20b5-403d-ae81-f947250569f7 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.409139 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e709-20b5-403d-ae81-f947250569f7 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.409409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e709-20b5-403d-ae81-f947250569f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.437823 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f952e709-20b5-403d-ae81-f947250569f7 None None] MFA Rules not processed for user `9cd1cd0879044238a3346c6a82d9d218`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:47.439044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f952e709-20b5-403d-ae81-f947250569f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:47.472936 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:47.507807 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1383/2723] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:47.512888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c24df8-591e-408b-9b46-ccf0ec50cdb3 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:47.555509 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:47.575082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c24df8-591e-408b-9b46-ccf0ec50cdb3 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:47.579771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9291-2b19-4b38-a58c-468c7f1aff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:47.580390 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9291-2b19-4b38-a58c-468c7f1aff40 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.580664 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9291-2b19-4b38-a58c-468c7f1aff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.580933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9291-2b19-4b38-a58c-468c7f1aff40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.581551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc9291-2b19-4b38-a58c-468c7f1aff40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:47.583409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc9291-2b19-4b38-a58c-468c7f1aff40 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:47.609212 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1341/2724] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:47 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:34:47.613091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952e709-20b5-403d-ae81-f947250569f7 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:47.624567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952e709-20b5-403d-ae81-f947250569f7 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:47.807070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c7d5c-bc7c-4d65-a0a2-9818b44ace30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:47.808222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c7d5c-bc7c-4d65-a0a2-9818b44ace30 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.808496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c7d5c-bc7c-4d65-a0a2-9818b44ace30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.808770 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c7d5c-bc7c-4d65-a0a2-9818b44ace30 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.809379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c7d5c-bc7c-4d65-a0a2-9818b44ace30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:47.811293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c7d5c-bc7c-4d65-a0a2-9818b44ace30 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:47.833660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1384/2725] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:47 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:47.838079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9291-2b19-4b38-a58c-468c7f1aff40 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:47.848478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9291-2b19-4b38-a58c-468c7f1aff40 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:47.853013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25114e-5345-4067-987f-ef339c293efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:47.853582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25114e-5345-4067-987f-ef339c293efb admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.853862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25114e-5345-4067-987f-ef339c293efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.854135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25114e-5345-4067-987f-ef339c293efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.855271 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25114e-5345-4067-987f-ef339c293efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:47.856888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25114e-5345-4067-987f-ef339c293efb admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:47.867118 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1342/2726] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:47.871668 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c7d5c-bc7c-4d65-a0a2-9818b44ace30 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:47.882023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c7d5c-bc7c-4d65-a0a2-9818b44ace30 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:47.886733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aefaa-ab2d-460d-8911-2f1159f4bc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:47.887379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aefaa-ab2d-460d-8911-2f1159f4bc5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.887646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aefaa-ab2d-460d-8911-2f1159f4bc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.887929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aefaa-ab2d-460d-8911-2f1159f4bc5a admin admin] PATH_INFO: `/v3/projects/c001ae91bec84ae4b97c90dcd94777a5/users/566e448fcafa4bf4a9e1432399d84f52/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.902506 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59aefaa-ab2d-460d-8911-2f1159f4bc5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c001ae91bec84ae4b97c90dcd94777a5, user_id=566e448fcafa4bf4a9e1432399d84f52, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:47.905183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59aefaa-ab2d-460d-8911-2f1159f4bc5a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:47.918038 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1385/2727] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:47 2022] PUT /identity/v3/projects/c001ae91bec84ae4b97c90dcd94777a5/users/566e448fcafa4bf4a9e1432399d84f52/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:34:47.922135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25114e-5345-4067-987f-ef339c293efb admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:47.932000 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25114e-5345-4067-987f-ef339c293efb admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:47.987036 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac87d2-f8da-4130-8422-af67b5852d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:47.987583 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac87d2-f8da-4130-8422-af67b5852d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:47.987882 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac87d2-f8da-4130-8422-af67b5852d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:47.988181 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac87d2-f8da-4130-8422-af67b5852d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:47.988806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac87d2-f8da-4130-8422-af67b5852d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:47.990383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac87d2-f8da-4130-8422-af67b5852d1d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:48.000641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1343/2728] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:48.004800 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aefaa-ab2d-460d-8911-2f1159f4bc5a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:48.014789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aefaa-ab2d-460d-8911-2f1159f4bc5a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:48.019314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627014e4-aac6-4fc7-b5c0-764158e566b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:48.019978 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627014e4-aac6-4fc7-b5c0-764158e566b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:48.020256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627014e4-aac6-4fc7-b5c0-764158e566b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:48.020526 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627014e4-aac6-4fc7-b5c0-764158e566b6 admin admin] PATH_INFO: `/v3/projects/c001ae91bec84ae4b97c90dcd94777a5/users/566e448fcafa4bf4a9e1432399d84f52/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:48.022404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627014e4-aac6-4fc7-b5c0-764158e566b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c001ae91bec84ae4b97c90dcd94777a5, user_id=566e448fcafa4bf4a9e1432399d84f52, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:48.025035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627014e4-aac6-4fc7-b5c0-764158e566b6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:48.036051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1386/2729] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:48 2022] PUT /identity/v3/projects/c001ae91bec84ae4b97c90dcd94777a5/users/566e448fcafa4bf4a9e1432399d84f52/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:34:48.046860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36ec1c-4298-4692-bd44-61032d70100a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:48.047148 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36ec1c-4298-4692-bd44-61032d70100a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:48.047479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36ec1c-4298-4692-bd44-61032d70100a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:48.076143 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ba36ec1c-4298-4692-bd44-61032d70100a None None] MFA Rules not processed for user `566e448fcafa4bf4a9e1432399d84f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:48.077392 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ba36ec1c-4298-4692-bd44-61032d70100a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:48.144196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1344/2730] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:48.155534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627014e4-aac6-4fc7-b5c0-764158e566b6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:48.157271 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-627014e4-aac6-4fc7-b5c0-764158e566b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:48.214515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627014e4-aac6-4fc7-b5c0-764158e566b6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:48.218203 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bdca8-daa0-466d-a608-db83613dee9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:48.218791 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bdca8-daa0-466d-a608-db83613dee9c service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:48.219067 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bdca8-daa0-466d-a608-db83613dee9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:48.219337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bdca8-daa0-466d-a608-db83613dee9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:48.228221 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bdca8-daa0-466d-a608-db83613dee9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:48.229643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bdca8-daa0-466d-a608-db83613dee9c service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:48.239552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1387/2731] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:48.321259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36ec1c-4298-4692-bd44-61032d70100a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:48.330878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36ec1c-4298-4692-bd44-61032d70100a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:48.334484 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b2dc-dd73-4618-a059-dccb4745959b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:48.335071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b2dc-dd73-4618-a059-dccb4745959b service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:48.335347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b2dc-dd73-4618-a059-dccb4745959b service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:48.335618 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b2dc-dd73-4618-a059-dccb4745959b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:48.369281 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:48.393979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663b2dc-dd73-4618-a059-dccb4745959b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:48.395380 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663b2dc-dd73-4618-a059-dccb4745959b service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:48.404874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1345/2732] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:53.109014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bdca8-daa0-466d-a608-db83613dee9c service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:53.139682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:53.171281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bdca8-daa0-466d-a608-db83613dee9c service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:53.175739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:53.176388 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:53.176662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:53.176939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] PATH_INFO: `/v3/users/9cd1cd0879044238a3346c6a82d9d218` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:53.178052 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd1cd0879044238a3346c6a82d9d218)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:53.179968 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:53.225214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd1cd0879044238a3346c6a82d9d218'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.232495 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd1cd0879044238a3346c6a82d9d218'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.233156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd1cd0879044238a3346c6a82d9d218'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.233769 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd1cd0879044238a3346c6a82d9d218'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.245572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd1cd0879044238a3346c6a82d9d218'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.257529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1388/2733] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:53 2022] DELETE /identity/v3/users/9cd1cd0879044238a3346c6a82d9d218 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:53.262527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54febf-0d6b-4c0d-a1c4-007edcd85d29 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:53.263255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54febf-0d6b-4c0d-a1c4-007edcd85d29 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:53.263255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54febf-0d6b-4c0d-a1c4-007edcd85d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:53.281914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-0e54febf-0d6b-4c0d-a1c4-007edcd85d29 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:53.283098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0e54febf-0d6b-4c0d-a1c4-007edcd85d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:53.340229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1346/2734] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:34:53.350430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:53.351896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:53.407666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee2b28-72fe-4389-af37-ea3e126f01e6 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:53.411300 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84526bf-f272-452b-823f-1befa72df0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:53.411883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84526bf-f272-452b-823f-1befa72df0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:53.412200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84526bf-f272-452b-823f-1befa72df0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:53.412469 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84526bf-f272-452b-823f-1befa72df0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:53.421399 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84526bf-f272-452b-823f-1befa72df0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:53.422814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84526bf-f272-452b-823f-1befa72df0f6 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:53.432014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1389/2735] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:53.696703 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54febf-0d6b-4c0d-a1c4-007edcd85d29 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:53.698157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0e54febf-0d6b-4c0d-a1c4-007edcd85d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:53.717290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54febf-0d6b-4c0d-a1c4-007edcd85d29 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:53.722763 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:53.723283 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:53.723556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:53.723813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] PATH_INFO: `/v3/projects/039973977a954285a57b4c5118458c61` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:53.724985 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039973977a954285a57b4c5118458c61)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:53.726865 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:53.773596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039973977a954285a57b4c5118458c61', 'request_id': 'req-5a051cbf-4e70-494c-9793-ab2d49c42213'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.779668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039973977a954285a57b4c5118458c61', 'request_id': 'req-5a051cbf-4e70-494c-9793-ab2d49c42213'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.786906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039973977a954285a57b4c5118458c61', 'request_id': 'req-5a051cbf-4e70-494c-9793-ab2d49c42213'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.797454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] The token cache is being invalidate because project 039973977a954285a57b4c5118458c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:53.797739 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.798366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.799918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1347/2736] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:53 2022] DELETE /identity/v3/projects/039973977a954285a57b4c5118458c61 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:53.804000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84526bf-f272-452b-823f-1befa72df0f6 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:53.814351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84526bf-f272-452b-823f-1befa72df0f6 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:53.860580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:53.871159 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326bdd9-93e3-49f5-966b-b1a382b7af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:53.872526 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326bdd9-93e3-49f5-966b-b1a382b7af9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:53.872767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326bdd9-93e3-49f5-966b-b1a382b7af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:53.873067 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326bdd9-93e3-49f5-966b-b1a382b7af9a admin admin] PATH_INFO: `/v3/users/566e448fcafa4bf4a9e1432399d84f52` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:53.874190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326bdd9-93e3-49f5-966b-b1a382b7af9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=566e448fcafa4bf4a9e1432399d84f52)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:53.876129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326bdd9-93e3-49f5-966b-b1a382b7af9a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:53.919795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e326bdd9-93e3-49f5-966b-b1a382b7af9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '566e448fcafa4bf4a9e1432399d84f52'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.926660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e326bdd9-93e3-49f5-966b-b1a382b7af9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '566e448fcafa4bf4a9e1432399d84f52'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.927278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e326bdd9-93e3-49f5-966b-b1a382b7af9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '566e448fcafa4bf4a9e1432399d84f52'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.927890 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e326bdd9-93e3-49f5-966b-b1a382b7af9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '566e448fcafa4bf4a9e1432399d84f52'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.940096 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-e326bdd9-93e3-49f5-966b-b1a382b7af9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '566e448fcafa4bf4a9e1432399d84f52'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:53.951856 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1390/2737] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:53 2022] DELETE /identity/v3/users/566e448fcafa4bf4a9e1432399d84f52 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:34:54.220553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:54.221991 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:54.236187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a051cbf-4e70-494c-9793-ab2d49c42213 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:54.294579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:54.295276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:54.295457 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:54.295724 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] PATH_INFO: `/v3/projects/c001ae91bec84ae4b97c90dcd94777a5` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:54.296873 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c001ae91bec84ae4b97c90dcd94777a5)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:54.298755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:54.300216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:54.346164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c001ae91bec84ae4b97c90dcd94777a5', 'request_id': 'req-ccfc5271-0569-421a-afa4-cad81e97e4c9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:54.352178 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c001ae91bec84ae4b97c90dcd94777a5', 'request_id': 'req-ccfc5271-0569-421a-afa4-cad81e97e4c9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:54.360492 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c001ae91bec84ae4b97c90dcd94777a5', 'request_id': 'req-ccfc5271-0569-421a-afa4-cad81e97e4c9'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:54.371078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] The token cache is being invalidate because project c001ae91bec84ae4b97c90dcd94777a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:54.371396 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:54.372115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-ccfc5271-0569-421a-afa4-cad81e97e4c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:54.373571 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1348/2738] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:54 2022] DELETE /identity/v3/projects/c001ae91bec84ae4b97c90dcd94777a5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:54.378706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86bbf5-c451-4b0a-aeab-7226480c2944 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:54.379169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86bbf5-c451-4b0a-aeab-7226480c2944 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:54.379268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86bbf5-c451-4b0a-aeab-7226480c2944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:54.399040 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-4b86bbf5-c451-4b0a-aeab-7226480c2944 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:54.400247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-4b86bbf5-c451-4b0a-aeab-7226480c2944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:54.459342 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1391/2739] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:54.469309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820b0cb-427d-44e4-9602-769dade166a3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:54.469590 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820b0cb-427d-44e4-9602-769dade166a3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:54.469889 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820b0cb-427d-44e4-9602-769dade166a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:54.489930 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d820b0cb-427d-44e4-9602-769dade166a3 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:54.491140 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d820b0cb-427d-44e4-9602-769dade166a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:54.499196 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1349/2740] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:54.503370 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86bbf5-c451-4b0a-aeab-7226480c2944 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:54.513349 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86bbf5-c451-4b0a-aeab-7226480c2944 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:54.517921 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9a8eb-7384-4791-a956-2c33f918d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:54.518507 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9a8eb-7384-4791-a956-2c33f918d33c admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:54.518786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9a8eb-7384-4791-a956-2c33f918d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:54.519061 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9a8eb-7384-4791-a956-2c33f918d33c admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:54.519698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9a8eb-7384-4791-a956-2c33f918d33c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:34:54.520105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9a8eb-7384-4791-a956-2c33f918d33c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:54.521722 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9a8eb-7384-4791-a956-2c33f918d33c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:54.533826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1392/2741] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:34:54.538048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820b0cb-427d-44e4-9602-769dade166a3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:54.547815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820b0cb-427d-44e4-9602-769dade166a3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:54.552453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b2d96-1aa9-47d6-910a-94f0c625eb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:54.553035 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b2d96-1aa9-47d6-910a-94f0c625eb7c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:54.553307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b2d96-1aa9-47d6-910a-94f0c625eb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:54.553576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b2d96-1aa9-47d6-910a-94f0c625eb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:54.554192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b2d96-1aa9-47d6-910a-94f0c625eb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:54.556098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b2d96-1aa9-47d6-910a-94f0c625eb7c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:54.583110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1350/2742] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:54 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:54.588108 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9a8eb-7384-4791-a956-2c33f918d33c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:54.598896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9a8eb-7384-4791-a956-2c33f918d33c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:54.647554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:54.656144 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3649eca-8862-4a1a-8deb-ebd1d57fd6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:54.656912 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649eca-8862-4a1a-8deb-ebd1d57fd6db admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:54.657364 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649eca-8862-4a1a-8deb-ebd1d57fd6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:54.657812 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649eca-8862-4a1a-8deb-ebd1d57fd6db admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:54.658430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3649eca-8862-4a1a-8deb-ebd1d57fd6db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:54.660381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3649eca-8862-4a1a-8deb-ebd1d57fd6db admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:54.681835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1393/2743] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:54 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:54.686482 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b2d96-1aa9-47d6-910a-94f0c625eb7c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:54.696903 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b2d96-1aa9-47d6-910a-94f0c625eb7c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:54.702224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75333b-4a3b-4f1e-939a-7e86eb1aca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:54.702809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75333b-4a3b-4f1e-939a-7e86eb1aca22 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:54.703086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75333b-4a3b-4f1e-939a-7e86eb1aca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:54.703357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75333b-4a3b-4f1e-939a-7e86eb1aca22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:54.704021 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75333b-4a3b-4f1e-939a-7e86eb1aca22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:54.705607 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75333b-4a3b-4f1e-939a-7e86eb1aca22 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:54.716615 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1351/2744] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:54.720529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3649eca-8862-4a1a-8deb-ebd1d57fd6db admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:54.730200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3649eca-8862-4a1a-8deb-ebd1d57fd6db admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:54.735016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192b96e-02fb-4992-9334-0c4f4331e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:54.735599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192b96e-02fb-4992-9334-0c4f4331e4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:54.735879 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192b96e-02fb-4992-9334-0c4f4331e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:54.736175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192b96e-02fb-4992-9334-0c4f4331e4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:54.736802 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192b96e-02fb-4992-9334-0c4f4331e4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:54.738401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192b96e-02fb-4992-9334-0c4f4331e4fb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:54.749219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1394/2745] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:34:54.752689 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75333b-4a3b-4f1e-939a-7e86eb1aca22 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:54.762304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75333b-4a3b-4f1e-939a-7e86eb1aca22 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:54.767592 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c9507-02c7-4fed-8155-8f4ee68b4c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:54.768258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c9507-02c7-4fed-8155-8f4ee68b4c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:54.768535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c9507-02c7-4fed-8155-8f4ee68b4c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:54.768810 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c9507-02c7-4fed-8155-8f4ee68b4c30 admin admin] PATH_INFO: `/v3/projects/0e23e0bf8e294be39c5755229fdf1c7e/users/4a34644df10849edb5146a3492ac1ffd/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:54.783625 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c9507-02c7-4fed-8155-8f4ee68b4c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e23e0bf8e294be39c5755229fdf1c7e, user_id=4a34644df10849edb5146a3492ac1ffd, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:54.786274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c9507-02c7-4fed-8155-8f4ee68b4c30 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:54.799087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1352/2746] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:54 2022] PUT /identity/v3/projects/0e23e0bf8e294be39c5755229fdf1c7e/users/4a34644df10849edb5146a3492ac1ffd/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:34:54.811018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ce800-a9fc-4150-8a24-cde494bd1933 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:54.811870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ce800-a9fc-4150-8a24-cde494bd1933 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:54.813252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ce800-a9fc-4150-8a24-cde494bd1933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:54.848651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-fc5ce800-a9fc-4150-8a24-cde494bd1933 None None] MFA Rules not processed for user `4a34644df10849edb5146a3492ac1ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:54.849888 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-fc5ce800-a9fc-4150-8a24-cde494bd1933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:54.912643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1395/2747] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:54.917112 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c9507-02c7-4fed-8155-8f4ee68b4c30 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:54.977387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c9507-02c7-4fed-8155-8f4ee68b4c30 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:54.982167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0f4ca-abd4-4fa7-857f-87398fde6ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:54.982751 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0f4ca-abd4-4fa7-857f-87398fde6ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:54.983031 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0f4ca-abd4-4fa7-857f-87398fde6ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:54.983306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0f4ca-abd4-4fa7-857f-87398fde6ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:54.983947 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0f4ca-abd4-4fa7-857f-87398fde6ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:54.985842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0f4ca-abd4-4fa7-857f-87398fde6ce5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:55.014342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1353/2748] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:54 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:55.018607 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ce800-a9fc-4150-8a24-cde494bd1933 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:55.029448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ce800-a9fc-4150-8a24-cde494bd1933 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:55.085389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332098ba-3f9b-4a84-afe3-506cfc31745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:55.085987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332098ba-3f9b-4a84-afe3-506cfc31745b admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:55.086268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332098ba-3f9b-4a84-afe3-506cfc31745b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:55.086542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332098ba-3f9b-4a84-afe3-506cfc31745b admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:55.087177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332098ba-3f9b-4a84-afe3-506cfc31745b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:55.089361 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332098ba-3f9b-4a84-afe3-506cfc31745b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:55.110031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1396/2749] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:55 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:55.114002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0f4ca-abd4-4fa7-857f-87398fde6ce5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:55.124820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0f4ca-abd4-4fa7-857f-87398fde6ce5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:55.129376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503931b1-dc13-452e-b0c6-594837f2f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:55.129965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503931b1-dc13-452e-b0c6-594837f2f3ad admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:55.130242 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503931b1-dc13-452e-b0c6-594837f2f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:55.130510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503931b1-dc13-452e-b0c6-594837f2f3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:55.131143 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503931b1-dc13-452e-b0c6-594837f2f3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:55.132782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503931b1-dc13-452e-b0c6-594837f2f3ad admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:55.138475 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:55.145341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1354/2750] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:55.149516 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332098ba-3f9b-4a84-afe3-506cfc31745b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:55.159420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332098ba-3f9b-4a84-afe3-506cfc31745b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:55.164118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407676c0-0939-44d2-9bc9-53f8eb987d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:55.164702 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407676c0-0939-44d2-9bc9-53f8eb987d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:55.164979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407676c0-0939-44d2-9bc9-53f8eb987d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:55.165254 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407676c0-0939-44d2-9bc9-53f8eb987d1c admin admin] PATH_INFO: `/v3/projects/1d95b60f477249febdb9ab5ee5b721eb/users/d1dff408011d40769041b9d8dcc684bb/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:55.179653 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407676c0-0939-44d2-9bc9-53f8eb987d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d95b60f477249febdb9ab5ee5b721eb, user_id=d1dff408011d40769041b9d8dcc684bb, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:55.182309 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407676c0-0939-44d2-9bc9-53f8eb987d1c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:55.196440 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1397/2751] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:55 2022] PUT /identity/v3/projects/1d95b60f477249febdb9ab5ee5b721eb/users/d1dff408011d40769041b9d8dcc684bb/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:55.200909 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503931b1-dc13-452e-b0c6-594837f2f3ad admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:55.210788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503931b1-dc13-452e-b0c6-594837f2f3ad admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:55.266405 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e7fa3-0f0e-4d51-8edd-7e044ba27f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:55.266999 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e7fa3-0f0e-4d51-8edd-7e044ba27f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:55.267279 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e7fa3-0f0e-4d51-8edd-7e044ba27f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:55.267557 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e7fa3-0f0e-4d51-8edd-7e044ba27f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:55.268215 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e7fa3-0f0e-4d51-8edd-7e044ba27f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:55.269803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e7fa3-0f0e-4d51-8edd-7e044ba27f68 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:55.279569 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1355/2752] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:55.283710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407676c0-0939-44d2-9bc9-53f8eb987d1c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:55.293764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407676c0-0939-44d2-9bc9-53f8eb987d1c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:55.298604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b40e7-c981-4276-bb87-4a51602d3487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:55.299267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b40e7-c981-4276-bb87-4a51602d3487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:55.299543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b40e7-c981-4276-bb87-4a51602d3487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:55.299814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b40e7-c981-4276-bb87-4a51602d3487 admin admin] PATH_INFO: `/v3/projects/1d95b60f477249febdb9ab5ee5b721eb/users/d1dff408011d40769041b9d8dcc684bb/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:55.301735 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b40e7-c981-4276-bb87-4a51602d3487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d95b60f477249febdb9ab5ee5b721eb, user_id=d1dff408011d40769041b9d8dcc684bb, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:55.304366 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b40e7-c981-4276-bb87-4a51602d3487 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:55.315046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1398/2753] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:55 2022] PUT /identity/v3/projects/1d95b60f477249febdb9ab5ee5b721eb/users/d1dff408011d40769041b9d8dcc684bb/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:55.325098 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c65bd-dd7f-41dd-9c1e-518806cf8ddf None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:55.326077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c65bd-dd7f-41dd-9c1e-518806cf8ddf None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:55.326182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c65bd-dd7f-41dd-9c1e-518806cf8ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:55.354670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-007c65bd-dd7f-41dd-9c1e-518806cf8ddf None None] MFA Rules not processed for user `d1dff408011d40769041b9d8dcc684bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:55.355883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-007c65bd-dd7f-41dd-9c1e-518806cf8ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:55.423522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1356/2754] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:55.434188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b40e7-c981-4276-bb87-4a51602d3487 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:55.436759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b75b40e7-c981-4276-bb87-4a51602d3487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:55.457240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:55.494694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b40e7-c981-4276-bb87-4a51602d3487 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:55.498954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c262d-7e4b-4c36-85c7-0c6a9364dff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:55.499541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c262d-7e4b-4c36-85c7-0c6a9364dff1 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:55.499816 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c262d-7e4b-4c36-85c7-0c6a9364dff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:55.500113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c262d-7e4b-4c36-85c7-0c6a9364dff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:55.508993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c262d-7e4b-4c36-85c7-0c6a9364dff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:55.510401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c262d-7e4b-4c36-85c7-0c6a9364dff1 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:55.520287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1399/2755] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:56.102660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c65bd-dd7f-41dd-9c1e-518806cf8ddf None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:56.165726 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c65bd-dd7f-41dd-9c1e-518806cf8ddf None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:56.170376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:56.171057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:56.171335 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:56.171606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] PATH_INFO: `/v3/users/4a34644df10849edb5146a3492ac1ffd` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:56.172745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a34644df10849edb5146a3492ac1ffd)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:56.174826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:56.197324 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:56.223164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a34644df10849edb5146a3492ac1ffd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.230436 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a34644df10849edb5146a3492ac1ffd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.231092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a34644df10849edb5146a3492ac1ffd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.231952 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a34644df10849edb5146a3492ac1ffd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.238735 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a34644df10849edb5146a3492ac1ffd'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.255697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1357/2756] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:56 2022] DELETE /identity/v3/users/4a34644df10849edb5146a3492ac1ffd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:56.260261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15430a46-4da0-49ee-a4d5-0c859ed0e823 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:56.260538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15430a46-4da0-49ee-a4d5-0c859ed0e823 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:56.260806 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15430a46-4da0-49ee-a4d5-0c859ed0e823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:56.280748 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-15430a46-4da0-49ee-a4d5-0c859ed0e823 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:56.281949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-15430a46-4da0-49ee-a4d5-0c859ed0e823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:56.339777 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1400/2757] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:56.350075 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:56.351481 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:56.407986 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2c4a-c57b-48fb-afe6-ee563c2c7de8 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:56.411510 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cce6f-3d13-48fa-bc9c-b468d39f5834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:56.412137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cce6f-3d13-48fa-bc9c-b468d39f5834 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:56.412415 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cce6f-3d13-48fa-bc9c-b468d39f5834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:56.412690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cce6f-3d13-48fa-bc9c-b468d39f5834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:56.422065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cce6f-3d13-48fa-bc9c-b468d39f5834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:56.423791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cce6f-3d13-48fa-bc9c-b468d39f5834 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:56.433573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1358/2758] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:34:56.707995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15430a46-4da0-49ee-a4d5-0c859ed0e823 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:56.709429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-15430a46-4da0-49ee-a4d5-0c859ed0e823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:56.722161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15430a46-4da0-49ee-a4d5-0c859ed0e823 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:56.726854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:56.727484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:56.727763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:56.728074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] PATH_INFO: `/v3/projects/0e23e0bf8e294be39c5755229fdf1c7e` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:56.729192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e23e0bf8e294be39c5755229fdf1c7e)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:56.731095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:56.778931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e23e0bf8e294be39c5755229fdf1c7e', 'request_id': 'req-6c043ee7-27cf-4808-915e-915eed6d28bd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.784969 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e23e0bf8e294be39c5755229fdf1c7e', 'request_id': 'req-6c043ee7-27cf-4808-915e-915eed6d28bd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.792340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e23e0bf8e294be39c5755229fdf1c7e', 'request_id': 'req-6c043ee7-27cf-4808-915e-915eed6d28bd'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.802555 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] The token cache is being invalidate because project 0e23e0bf8e294be39c5755229fdf1c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:56.802835 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.803446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.804949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1401/2759] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:56 2022] DELETE /identity/v3/projects/0e23e0bf8e294be39c5755229fdf1c7e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:56.809065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cce6f-3d13-48fa-bc9c-b468d39f5834 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:56.819530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cce6f-3d13-48fa-bc9c-b468d39f5834 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:56.879447 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663425b9-6931-4eef-800f-0b5304e5f1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:56.880092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663425b9-6931-4eef-800f-0b5304e5f1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:56.880366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663425b9-6931-4eef-800f-0b5304e5f1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:56.880635 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663425b9-6931-4eef-800f-0b5304e5f1f3 admin admin] PATH_INFO: `/v3/users/d1dff408011d40769041b9d8dcc684bb` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:56.881748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663425b9-6931-4eef-800f-0b5304e5f1f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1dff408011d40769041b9d8dcc684bb)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:56.883632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663425b9-6931-4eef-800f-0b5304e5f1f3 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:56.932346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:56.933953 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-663425b9-6931-4eef-800f-0b5304e5f1f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1dff408011d40769041b9d8dcc684bb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.943801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-663425b9-6931-4eef-800f-0b5304e5f1f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1dff408011d40769041b9d8dcc684bb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.944446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-663425b9-6931-4eef-800f-0b5304e5f1f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1dff408011d40769041b9d8dcc684bb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.945058 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-663425b9-6931-4eef-800f-0b5304e5f1f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1dff408011d40769041b9d8dcc684bb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.952490 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-663425b9-6931-4eef-800f-0b5304e5f1f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1dff408011d40769041b9d8dcc684bb'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:56.969667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1359/2760] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:34:56 2022] DELETE /identity/v3/users/d1dff408011d40769041b9d8dcc684bb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:57.237457 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:57.238992 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:57.253732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c043ee7-27cf-4808-915e-915eed6d28bd admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:57.300855 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:57.318095 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:57.318732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:57.319016 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:57.319289 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] PATH_INFO: `/v3/projects/1d95b60f477249febdb9ab5ee5b721eb` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:57.320438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d95b60f477249febdb9ab5ee5b721eb)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:57.322391 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:57.368237 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d95b60f477249febdb9ab5ee5b721eb', 'request_id': 'req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:57.374347 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d95b60f477249febdb9ab5ee5b721eb', 'request_id': 'req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:57.381489 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d95b60f477249febdb9ab5ee5b721eb', 'request_id': 'req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:57.392231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] The token cache is being invalidate because project 1d95b60f477249febdb9ab5ee5b721eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:34:57.392567 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:57.393346 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f8c44d0a-90a0-4fa6-8372-f175a7f0f05f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:34:57.394987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1402/2761] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:34:57 2022] DELETE /identity/v3/projects/1d95b60f477249febdb9ab5ee5b721eb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:57.400039 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cb66f-63c0-454c-9580-da22efa0ba69 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:57.400527 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cb66f-63c0-454c-9580-da22efa0ba69 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:57.400728 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cb66f-63c0-454c-9580-da22efa0ba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:57.421901 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ae5cb66f-63c0-454c-9580-da22efa0ba69 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:57.423087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ae5cb66f-63c0-454c-9580-da22efa0ba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:57.480553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1360/2762] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:57.543714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcc39b-aa91-49cd-a8e2-50b753a643f6 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:57.544024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcc39b-aa91-49cd-a8e2-50b753a643f6 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:57.544351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcc39b-aa91-49cd-a8e2-50b753a643f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:57.564699 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b9bcc39b-aa91-49cd-a8e2-50b753a643f6 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:57.565889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b9bcc39b-aa91-49cd-a8e2-50b753a643f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:57.573625 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1403/2763] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:57.578553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cb66f-63c0-454c-9580-da22efa0ba69 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:57.588131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cb66f-63c0-454c-9580-da22efa0ba69 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:57.593789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a57f-7b99-45e1-92c0-09270acca8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:57.594374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a57f-7b99-45e1-92c0-09270acca8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:57.594652 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a57f-7b99-45e1-92c0-09270acca8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:57.594928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a57f-7b99-45e1-92c0-09270acca8a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:57.595563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a57f-7b99-45e1-92c0-09270acca8a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:34:57.595862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a57f-7b99-45e1-92c0-09270acca8a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:57.597479 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a57f-7b99-45e1-92c0-09270acca8a2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:57.608710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1361/2764] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:34:57.613047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcc39b-aa91-49cd-a8e2-50b753a643f6 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:57.621979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcc39b-aa91-49cd-a8e2-50b753a643f6 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:57.627166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375dc2c-7e2a-431b-a20c-e2303b91c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:57.627753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375dc2c-7e2a-431b-a20c-e2303b91c6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:57.628079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375dc2c-7e2a-431b-a20c-e2303b91c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:57.628372 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375dc2c-7e2a-431b-a20c-e2303b91c6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:57.628987 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375dc2c-7e2a-431b-a20c-e2303b91c6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:57.630893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375dc2c-7e2a-431b-a20c-e2303b91c6d5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:57.658330 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1404/2765] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:34:57 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:34:57.662374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a57f-7b99-45e1-92c0-09270acca8a2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:57.673394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a57f-7b99-45e1-92c0-09270acca8a2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:57.728551 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0009a0-4c9b-4935-93e1-5642cca106ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:57.729135 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0009a0-4c9b-4935-93e1-5642cca106ff admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:57.729411 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0009a0-4c9b-4935-93e1-5642cca106ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:57.729682 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0009a0-4c9b-4935-93e1-5642cca106ff admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:57.730304 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0009a0-4c9b-4935-93e1-5642cca106ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:57.732409 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0009a0-4c9b-4935-93e1-5642cca106ff admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:57.754000 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1362/2766] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:34:57 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:34:57.758278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375dc2c-7e2a-431b-a20c-e2303b91c6d5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:57.769263 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375dc2c-7e2a-431b-a20c-e2303b91c6d5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:57.773785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9b2bd-5177-4287-83e6-192827eab63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:57.774375 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9b2bd-5177-4287-83e6-192827eab63d admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:57.774704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9b2bd-5177-4287-83e6-192827eab63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:57.774979 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9b2bd-5177-4287-83e6-192827eab63d admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:57.775607 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9b2bd-5177-4287-83e6-192827eab63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:57.777250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9b2bd-5177-4287-83e6-192827eab63d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:57.788018 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1405/2767] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:34:57.792195 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0009a0-4c9b-4935-93e1-5642cca106ff admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:57.802438 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0009a0-4c9b-4935-93e1-5642cca106ff admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:57.807014 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56b441-0f88-4355-8b19-ac55117226c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:57.807594 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b441-0f88-4355-8b19-ac55117226c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:57.807866 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b441-0f88-4355-8b19-ac55117226c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:57.808273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b441-0f88-4355-8b19-ac55117226c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:57.808908 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56b441-0f88-4355-8b19-ac55117226c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:57.810684 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56b441-0f88-4355-8b19-ac55117226c9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:57.821109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1363/2768] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:34:57.825189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9b2bd-5177-4287-83e6-192827eab63d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:57.837713 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9b2bd-5177-4287-83e6-192827eab63d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:57.843212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80936e2-a00e-498a-b727-33bdd3cc684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:57.843854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80936e2-a00e-498a-b727-33bdd3cc684e admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:57.844166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80936e2-a00e-498a-b727-33bdd3cc684e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:57.844442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80936e2-a00e-498a-b727-33bdd3cc684e admin admin] PATH_INFO: `/v3/projects/67f26ef1d86d498d99cc3be80c8aee2b/users/e76ca75858834dafb70b2ec7d149c2af/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:57.858530 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80936e2-a00e-498a-b727-33bdd3cc684e admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f26ef1d86d498d99cc3be80c8aee2b, user_id=e76ca75858834dafb70b2ec7d149c2af, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:57.861191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80936e2-a00e-498a-b727-33bdd3cc684e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:57.873721 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1406/2769] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:34:57 2022] PUT /identity/v3/projects/67f26ef1d86d498d99cc3be80c8aee2b/users/e76ca75858834dafb70b2ec7d149c2af/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:34:57.883949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd34c8-264a-45cd-8a63-9ea5074e463a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:57.884237 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd34c8-264a-45cd-8a63-9ea5074e463a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:57.884512 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd34c8-264a-45cd-8a63-9ea5074e463a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:57.913370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-21dd34c8-264a-45cd-8a63-9ea5074e463a None None] MFA Rules not processed for user `e76ca75858834dafb70b2ec7d149c2af`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:34:57.914580 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-21dd34c8-264a-45cd-8a63-9ea5074e463a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:57.930861 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:34:57.980927 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1364/2770] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:34:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:34:57.992060 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80936e2-a00e-498a-b727-33bdd3cc684e admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:34:57.993739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f80936e2-a00e-498a-b727-33bdd3cc684e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:34:58.049417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80936e2-a00e-498a-b727-33bdd3cc684e admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:34:58.053014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc12315-5ca9-431a-8e27-11fb28bcdd15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c498b5857f42f2ab84423f8f4ea11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:34:58.053599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12315-5ca9-431a-8e27-11fb28bcdd15 service glance] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:34:58.053876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12315-5ca9-431a-8e27-11fb28bcdd15 service glance] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:34:58.054150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12315-5ca9-431a-8e27-11fb28bcdd15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:34:58.062949 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc12315-5ca9-431a-8e27-11fb28bcdd15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:34:58.064401 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc12315-5ca9-431a-8e27-11fb28bcdd15 service glance] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:34:58.073353 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1407/2771] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:34:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:35:07.978043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=19 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:35:08.069220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:35:17.800980 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd34c8-264a-45cd-8a63-9ea5074e463a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:17.864654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd34c8-264a-45cd-8a63-9ea5074e463a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:17.869973 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:17.870584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:17.870856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:17.871120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] PATH_INFO: `/v3/users/e76ca75858834dafb70b2ec7d149c2af` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:17.872244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76ca75858834dafb70b2ec7d149c2af)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:17.874129 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:17.920420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76ca75858834dafb70b2ec7d149c2af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:17.927783 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76ca75858834dafb70b2ec7d149c2af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:17.928424 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76ca75858834dafb70b2ec7d149c2af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:17.929029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76ca75858834dafb70b2ec7d149c2af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:17.936644 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76ca75858834dafb70b2ec7d149c2af'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:17.953341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1365/2772] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:35:17 2022] DELETE /identity/v3/users/e76ca75858834dafb70b2ec7d149c2af => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:35:17.957831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e735b1-f926-47dd-b704-2cbd7c5e364f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:17.958303 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e735b1-f926-47dd-b704-2cbd7c5e364f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:17.958428 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e735b1-f926-47dd-b704-2cbd7c5e364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:17.977410 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e2e735b1-f926-47dd-b704-2cbd7c5e364f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:35:17.979170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e2e735b1-f926-47dd-b704-2cbd7c5e364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:18.035710 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1408/2773] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:35:18.046338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:18.047733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:18.106448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21b33d-2204-47d8-992d-4ffe936fef1d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:18.110057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcbd6-c262-45c4-86e1-a999177f28ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:18.110654 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcbd6-c262-45c4-86e1-a999177f28ea service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:18.110933 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcbd6-c262-45c4-86e1-a999177f28ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:18.111184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcbd6-c262-45c4-86e1-a999177f28ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:18.120524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfcbd6-c262-45c4-86e1-a999177f28ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:18.121931 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfcbd6-c262-45c4-86e1-a999177f28ea service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:18.131056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1366/2774] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:35:18.397716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e735b1-f926-47dd-b704-2cbd7c5e364f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:18.399149 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e2e735b1-f926-47dd-b704-2cbd7c5e364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:18.411828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e735b1-f926-47dd-b704-2cbd7c5e364f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:18.417652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:18.418319 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:18.418593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:18.418863 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] PATH_INFO: `/v3/projects/67f26ef1d86d498d99cc3be80c8aee2b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:18.420006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f26ef1d86d498d99cc3be80c8aee2b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:18.421891 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:18.467860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f26ef1d86d498d99cc3be80c8aee2b', 'request_id': 'req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:18.474253 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f26ef1d86d498d99cc3be80c8aee2b', 'request_id': 'req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:18.482091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f26ef1d86d498d99cc3be80c8aee2b', 'request_id': 'req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:18.492345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] The token cache is being invalidate because project 67f26ef1d86d498d99cc3be80c8aee2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:35:18.492629 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:18.493258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-f9f2904a-2012-4b66-b93a-0a759c7fc3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:18.494819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1409/2775] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:35:18 2022] DELETE /identity/v3/projects/67f26ef1d86d498d99cc3be80c8aee2b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:35:18.499723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae18224-d6e2-4972-913e-5d50cd0dc27c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:18.500020 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae18224-d6e2-4972-913e-5d50cd0dc27c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:18.500290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae18224-d6e2-4972-913e-5d50cd0dc27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:18.520059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6ae18224-d6e2-4972-913e-5d50cd0dc27c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:35:18.521248 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6ae18224-d6e2-4972-913e-5d50cd0dc27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:18.538268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:35:18.581823 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1367/2776] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:35:18.591117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259df98-f70e-4c57-a5d4-c51e9f252177 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:18.591486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259df98-f70e-4c57-a5d4-c51e9f252177 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:18.591750 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259df98-f70e-4c57-a5d4-c51e9f252177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:18.611377 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f259df98-f70e-4c57-a5d4-c51e9f252177 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:35:18.612595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f259df98-f70e-4c57-a5d4-c51e9f252177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:18.620312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1410/2777] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:35:18.624556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae18224-d6e2-4972-913e-5d50cd0dc27c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:18.634232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae18224-d6e2-4972-913e-5d50cd0dc27c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:18.639343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52e53d-074b-4a67-8694-8c45485308e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:18.639961 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52e53d-074b-4a67-8694-8c45485308e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:18.640241 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52e53d-074b-4a67-8694-8c45485308e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:18.640515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52e53d-074b-4a67-8694-8c45485308e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:18.641184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52e53d-074b-4a67-8694-8c45485308e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:35:18.641488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52e53d-074b-4a67-8694-8c45485308e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:18.643072 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52e53d-074b-4a67-8694-8c45485308e2 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:18.655170 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1368/2778] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:35:18.659312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259df98-f70e-4c57-a5d4-c51e9f252177 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:18.669036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259df98-f70e-4c57-a5d4-c51e9f252177 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:18.673595 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50deef-0d36-4059-8a6d-45e262f4461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:18.674176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50deef-0d36-4059-8a6d-45e262f4461c admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:18.674446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50deef-0d36-4059-8a6d-45e262f4461c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:18.674713 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50deef-0d36-4059-8a6d-45e262f4461c admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:18.675358 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50deef-0d36-4059-8a6d-45e262f4461c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:18.677264 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50deef-0d36-4059-8a6d-45e262f4461c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:18.703849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1411/2779] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:35:18 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:35:18.708049 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52e53d-074b-4a67-8694-8c45485308e2 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:18.719408 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52e53d-074b-4a67-8694-8c45485308e2 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:18.774081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754609c-987b-412b-9fc4-6b181e54e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:18.774599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754609c-987b-412b-9fc4-6b181e54e8ec admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:18.774874 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754609c-987b-412b-9fc4-6b181e54e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:18.775143 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754609c-987b-412b-9fc4-6b181e54e8ec admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:18.776364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754609c-987b-412b-9fc4-6b181e54e8ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:18.778488 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754609c-987b-412b-9fc4-6b181e54e8ec admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:18.798403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1369/2780] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:35:18 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:35:18.802448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50deef-0d36-4059-8a6d-45e262f4461c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:18.813517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50deef-0d36-4059-8a6d-45e262f4461c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:18.818145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0a1dd-e74e-45b0-b8eb-3eeebbdc60e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:18.818753 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0a1dd-e74e-45b0-b8eb-3eeebbdc60e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:18.819025 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0a1dd-e74e-45b0-b8eb-3eeebbdc60e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:18.819293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0a1dd-e74e-45b0-b8eb-3eeebbdc60e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:18.819935 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0a1dd-e74e-45b0-b8eb-3eeebbdc60e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:18.821514 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0a1dd-e74e-45b0-b8eb-3eeebbdc60e5 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:18.832393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1412/2781] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:35:18.836262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754609c-987b-412b-9fc4-6b181e54e8ec admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:18.846771 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754609c-987b-412b-9fc4-6b181e54e8ec admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:18.851303 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd436a-ff2f-495d-ae81-a88064f374d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:18.851888 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd436a-ff2f-495d-ae81-a88064f374d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:18.852188 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd436a-ff2f-495d-ae81-a88064f374d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:18.852460 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd436a-ff2f-495d-ae81-a88064f374d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:18.853086 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd436a-ff2f-495d-ae81-a88064f374d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:18.854897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd436a-ff2f-495d-ae81-a88064f374d5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:18.865115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1370/2782] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:35:18.869036 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0a1dd-e74e-45b0-b8eb-3eeebbdc60e5 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:18.879343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0a1dd-e74e-45b0-b8eb-3eeebbdc60e5 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:18.883845 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b32d0e-7708-422c-93e7-2dbe19fa12bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:18.884503 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b32d0e-7708-422c-93e7-2dbe19fa12bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:18.884779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b32d0e-7708-422c-93e7-2dbe19fa12bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:18.885652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b32d0e-7708-422c-93e7-2dbe19fa12bc admin admin] PATH_INFO: `/v3/projects/3bf3049cf1e84951a1512968695a28aa/users/6cdaf5226b0e4418afa9bc688cefd838/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:18.900024 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b32d0e-7708-422c-93e7-2dbe19fa12bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf3049cf1e84951a1512968695a28aa, user_id=6cdaf5226b0e4418afa9bc688cefd838, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:18.903000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b32d0e-7708-422c-93e7-2dbe19fa12bc admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:18.915669 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1413/2783] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:35:18 2022] PUT /identity/v3/projects/3bf3049cf1e84951a1512968695a28aa/users/6cdaf5226b0e4418afa9bc688cefd838/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:35:18.925966 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e466-6ddd-4a20-8d5a-fe2c177fd936 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:18.926273 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e466-6ddd-4a20-8d5a-fe2c177fd936 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:18.926547 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e466-6ddd-4a20-8d5a-fe2c177fd936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:18.954441 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7a29e466-6ddd-4a20-8d5a-fe2c177fd936 None None] MFA Rules not processed for user `6cdaf5226b0e4418afa9bc688cefd838`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:35:18.955634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7a29e466-6ddd-4a20-8d5a-fe2c177fd936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:19.017462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1371/2784] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:35:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:35:19.028194 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b32d0e-7708-422c-93e7-2dbe19fa12bc admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:19.029799 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-07b32d0e-7708-422c-93e7-2dbe19fa12bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:19.051368 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:35:19.088918 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b32d0e-7708-422c-93e7-2dbe19fa12bc admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:19.092557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ecc94-da3d-4d92-8fdf-ae3e91855196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:19.093154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ecc94-da3d-4d92-8fdf-ae3e91855196 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:19.093430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ecc94-da3d-4d92-8fdf-ae3e91855196 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:19.093957 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ecc94-da3d-4d92-8fdf-ae3e91855196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:19.102054 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ecc94-da3d-4d92-8fdf-ae3e91855196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:19.103474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ecc94-da3d-4d92-8fdf-ae3e91855196 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:19.112323 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1414/2785] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:35:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:35:24.455383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29e466-6ddd-4a20-8d5a-fe2c177fd936 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:24.475177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:35:24.519232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29e466-6ddd-4a20-8d5a-fe2c177fd936 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:24.523715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:24.524356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:24.524637 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:24.524912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] PATH_INFO: `/v3/users/6cdaf5226b0e4418afa9bc688cefd838` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:24.526013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cdaf5226b0e4418afa9bc688cefd838)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:24.528530 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:24.572781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cdaf5226b0e4418afa9bc688cefd838'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:24.580449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cdaf5226b0e4418afa9bc688cefd838'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:24.581059 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cdaf5226b0e4418afa9bc688cefd838'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:24.581653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cdaf5226b0e4418afa9bc688cefd838'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:24.588548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cdaf5226b0e4418afa9bc688cefd838'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:24.606384 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1372/2786] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:35:24 2022] DELETE /identity/v3/users/6cdaf5226b0e4418afa9bc688cefd838 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:35:24.610924 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7837eed-4b3e-4ecb-9e5d-821f31136323 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:24.611419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7837eed-4b3e-4ecb-9e5d-821f31136323 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:24.611524 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7837eed-4b3e-4ecb-9e5d-821f31136323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:24.629881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-f7837eed-4b3e-4ecb-9e5d-821f31136323 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:35:24.631109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f7837eed-4b3e-4ecb-9e5d-821f31136323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:24.688497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1415/2787] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:35:24.698071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:24.699478 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:24.757928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717c9bd-9655-4b4d-8532-297adcdbf3ae admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:24.761603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215f96f-d0fb-4fec-b498-1889cf72c9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:24.762719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215f96f-d0fb-4fec-b498-1889cf72c9de service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:24.762997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215f96f-d0fb-4fec-b498-1889cf72c9de service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:24.763268 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215f96f-d0fb-4fec-b498-1889cf72c9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:24.772252 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215f96f-d0fb-4fec-b498-1889cf72c9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:24.773668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215f96f-d0fb-4fec-b498-1889cf72c9de service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:24.783920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1373/2788] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:35:25.049174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7837eed-4b3e-4ecb-9e5d-821f31136323 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:25.050576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f7837eed-4b3e-4ecb-9e5d-821f31136323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:25.065345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7837eed-4b3e-4ecb-9e5d-821f31136323 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:25.069994 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:25.070620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:25.070894 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:25.071169 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] PATH_INFO: `/v3/projects/3bf3049cf1e84951a1512968695a28aa` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:25.072342 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf3049cf1e84951a1512968695a28aa)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:25.075419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:25.120870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf3049cf1e84951a1512968695a28aa', 'request_id': 'req-3f02af6f-625f-406e-98d5-692245504c35'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:25.127573 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf3049cf1e84951a1512968695a28aa', 'request_id': 'req-3f02af6f-625f-406e-98d5-692245504c35'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:25.134468 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf3049cf1e84951a1512968695a28aa', 'request_id': 'req-3f02af6f-625f-406e-98d5-692245504c35'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:25.145258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] The token cache is being invalidate because project 3bf3049cf1e84951a1512968695a28aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:35:25.145543 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:25.146170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:35:25.147630 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1416/2789] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:35:25 2022] DELETE /identity/v3/projects/3bf3049cf1e84951a1512968695a28aa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:35:34.780306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:35:35.142284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:35:44.184274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215f96f-d0fb-4fec-b498-1889cf72c9de service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:35:44.185845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e215f96f-d0fb-4fec-b498-1889cf72c9de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:44.198073 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215f96f-d0fb-4fec-b498-1889cf72c9de service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:35:44.247444 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abd4fd-03f4-41ed-9b74-5bd1278f8780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:35:44.248069 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abd4fd-03f4-41ed-9b74-5bd1278f8780 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:35:44.248348 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abd4fd-03f4-41ed-9b74-5bd1278f8780 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:35:44.248645 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abd4fd-03f4-41ed-9b74-5bd1278f8780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:35:44.250369 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c7abd4fd-03f4-41ed-9b74-5bd1278f8780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:35:44.260324 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abd4fd-03f4-41ed-9b74-5bd1278f8780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:35:44.261731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abd4fd-03f4-41ed-9b74-5bd1278f8780 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:35:44.270367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1374/2790] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:35:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:35:54.266048 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=26 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:36:01.532745 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:36:01.534123 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:36:01.590164 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02af6f-625f-406e-98d5-692245504c35 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:36:01.593728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdec4a-b27e-41ef-a2b4-5109de5947c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:36:01.594316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdec4a-b27e-41ef-a2b4-5109de5947c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:36:01.594594 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdec4a-b27e-41ef-a2b4-5109de5947c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:36:01.594870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdec4a-b27e-41ef-a2b4-5109de5947c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:36:01.596603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-13bdec4a-b27e-41ef-a2b4-5109de5947c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:36:01.665232 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdec4a-b27e-41ef-a2b4-5109de5947c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:36:01.666650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdec4a-b27e-41ef-a2b4-5109de5947c4 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:36:01.678732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1417/2791] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:36:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:36:06.191119 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abd4fd-03f4-41ed-9b74-5bd1278f8780 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:36:06.192528 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c7abd4fd-03f4-41ed-9b74-5bd1278f8780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:36:06.203430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abd4fd-03f4-41ed-9b74-5bd1278f8780 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:36:06.207006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fcd22-6a68-4baa-8820-00bfc224891e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:36:06.207588 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fcd22-6a68-4baa-8820-00bfc224891e service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:36:06.207863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fcd22-6a68-4baa-8820-00bfc224891e service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:36:06.208160 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fcd22-6a68-4baa-8820-00bfc224891e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:36:06.210709 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-db6fcd22-6a68-4baa-8820-00bfc224891e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:36:06.223687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fcd22-6a68-4baa-8820-00bfc224891e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:36:06.225367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fcd22-6a68-4baa-8820-00bfc224891e service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:36:06.236449 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1375/2792] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:36:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:36:11.673275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=54 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:36:16.231597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:37:43.542692 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdec4a-b27e-41ef-a2b4-5109de5947c4 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:37:43.544170 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-13bdec4a-b27e-41ef-a2b4-5109de5947c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:37:43.611213 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdec4a-b27e-41ef-a2b4-5109de5947c4 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:37:43.616577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ad487-ab7e-4686-b73d-0357e38e939c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:37:43.617200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ad487-ab7e-4686-b73d-0357e38e939c service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:37:43.617611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ad487-ab7e-4686-b73d-0357e38e939c service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:37:43.617871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ad487-ab7e-4686-b73d-0357e38e939c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:37:43.619593 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9a5ad487-ab7e-4686-b73d-0357e38e939c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:37:43.631190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ad487-ab7e-4686-b73d-0357e38e939c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:37:43.632797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ad487-ab7e-4686-b73d-0357e38e939c service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:37:43.642648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1418/2793] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:37:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:37:53.638397 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=32 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:38:37.181275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fcd22-6a68-4baa-8820-00bfc224891e service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:38:37.183787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-db6fcd22-6a68-4baa-8820-00bfc224891e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:38:37.198329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fcd22-6a68-4baa-8820-00bfc224891e service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:38:37.205262 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594f873-1fff-49dc-916c-484d95a7033b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:38:37.205842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594f873-1fff-49dc-916c-484d95a7033b service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:38:37.206207 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594f873-1fff-49dc-916c-484d95a7033b service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:38:37.206456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594f873-1fff-49dc-916c-484d95a7033b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:38:37.208441 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1594f873-1fff-49dc-916c-484d95a7033b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:38:37.222139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594f873-1fff-49dc-916c-484d95a7033b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:38:37.223776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594f873-1fff-49dc-916c-484d95a7033b service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:38:37.236678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1376/2794] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:38:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:38:40.688679 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1448-0aab-47c7-b1c0-5958c8b362c5 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:38:40.689220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1448-0aab-47c7-b1c0-5958c8b362c5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:38:40.689331 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1448-0aab-47c7-b1c0-5958c8b362c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:38:40.709693 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-c7fa1448-0aab-47c7-b1c0-5958c8b362c5 None None] MFA Rules not processed for user `64f720a590ec49889830b72487d390bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:38:40.710870 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-c7fa1448-0aab-47c7-b1c0-5958c8b362c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:38:40.764345 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1419/2795] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:38:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:38:41.066643 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594f873-1fff-49dc-916c-484d95a7033b service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:38:41.068070 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1594f873-1fff-49dc-916c-484d95a7033b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:38:41.079277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594f873-1fff-49dc-916c-484d95a7033b service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:38:41.082787 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc844b-ec3e-4085-88b2-ce45865ca1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:38:41.083366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc844b-ec3e-4085-88b2-ce45865ca1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:38:41.083640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc844b-ec3e-4085-88b2-ce45865ca1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:38:41.083923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc844b-ec3e-4085-88b2-ce45865ca1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:38:41.085643 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-83cc844b-ec3e-4085-88b2-ce45865ca1d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:38:41.095261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc844b-ec3e-4085-88b2-ce45865ca1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:38:41.096697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc844b-ec3e-4085-88b2-ce45865ca1d8 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:38:41.104723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1377/2796] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:38:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:38:41.430194 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa1448-0aab-47c7-b1c0-5958c8b362c5 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:38:41.443136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa1448-0aab-47c7-b1c0-5958c8b362c5 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:38:41.448118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bb7b0-b30e-402e-8807-38319549f928 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:38:41.448752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bb7b0-b30e-402e-8807-38319549f928 service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:38:41.449031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bb7b0-b30e-402e-8807-38319549f928 service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:38:41.449302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bb7b0-b30e-402e-8807-38319549f928 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:38:41.451006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-f18bb7b0-b30e-402e-8807-38319549f928 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:38:41.463460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bb7b0-b30e-402e-8807-38319549f928 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:38:41.464989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bb7b0-b30e-402e-8807-38319549f928 service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:38:41.476295 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1420/2797] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:38:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:38:48.739990 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc844b-ec3e-4085-88b2-ce45865ca1d8 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:38:48.754290 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc844b-ec3e-4085-88b2-ce45865ca1d8 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:38:48.760026 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305a7e-58df-4e47-ace7-06222f8a8364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:38:48.760633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305a7e-58df-4e47-ace7-06222f8a8364 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:38:48.760941 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305a7e-58df-4e47-ace7-06222f8a8364 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:38:48.761270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305a7e-58df-4e47-ace7-06222f8a8364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:38:48.763007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cb305a7e-58df-4e47-ace7-06222f8a8364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:38:48.775755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb305a7e-58df-4e47-ace7-06222f8a8364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:38:48.777356 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb305a7e-58df-4e47-ace7-06222f8a8364 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:38:48.788710 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1378/2798] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:38:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:38:51.471691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=31 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:38:51.939128 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bb7b0-b30e-402e-8807-38319549f928 service placement] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:38:51.952869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bb7b0-b30e-402e-8807-38319549f928 service placement] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:38:51.959422 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d72e4a-7ce1-43d2-9ff8-fafd1c3e0790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:38:51.960034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d72e4a-7ce1-43d2-9ff8-fafd1c3e0790 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:38:51.960312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d72e4a-7ce1-43d2-9ff8-fafd1c3e0790 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:38:51.960582 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d72e4a-7ce1-43d2-9ff8-fafd1c3e0790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:38:51.962335 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-52d72e4a-7ce1-43d2-9ff8-fafd1c3e0790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:38:51.975324 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d72e4a-7ce1-43d2-9ff8-fafd1c3e0790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:38:51.976978 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d72e4a-7ce1-43d2-9ff8-fafd1c3e0790 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:38:51.988761 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1421/2799] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:38:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:38:58.784022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=18 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:39:01.983166 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=6 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:06.871147 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305a7e-58df-4e47-ace7-06222f8a8364 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:06.873721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-cb305a7e-58df-4e47-ace7-06222f8a8364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:06.888490 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305a7e-58df-4e47-ace7-06222f8a8364 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:06.893984 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6823fe-c0f6-45e9-9706-3450a1344cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:06.894564 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6823fe-c0f6-45e9-9706-3450a1344cba service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:06.894839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6823fe-c0f6-45e9-9706-3450a1344cba service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:06.895107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6823fe-c0f6-45e9-9706-3450a1344cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:06.896749 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1d6823fe-c0f6-45e9-9706-3450a1344cba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:06.906840 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6823fe-c0f6-45e9-9706-3450a1344cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:06.908429 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6823fe-c0f6-45e9-9706-3450a1344cba service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:06.917046 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1379/2800] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:16.913037 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=6 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:25.894086 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d72e4a-7ce1-43d2-9ff8-fafd1c3e0790 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:25.903881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d72e4a-7ce1-43d2-9ff8-fafd1c3e0790 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:25.908145 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2674f2-315c-42cf-af2e-1493631a647d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:25.908729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2674f2-315c-42cf-af2e-1493631a647d service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:25.909002 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2674f2-315c-42cf-af2e-1493631a647d service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:25.909276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2674f2-315c-42cf-af2e-1493631a647d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:25.910975 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7c2674f2-315c-42cf-af2e-1493631a647d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:25.971737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2674f2-315c-42cf-af2e-1493631a647d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:25.973173 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2674f2-315c-42cf-af2e-1493631a647d service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:25.982488 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1422/2801] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:29.028200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6823fe-c0f6-45e9-9706-3450a1344cba service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:29.030357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1d6823fe-c0f6-45e9-9706-3450a1344cba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:29.049967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6823fe-c0f6-45e9-9706-3450a1344cba service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:29.055561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e0212-c0ae-4a79-a776-adf115072f80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:29.056622 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e0212-c0ae-4a79-a776-adf115072f80 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.056740 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e0212-c0ae-4a79-a776-adf115072f80 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.056923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e0212-c0ae-4a79-a776-adf115072f80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.058875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-939e0212-c0ae-4a79-a776-adf115072f80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:29.072962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e0212-c0ae-4a79-a776-adf115072f80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:29.074585 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e0212-c0ae-4a79-a776-adf115072f80 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:29.086786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1380/2802] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:29.096484 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2674f2-315c-42cf-af2e-1493631a647d service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:29.098291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7c2674f2-315c-42cf-af2e-1493631a647d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:29.114752 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2674f2-315c-42cf-af2e-1493631a647d service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:29.120704 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbf6e8-6c8e-4c43-a7c8-1066ac9188e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:29.121419 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbf6e8-6c8e-4c43-a7c8-1066ac9188e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.121768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbf6e8-6c8e-4c43-a7c8-1066ac9188e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.122112 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbf6e8-6c8e-4c43-a7c8-1066ac9188e4 admin admin] PATH_INFO: `/v3/users/64f720a590ec49889830b72487d390bf` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.123308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbf6e8-6c8e-4c43-a7c8-1066ac9188e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f720a590ec49889830b72487d390bf)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:29.125746 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbf6e8-6c8e-4c43-a7c8-1066ac9188e4 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:29.178818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-57fbf6e8-6c8e-4c43-a7c8-1066ac9188e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f720a590ec49889830b72487d390bf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:29.186344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-57fbf6e8-6c8e-4c43-a7c8-1066ac9188e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f720a590ec49889830b72487d390bf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:29.187059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-57fbf6e8-6c8e-4c43-a7c8-1066ac9188e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f720a590ec49889830b72487d390bf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:29.187831 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-57fbf6e8-6c8e-4c43-a7c8-1066ac9188e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f720a590ec49889830b72487d390bf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:29.199842 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-57fbf6e8-6c8e-4c43-a7c8-1066ac9188e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f720a590ec49889830b72487d390bf'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:29.211816 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1423/2803] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:40:29 2022] DELETE /identity/v3/users/64f720a590ec49889830b72487d390bf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:29.387870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e0212-c0ae-4a79-a776-adf115072f80 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:29.399033 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e0212-c0ae-4a79-a776-adf115072f80 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:29.456506 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:29.457146 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.457401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.457669 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] PATH_INFO: `/v3/projects/41c783adabb94ed3bceb5886523673f8` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.458755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c783adabb94ed3bceb5886523673f8)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:29.460663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:29.505639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c783adabb94ed3bceb5886523673f8', 'request_id': 'req-6240af47-75df-4328-b7e1-a0eaf740641f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:29.511705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c783adabb94ed3bceb5886523673f8', 'request_id': 'req-6240af47-75df-4328-b7e1-a0eaf740641f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:29.519883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c783adabb94ed3bceb5886523673f8', 'request_id': 'req-6240af47-75df-4328-b7e1-a0eaf740641f'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:29.530029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] The token cache is being invalidate because project 41c783adabb94ed3bceb5886523673f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:40:29.530314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:29.531750 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-6240af47-75df-4328-b7e1-a0eaf740641f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:29.533376 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1381/2804] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:40:29 2022] DELETE /identity/v3/projects/41c783adabb94ed3bceb5886523673f8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:29.538247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e9209-06a7-4106-a4f8-6581ae234881 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.538563 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e9209-06a7-4106-a4f8-6581ae234881 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.538857 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e9209-06a7-4106-a4f8-6581ae234881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.558458 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-7b8e9209-06a7-4106-a4f8-6581ae234881 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:29.560015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-7b8e9209-06a7-4106-a4f8-6581ae234881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:29.619549 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1424/2805] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:29.627713 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4855559-d408-47cc-9bc2-bb6a13790de9 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.628034 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4855559-d408-47cc-9bc2-bb6a13790de9 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.628314 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4855559-d408-47cc-9bc2-bb6a13790de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.648294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b4855559-d408-47cc-9bc2-bb6a13790de9 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:29.649502 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b4855559-d408-47cc-9bc2-bb6a13790de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:29.657496 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1382/2806] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:29.661627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e9209-06a7-4106-a4f8-6581ae234881 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:29.671127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e9209-06a7-4106-a4f8-6581ae234881 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:29.676097 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae44437-1df1-48c1-9a1c-608fe15b8caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:29.676682 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae44437-1df1-48c1-9a1c-608fe15b8caa admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.676955 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae44437-1df1-48c1-9a1c-608fe15b8caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.677222 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae44437-1df1-48c1-9a1c-608fe15b8caa admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.677852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae44437-1df1-48c1-9a1c-608fe15b8caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:40:29.678146 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae44437-1df1-48c1-9a1c-608fe15b8caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:29.679733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae44437-1df1-48c1-9a1c-608fe15b8caa admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:29.681191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:29.694220 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1425/2807] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:40:29.698606 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4855559-d408-47cc-9bc2-bb6a13790de9 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:29.708768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4855559-d408-47cc-9bc2-bb6a13790de9 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:29.713399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e9317-c945-4efb-9e9f-853d49ebea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:29.714005 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e9317-c945-4efb-9e9f-853d49ebea25 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.714277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e9317-c945-4efb-9e9f-853d49ebea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.714545 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e9317-c945-4efb-9e9f-853d49ebea25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.715171 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e9317-c945-4efb-9e9f-853d49ebea25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:29.717071 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e9317-c945-4efb-9e9f-853d49ebea25 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:29.743082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1383/2808] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:40:29 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:29.747155 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae44437-1df1-48c1-9a1c-608fe15b8caa admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:29.757551 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae44437-1df1-48c1-9a1c-608fe15b8caa admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:29.813785 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17457e9-4c94-4941-823b-6acb1c711c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:29.814308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17457e9-4c94-4941-823b-6acb1c711c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.814586 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17457e9-4c94-4941-823b-6acb1c711c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.814876 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17457e9-4c94-4941-823b-6acb1c711c17 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.815486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17457e9-4c94-4941-823b-6acb1c711c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:29.817429 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17457e9-4c94-4941-823b-6acb1c711c17 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:29.840907 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1426/2809] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:40:29 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:29.845138 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e9317-c945-4efb-9e9f-853d49ebea25 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:29.855246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e9317-c945-4efb-9e9f-853d49ebea25 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:29.860016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9978253-973b-4a79-af6e-8746f5320e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:29.860600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9978253-973b-4a79-af6e-8746f5320e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.860879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9978253-973b-4a79-af6e-8746f5320e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.861153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9978253-973b-4a79-af6e-8746f5320e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.861786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9978253-973b-4a79-af6e-8746f5320e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:29.863401 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9978253-973b-4a79-af6e-8746f5320e87 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:29.873197 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1384/2810] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:29.877932 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17457e9-4c94-4941-823b-6acb1c711c17 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:29.888101 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17457e9-4c94-4941-823b-6acb1c711c17 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:29.893328 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebac3e9-a953-488b-b9e1-76c287635ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:29.893919 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebac3e9-a953-488b-b9e1-76c287635ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.894199 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebac3e9-a953-488b-b9e1-76c287635ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.894475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebac3e9-a953-488b-b9e1-76c287635ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.895107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebac3e9-a953-488b-b9e1-76c287635ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:29.896741 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebac3e9-a953-488b-b9e1-76c287635ebb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:29.907272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1427/2811] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:29.911229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9978253-973b-4a79-af6e-8746f5320e87 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:29.921042 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9978253-973b-4a79-af6e-8746f5320e87 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:29.925842 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4659704-3a16-42a4-a3a5-77f1d92d0f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:29.926505 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659704-3a16-42a4-a3a5-77f1d92d0f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.926800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659704-3a16-42a4-a3a5-77f1d92d0f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.927075 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659704-3a16-42a4-a3a5-77f1d92d0f65 admin admin] PATH_INFO: `/v3/projects/44b0bba6cf9947b8872d6f07bb198c85/users/ea735b186d5b4a8fadc44ed34901bdf0/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.942410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4659704-3a16-42a4-a3a5-77f1d92d0f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b0bba6cf9947b8872d6f07bb198c85, user_id=ea735b186d5b4a8fadc44ed34901bdf0, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:29.945056 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4659704-3a16-42a4-a3a5-77f1d92d0f65 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:29.957801 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1385/2812] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:40:29 2022] PUT /identity/v3/projects/44b0bba6cf9947b8872d6f07bb198c85/users/ea735b186d5b4a8fadc44ed34901bdf0/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:29.969088 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8731a4-c821-47f5-b3b0-f47125145440 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:29.969367 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8731a4-c821-47f5-b3b0-f47125145440 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:29.969639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8731a4-c821-47f5-b3b0-f47125145440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:29.997665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-dd8731a4-c821-47f5-b3b0-f47125145440 None None] MFA Rules not processed for user `ea735b186d5b4a8fadc44ed34901bdf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:29.998916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-dd8731a4-c821-47f5-b3b0-f47125145440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:30.061168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1428/2813] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:30.066514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4659704-3a16-42a4-a3a5-77f1d92d0f65 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:30.079605 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:30.128157 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4659704-3a16-42a4-a3a5-77f1d92d0f65 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:30.132764 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603a6ad-18ac-45bf-bf1b-f4be810b1c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:30.133357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603a6ad-18ac-45bf-bf1b-f4be810b1c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:30.133634 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603a6ad-18ac-45bf-bf1b-f4be810b1c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:30.133906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603a6ad-18ac-45bf-bf1b-f4be810b1c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:30.134518 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603a6ad-18ac-45bf-bf1b-f4be810b1c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:30.136432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603a6ad-18ac-45bf-bf1b-f4be810b1c0f admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:30.163414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1386/2814] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:40:30 2022] POST /identity/v3/projects => generated 359 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:30.167568 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8731a4-c821-47f5-b3b0-f47125145440 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:30.178839 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8731a4-c821-47f5-b3b0-f47125145440 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:30.233883 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b05e3-9364-4bc0-ab71-b1765001fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:30.235190 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b05e3-9364-4bc0-ab71-b1765001fa8f admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:30.235469 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b05e3-9364-4bc0-ab71-b1765001fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:30.235737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b05e3-9364-4bc0-ab71-b1765001fa8f admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:30.236412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b05e3-9364-4bc0-ab71-b1765001fa8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:30.238314 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b05e3-9364-4bc0-ab71-b1765001fa8f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:30.246942 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:30.260466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1429/2815] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:40:30 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:30.264814 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603a6ad-18ac-45bf-bf1b-f4be810b1c0f admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:30.275043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603a6ad-18ac-45bf-bf1b-f4be810b1c0f admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:30.279633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999812eb-0b07-44f2-8378-e5c6596d5738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:30.280258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999812eb-0b07-44f2-8378-e5c6596d5738 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:30.280538 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999812eb-0b07-44f2-8378-e5c6596d5738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:30.280812 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999812eb-0b07-44f2-8378-e5c6596d5738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:30.281627 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999812eb-0b07-44f2-8378-e5c6596d5738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:30.283249 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999812eb-0b07-44f2-8378-e5c6596d5738 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:30.293631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1387/2816] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:30.298759 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b05e3-9364-4bc0-ab71-b1765001fa8f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:30.314534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b05e3-9364-4bc0-ab71-b1765001fa8f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:30.319417 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d85dc4-b4a6-461f-a6eb-f07bd106f068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:30.320057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85dc4-b4a6-461f-a6eb-f07bd106f068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:30.320337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85dc4-b4a6-461f-a6eb-f07bd106f068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:30.320611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85dc4-b4a6-461f-a6eb-f07bd106f068 admin admin] PATH_INFO: `/v3/projects/961859e7b3fa485d9f82b57afe444f2b/users/cefb5d61c7804069bc2fa75fa664fe5f/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:30.335299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d85dc4-b4a6-461f-a6eb-f07bd106f068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=961859e7b3fa485d9f82b57afe444f2b, user_id=cefb5d61c7804069bc2fa75fa664fe5f, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:30.337947 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d85dc4-b4a6-461f-a6eb-f07bd106f068 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:30.351045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1430/2817] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:40:30 2022] PUT /identity/v3/projects/961859e7b3fa485d9f82b57afe444f2b/users/cefb5d61c7804069bc2fa75fa664fe5f/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:30.355009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999812eb-0b07-44f2-8378-e5c6596d5738 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:30.365825 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999812eb-0b07-44f2-8378-e5c6596d5738 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:30.422995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1336a-08da-4e47-b03e-06ece64371da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:30.423584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1336a-08da-4e47-b03e-06ece64371da admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:30.423860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1336a-08da-4e47-b03e-06ece64371da admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:30.424164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1336a-08da-4e47-b03e-06ece64371da admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:30.424792 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1336a-08da-4e47-b03e-06ece64371da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:30.426365 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1336a-08da-4e47-b03e-06ece64371da admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:30.436016 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1388/2818] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:30.440392 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d85dc4-b4a6-461f-a6eb-f07bd106f068 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:30.450849 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d85dc4-b4a6-461f-a6eb-f07bd106f068 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:30.455444 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d589ccd-5090-4747-88d8-8d27b7a629cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:30.456114 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d589ccd-5090-4747-88d8-8d27b7a629cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:30.456393 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d589ccd-5090-4747-88d8-8d27b7a629cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:30.456665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d589ccd-5090-4747-88d8-8d27b7a629cb admin admin] PATH_INFO: `/v3/projects/961859e7b3fa485d9f82b57afe444f2b/users/cefb5d61c7804069bc2fa75fa664fe5f/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:30.458540 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d589ccd-5090-4747-88d8-8d27b7a629cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=961859e7b3fa485d9f82b57afe444f2b, user_id=cefb5d61c7804069bc2fa75fa664fe5f, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:30.461191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d589ccd-5090-4747-88d8-8d27b7a629cb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:30.471779 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1431/2819] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:40:30 2022] PUT /identity/v3/projects/961859e7b3fa485d9f82b57afe444f2b/users/cefb5d61c7804069bc2fa75fa664fe5f/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:30.481863 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87016-529e-430b-a2bd-30895fe2bb55 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:30.482147 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87016-529e-430b-a2bd-30895fe2bb55 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:30.482423 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d87016-529e-430b-a2bd-30895fe2bb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:30.510640 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-a7d87016-529e-430b-a2bd-30895fe2bb55 None None] MFA Rules not processed for user `cefb5d61c7804069bc2fa75fa664fe5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:30.512156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-a7d87016-529e-430b-a2bd-30895fe2bb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:30.578786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1389/2820] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:30.589826 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d589ccd-5090-4747-88d8-8d27b7a629cb admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:30.591536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-5d589ccd-5090-4747-88d8-8d27b7a629cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:30.649483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d589ccd-5090-4747-88d8-8d27b7a629cb admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:30.653105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2d959-ebdb-45fe-9895-4b13081b4376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:30.653698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2d959-ebdb-45fe-9895-4b13081b4376 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:30.653977 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2d959-ebdb-45fe-9895-4b13081b4376 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:30.654258 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2d959-ebdb-45fe-9895-4b13081b4376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:30.663705 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2d959-ebdb-45fe-9895-4b13081b4376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:30.665172 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2d959-ebdb-45fe-9895-4b13081b4376 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:30.675011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1432/2821] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:30.748610 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d87016-529e-430b-a2bd-30895fe2bb55 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:30.758631 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d87016-529e-430b-a2bd-30895fe2bb55 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:30.762525 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc893d-8078-4e5e-a178-48498f56e420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:30.763109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc893d-8078-4e5e-a178-48498f56e420 service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:30.763383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc893d-8078-4e5e-a178-48498f56e420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:30.763653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc893d-8078-4e5e-a178-48498f56e420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:30.769596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:30.822774 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc893d-8078-4e5e-a178-48498f56e420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:30.824232 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc893d-8078-4e5e-a178-48498f56e420 service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:30.834788 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1390/2822] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:33.553350 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2d959-ebdb-45fe-9895-4b13081b4376 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:33.614115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2d959-ebdb-45fe-9895-4b13081b4376 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:33.618541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:33.619150 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:33.619426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:33.619701 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] PATH_INFO: `/v3/users/ea735b186d5b4a8fadc44ed34901bdf0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:33.620829 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea735b186d5b4a8fadc44ed34901bdf0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:33.622722 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:33.672541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea735b186d5b4a8fadc44ed34901bdf0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:33.680423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea735b186d5b4a8fadc44ed34901bdf0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:33.681045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea735b186d5b4a8fadc44ed34901bdf0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:33.681643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea735b186d5b4a8fadc44ed34901bdf0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:33.686085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:33.696847 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea735b186d5b4a8fadc44ed34901bdf0'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:33.709405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1433/2823] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:40:33 2022] DELETE /identity/v3/users/ea735b186d5b4a8fadc44ed34901bdf0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:33.714079 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86da179-1693-446a-8023-6f688c4f64ae None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:33.714571 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86da179-1693-446a-8023-6f688c4f64ae None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:33.714678 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86da179-1693-446a-8023-6f688c4f64ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:33.733938 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c86da179-1693-446a-8023-6f688c4f64ae None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:33.735824 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c86da179-1693-446a-8023-6f688c4f64ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:33.793280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1391/2824] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:33.803117 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:33.804548 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:33.862764 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e1e3-7002-4c96-be26-0f329b1f1f25 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:33.866381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9116a4-770f-43a8-86ad-61ae0f50aa0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:33.866973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9116a4-770f-43a8-86ad-61ae0f50aa0c service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:33.867252 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9116a4-770f-43a8-86ad-61ae0f50aa0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:33.867522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9116a4-770f-43a8-86ad-61ae0f50aa0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:33.876583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9116a4-770f-43a8-86ad-61ae0f50aa0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:33.878015 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9116a4-770f-43a8-86ad-61ae0f50aa0c service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:33.887483 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1434/2825] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:34.154094 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86da179-1693-446a-8023-6f688c4f64ae None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:34.155532 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c86da179-1693-446a-8023-6f688c4f64ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:34.168394 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86da179-1693-446a-8023-6f688c4f64ae None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:34.173608 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:34.174430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:34.174708 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:34.174983 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] PATH_INFO: `/v3/projects/44b0bba6cf9947b8872d6f07bb198c85` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:34.176155 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b0bba6cf9947b8872d6f07bb198c85)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:34.178174 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:34.236403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b0bba6cf9947b8872d6f07bb198c85', 'request_id': 'req-7c3d1154-f2e2-4b09-bab1-517cad38959d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.242413 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b0bba6cf9947b8872d6f07bb198c85', 'request_id': 'req-7c3d1154-f2e2-4b09-bab1-517cad38959d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.249561 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b0bba6cf9947b8872d6f07bb198c85', 'request_id': 'req-7c3d1154-f2e2-4b09-bab1-517cad38959d'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.260153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] The token cache is being invalidate because project 44b0bba6cf9947b8872d6f07bb198c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:40:34.260439 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.261058 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.262772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1392/2826] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:40:34 2022] DELETE /identity/v3/projects/44b0bba6cf9947b8872d6f07bb198c85 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:34.267405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9116a4-770f-43a8-86ad-61ae0f50aa0c service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:34.276972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9116a4-770f-43a8-86ad-61ae0f50aa0c service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:34.333143 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eff57-643e-4736-95ee-4e83da9d5cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:34.333756 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eff57-643e-4736-95ee-4e83da9d5cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:34.334030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eff57-643e-4736-95ee-4e83da9d5cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:34.334299 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eff57-643e-4736-95ee-4e83da9d5cef admin admin] PATH_INFO: `/v3/users/cefb5d61c7804069bc2fa75fa664fe5f` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:34.335381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5eff57-643e-4736-95ee-4e83da9d5cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefb5d61c7804069bc2fa75fa664fe5f)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:34.337302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5eff57-643e-4736-95ee-4e83da9d5cef admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:34.382786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6a5eff57-643e-4736-95ee-4e83da9d5cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefb5d61c7804069bc2fa75fa664fe5f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.389771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6a5eff57-643e-4736-95ee-4e83da9d5cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefb5d61c7804069bc2fa75fa664fe5f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.390665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6a5eff57-643e-4736-95ee-4e83da9d5cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefb5d61c7804069bc2fa75fa664fe5f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.391267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6a5eff57-643e-4736-95ee-4e83da9d5cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefb5d61c7804069bc2fa75fa664fe5f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.403070 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6a5eff57-643e-4736-95ee-4e83da9d5cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefb5d61c7804069bc2fa75fa664fe5f'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.411209 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:34.416731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1435/2827] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:40:34 2022] DELETE /identity/v3/users/cefb5d61c7804069bc2fa75fa664fe5f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:34.687115 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:34.688784 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:34.703880 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d1154-f2e2-4b09-bab1-517cad38959d admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:34.735193 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:34.765000 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:34.766088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:34.766381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:34.766753 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] PATH_INFO: `/v3/projects/961859e7b3fa485d9f82b57afe444f2b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:34.767879 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=961859e7b3fa485d9f82b57afe444f2b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:34.769830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:34.815217 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '961859e7b3fa485d9f82b57afe444f2b', 'request_id': 'req-551dbf10-093b-4997-bcda-83e53836df04'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.821270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '961859e7b3fa485d9f82b57afe444f2b', 'request_id': 'req-551dbf10-093b-4997-bcda-83e53836df04'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.830821 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '961859e7b3fa485d9f82b57afe444f2b', 'request_id': 'req-551dbf10-093b-4997-bcda-83e53836df04'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.842744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] The token cache is being invalidate because project 961859e7b3fa485d9f82b57afe444f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:40:34.843029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.844420 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-551dbf10-093b-4997-bcda-83e53836df04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:34.845975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1393/2828] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:40:34 2022] DELETE /identity/v3/projects/961859e7b3fa485d9f82b57afe444f2b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:34.850853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b120-ccf1-4c81-b3f6-37a2587660d5 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:34.851312 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b120-ccf1-4c81-b3f6-37a2587660d5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:34.851412 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b120-ccf1-4c81-b3f6-37a2587660d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:34.870903 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-1173b120-ccf1-4c81-b3f6-37a2587660d5 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:34.872110 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1173b120-ccf1-4c81-b3f6-37a2587660d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:34.929218 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1436/2829] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:34.939316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ac0c-b01e-4d70-b9d7-9c3d293fa72a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:34.939595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ac0c-b01e-4d70-b9d7-9c3d293fa72a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:34.939892 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ac0c-b01e-4d70-b9d7-9c3d293fa72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:34.960918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1352ac0c-b01e-4d70-b9d7-9c3d293fa72a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:34.962130 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1352ac0c-b01e-4d70-b9d7-9c3d293fa72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:34.970308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1394/2830] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:34.974587 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173b120-ccf1-4c81-b3f6-37a2587660d5 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:34.984174 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173b120-ccf1-4c81-b3f6-37a2587660d5 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:34.988712 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adb0bc-63cb-4ef3-8342-90fdaea88894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:34.989296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adb0bc-63cb-4ef3-8342-90fdaea88894 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:34.989572 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adb0bc-63cb-4ef3-8342-90fdaea88894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:34.989844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adb0bc-63cb-4ef3-8342-90fdaea88894 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:34.990474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11adb0bc-63cb-4ef3-8342-90fdaea88894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:40:34.990771 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11adb0bc-63cb-4ef3-8342-90fdaea88894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:34.992396 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11adb0bc-63cb-4ef3-8342-90fdaea88894 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.004069 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1437/2831] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:40:35.008122 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352ac0c-b01e-4d70-b9d7-9c3d293fa72a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.018308 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352ac0c-b01e-4d70-b9d7-9c3d293fa72a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.022794 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58a86-a4d8-4e61-b8e1-1ff2f7122b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.023367 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58a86-a4d8-4e61-b8e1-1ff2f7122b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.023639 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58a86-a4d8-4e61-b8e1-1ff2f7122b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.023928 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58a86-a4d8-4e61-b8e1-1ff2f7122b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.024548 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda58a86-a4d8-4e61-b8e1-1ff2f7122b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.026407 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda58a86-a4d8-4e61-b8e1-1ff2f7122b37 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.052596 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1395/2832] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:40:35 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:35.056841 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adb0bc-63cb-4ef3-8342-90fdaea88894 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.067152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adb0bc-63cb-4ef3-8342-90fdaea88894 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.121889 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb672a05-13c4-4b2c-a29a-3e8abf22b377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.122478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672a05-13c4-4b2c-a29a-3e8abf22b377 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.122756 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672a05-13c4-4b2c-a29a-3e8abf22b377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.123035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672a05-13c4-4b2c-a29a-3e8abf22b377 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.123647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb672a05-13c4-4b2c-a29a-3e8abf22b377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.126242 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb672a05-13c4-4b2c-a29a-3e8abf22b377 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.147574 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1438/2833] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:40:35 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:35.151746 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58a86-a4d8-4e61-b8e1-1ff2f7122b37 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.161964 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58a86-a4d8-4e61-b8e1-1ff2f7122b37 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.166526 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb63d4b-d95d-4325-85da-a76f9e423f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.167109 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb63d4b-d95d-4325-85da-a76f9e423f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.167386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb63d4b-d95d-4325-85da-a76f9e423f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.167659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb63d4b-d95d-4325-85da-a76f9e423f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.168326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb63d4b-d95d-4325-85da-a76f9e423f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.169902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb63d4b-d95d-4325-85da-a76f9e423f70 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.179831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1396/2834] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:35.183652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb672a05-13c4-4b2c-a29a-3e8abf22b377 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.194132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb672a05-13c4-4b2c-a29a-3e8abf22b377 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.198732 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b729a-7236-4e4e-b756-2b96a0f4a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.199316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b729a-7236-4e4e-b756-2b96a0f4a487 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.199596 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b729a-7236-4e4e-b756-2b96a0f4a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.199871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b729a-7236-4e4e-b756-2b96a0f4a487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.200554 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b729a-7236-4e4e-b756-2b96a0f4a487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.202140 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b729a-7236-4e4e-b756-2b96a0f4a487 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.213197 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1439/2835] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:35.217333 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb63d4b-d95d-4325-85da-a76f9e423f70 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.227653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb63d4b-d95d-4325-85da-a76f9e423f70 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.232265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4813d49-8ffc-4f2c-b32a-a6f221535619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.232904 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4813d49-8ffc-4f2c-b32a-a6f221535619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.233182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4813d49-8ffc-4f2c-b32a-a6f221535619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.233456 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4813d49-8ffc-4f2c-b32a-a6f221535619 admin admin] PATH_INFO: `/v3/projects/d63b88c6ac5449608c2b23dce7a1fccc/users/b02a34e43db74b359b8de9279e1dfd3b/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.248226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4813d49-8ffc-4f2c-b32a-a6f221535619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63b88c6ac5449608c2b23dce7a1fccc, user_id=b02a34e43db74b359b8de9279e1dfd3b, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.251463 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4813d49-8ffc-4f2c-b32a-a6f221535619 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.264287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1397/2836] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:40:35 2022] PUT /identity/v3/projects/d63b88c6ac5449608c2b23dce7a1fccc/users/b02a34e43db74b359b8de9279e1dfd3b/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:35.274795 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815914-b210-4c37-a72b-63f848c1a71f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.275099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815914-b210-4c37-a72b-63f848c1a71f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.275386 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815914-b210-4c37-a72b-63f848c1a71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.302990 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-e6815914-b210-4c37-a72b-63f848c1a71f None None] MFA Rules not processed for user `b02a34e43db74b359b8de9279e1dfd3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:35.304238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-e6815914-b210-4c37-a72b-63f848c1a71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:35.357426 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:35.369219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1440/2837] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:35.373690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4813d49-8ffc-4f2c-b32a-a6f221535619 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.430192 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:35.434702 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4813d49-8ffc-4f2c-b32a-a6f221535619 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.441809 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26918e92-f978-411c-9830-71b03c33b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.442555 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26918e92-f978-411c-9830-71b03c33b4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.442839 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26918e92-f978-411c-9830-71b03c33b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.443114 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26918e92-f978-411c-9830-71b03c33b4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.443748 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26918e92-f978-411c-9830-71b03c33b4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.445694 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26918e92-f978-411c-9830-71b03c33b4a1 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.473346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1398/2838] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:40:35 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:40:35.477438 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6815914-b210-4c37-a72b-63f848c1a71f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.488814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6815914-b210-4c37-a72b-63f848c1a71f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.543723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef87e8-3e7a-4c6e-8751-b959e8318d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.544283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef87e8-3e7a-4c6e-8751-b959e8318d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.544566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef87e8-3e7a-4c6e-8751-b959e8318d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.544848 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef87e8-3e7a-4c6e-8751-b959e8318d5a admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.545473 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef87e8-3e7a-4c6e-8751-b959e8318d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.547878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef87e8-3e7a-4c6e-8751-b959e8318d5a admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.568887 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1441/2839] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:40:35 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:35.573092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26918e92-f978-411c-9830-71b03c33b4a1 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.583259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26918e92-f978-411c-9830-71b03c33b4a1 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.587878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05274ae8-0b7a-4388-abb8-39c0263476cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.588500 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274ae8-0b7a-4388-abb8-39c0263476cf admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.588778 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274ae8-0b7a-4388-abb8-39c0263476cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.589050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274ae8-0b7a-4388-abb8-39c0263476cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.589683 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05274ae8-0b7a-4388-abb8-39c0263476cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.591295 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05274ae8-0b7a-4388-abb8-39c0263476cf admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.602326 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1399/2840] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:35.606355 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef87e8-3e7a-4c6e-8751-b959e8318d5a admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.617219 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef87e8-3e7a-4c6e-8751-b959e8318d5a admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.621820 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dee11-b33f-4914-a6ac-37c673abe2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.622459 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dee11-b33f-4914-a6ac-37c673abe2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.622739 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dee11-b33f-4914-a6ac-37c673abe2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.623017 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dee11-b33f-4914-a6ac-37c673abe2a0 admin admin] PATH_INFO: `/v3/projects/1add9210edc344459945e7fe984ffe29/users/6766118956c24d128ffe663d5fcfd8e7/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.637906 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26dee11-b33f-4914-a6ac-37c673abe2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1add9210edc344459945e7fe984ffe29, user_id=6766118956c24d128ffe663d5fcfd8e7, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.640712 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26dee11-b33f-4914-a6ac-37c673abe2a0 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.653434 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1442/2841] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:40:35 2022] PUT /identity/v3/projects/1add9210edc344459945e7fe984ffe29/users/6766118956c24d128ffe663d5fcfd8e7/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:35.658549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05274ae8-0b7a-4388-abb8-39c0263476cf admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.669389 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05274ae8-0b7a-4388-abb8-39c0263476cf admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.726129 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411d469-5131-49d0-88ef-502b14570531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.726725 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d469-5131-49d0-88ef-502b14570531 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.727001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d469-5131-49d0-88ef-502b14570531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.727274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d469-5131-49d0-88ef-502b14570531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.727929 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411d469-5131-49d0-88ef-502b14570531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.729501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411d469-5131-49d0-88ef-502b14570531 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.740007 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1400/2842] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:35.744363 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dee11-b33f-4914-a6ac-37c673abe2a0 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.754720 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dee11-b33f-4914-a6ac-37c673abe2a0 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.759261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec53d0c-24af-4df1-9e85-b1cf24cbbc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.759897 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53d0c-24af-4df1-9e85-b1cf24cbbc4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.760200 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53d0c-24af-4df1-9e85-b1cf24cbbc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.760474 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53d0c-24af-4df1-9e85-b1cf24cbbc4d admin admin] PATH_INFO: `/v3/projects/1add9210edc344459945e7fe984ffe29/users/6766118956c24d128ffe663d5fcfd8e7/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.762612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec53d0c-24af-4df1-9e85-b1cf24cbbc4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1add9210edc344459945e7fe984ffe29, user_id=6766118956c24d128ffe663d5fcfd8e7, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.765343 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec53d0c-24af-4df1-9e85-b1cf24cbbc4d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.775624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1443/2843] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:40:35 2022] PUT /identity/v3/projects/1add9210edc344459945e7fe984ffe29/users/6766118956c24d128ffe663d5fcfd8e7/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:35.786366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1c96-ef0b-4dea-a68e-67e5fab9b6c2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.786659 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1c96-ef0b-4dea-a68e-67e5fab9b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.786969 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f1c96-ef0b-4dea-a68e-67e5fab9b6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.817099 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-731f1c96-ef0b-4dea-a68e-67e5fab9b6c2 None None] MFA Rules not processed for user `6766118956c24d128ffe663d5fcfd8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:35.818270 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-731f1c96-ef0b-4dea-a68e-67e5fab9b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:35.888288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1401/2844] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:35.899085 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec53d0c-24af-4df1-9e85-b1cf24cbbc4d admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:35.900922 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-1ec53d0c-24af-4df1-9e85-b1cf24cbbc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:35.957644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec53d0c-24af-4df1-9e85-b1cf24cbbc4d admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:35.961405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a3fa0-fb2d-4c90-a32c-1046138405a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:35.961998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3fa0-fb2d-4c90-a32c-1046138405a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:35.962277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3fa0-fb2d-4c90-a32c-1046138405a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:35.962552 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3fa0-fb2d-4c90-a32c-1046138405a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:35.972188 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a3fa0-fb2d-4c90-a32c-1046138405a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:35.973652 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a3fa0-fb2d-4c90-a32c-1046138405a4 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:35.982951 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1444/2845] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:36.028912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f1c96-ef0b-4dea-a68e-67e5fab9b6c2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:36.030294 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-731f1c96-ef0b-4dea-a68e-67e5fab9b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:36.042677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f1c96-ef0b-4dea-a68e-67e5fab9b6c2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:36.046312 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709541de-23ca-4998-9298-806a0f17915a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:36.046921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709541de-23ca-4998-9298-806a0f17915a service cinder] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:36.047184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709541de-23ca-4998-9298-806a0f17915a service cinder] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:36.047459 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709541de-23ca-4998-9298-806a0f17915a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:36.095067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:36.104806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709541de-23ca-4998-9298-806a0f17915a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:36.106228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709541de-23ca-4998-9298-806a0f17915a service cinder] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:36.115387 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1402/2846] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:39.386647 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a3fa0-fb2d-4c90-a32c-1046138405a4 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:39.438899 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:39.454344 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a3fa0-fb2d-4c90-a32c-1046138405a4 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:39.458813 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:39.459430 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:39.459708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:39.460009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] PATH_INFO: `/v3/users/b02a34e43db74b359b8de9279e1dfd3b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:39.461111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02a34e43db74b359b8de9279e1dfd3b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:39.463023 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:39.506665 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02a34e43db74b359b8de9279e1dfd3b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:39.513278 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02a34e43db74b359b8de9279e1dfd3b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:39.513868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02a34e43db74b359b8de9279e1dfd3b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:39.514497 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02a34e43db74b359b8de9279e1dfd3b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:39.527077 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02a34e43db74b359b8de9279e1dfd3b'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:39.539376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1445/2847] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:40:39 2022] DELETE /identity/v3/users/b02a34e43db74b359b8de9279e1dfd3b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:39.544006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660bc41-0476-493c-8413-0ef8d396701c None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:39.544490 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660bc41-0476-493c-8413-0ef8d396701c None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:39.544600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660bc41-0476-493c-8413-0ef8d396701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:39.564050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-b660bc41-0476-493c-8413-0ef8d396701c None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:39.565276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b660bc41-0476-493c-8413-0ef8d396701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:39.622890 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1403/2848] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:39.633529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:39.634853 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:39.692528 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b33ad-fe72-4e61-8802-c6302b49c278 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:39.696076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c5ba6-5c3c-4193-9980-7207254c82a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:39.696667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5ba6-5c3c-4193-9980-7207254c82a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:39.696941 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5ba6-5c3c-4193-9980-7207254c82a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:39.697210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5ba6-5c3c-4193-9980-7207254c82a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:39.707130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c5ba6-5c3c-4193-9980-7207254c82a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:39.708599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c5ba6-5c3c-4193-9980-7207254c82a8 service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:39.717768 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1446/2849] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:39.989562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660bc41-0476-493c-8413-0ef8d396701c None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:39.991030 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-b660bc41-0476-493c-8413-0ef8d396701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:40.003024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660bc41-0476-493c-8413-0ef8d396701c None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:40.007691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:40.008358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:40.008629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:40.008902 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] PATH_INFO: `/v3/projects/d63b88c6ac5449608c2b23dce7a1fccc` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:40.010013 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63b88c6ac5449608c2b23dce7a1fccc)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:40.012316 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:40.058980 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63b88c6ac5449608c2b23dce7a1fccc', 'request_id': 'req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.065024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63b88c6ac5449608c2b23dce7a1fccc', 'request_id': 'req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.072246 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63b88c6ac5449608c2b23dce7a1fccc', 'request_id': 'req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.083027 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] The token cache is being invalidate because project d63b88c6ac5449608c2b23dce7a1fccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:40:40.083317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.083972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.085442 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1404/2850] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:40:39 2022] DELETE /identity/v3/projects/d63b88c6ac5449608c2b23dce7a1fccc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:40.089403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c5ba6-5c3c-4193-9980-7207254c82a8 service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:40.099686 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c5ba6-5c3c-4193-9980-7207254c82a8 service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:40.155161 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca68ad7-7207-4769-a86e-d85f46dbb726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:40.155774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca68ad7-7207-4769-a86e-d85f46dbb726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:40.156074 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca68ad7-7207-4769-a86e-d85f46dbb726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:40.156442 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca68ad7-7207-4769-a86e-d85f46dbb726 admin admin] PATH_INFO: `/v3/users/6766118956c24d128ffe663d5fcfd8e7` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:40.157848 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca68ad7-7207-4769-a86e-d85f46dbb726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6766118956c24d128ffe663d5fcfd8e7)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:40.159756 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca68ad7-7207-4769-a86e-d85f46dbb726 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:40.173698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:40.207602 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6ca68ad7-7207-4769-a86e-d85f46dbb726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6766118956c24d128ffe663d5fcfd8e7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.214030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6ca68ad7-7207-4769-a86e-d85f46dbb726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6766118956c24d128ffe663d5fcfd8e7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.214663 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6ca68ad7-7207-4769-a86e-d85f46dbb726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6766118956c24d128ffe663d5fcfd8e7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.215268 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6ca68ad7-7207-4769-a86e-d85f46dbb726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6766118956c24d128ffe663d5fcfd8e7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.226767 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-6ca68ad7-7207-4769-a86e-d85f46dbb726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6766118956c24d128ffe663d5fcfd8e7'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.238561 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1447/2851] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:40:40 2022] DELETE /identity/v3/users/6766118956c24d128ffe663d5fcfd8e7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:40.507342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:40.509083 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:40.524942 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01b409-1a5d-4a5c-b458-78cff0afc7e0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:40.581560 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:40.582210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:40.582437 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:40.582707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] PATH_INFO: `/v3/projects/1add9210edc344459945e7fe984ffe29` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:40.583791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1add9210edc344459945e7fe984ffe29)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:40.585695 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:40.602343 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:40.632483 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1add9210edc344459945e7fe984ffe29', 'request_id': 'req-901ecb7f-537d-4a76-8bda-566dde9b7de8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.638731 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1add9210edc344459945e7fe984ffe29', 'request_id': 'req-901ecb7f-537d-4a76-8bda-566dde9b7de8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.646556 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1add9210edc344459945e7fe984ffe29', 'request_id': 'req-901ecb7f-537d-4a76-8bda-566dde9b7de8'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.657540 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] The token cache is being invalidate because project 1add9210edc344459945e7fe984ffe29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:40:40.657827 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.658453 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-901ecb7f-537d-4a76-8bda-566dde9b7de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:40.659947 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1405/2852] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:40:40 2022] DELETE /identity/v3/projects/1add9210edc344459945e7fe984ffe29 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:40.664928 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9bb54-61a4-4e90-bc90-fe596e43702e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:40.665648 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9bb54-61a4-4e90-bc90-fe596e43702e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:40.665896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9bb54-61a4-4e90-bc90-fe596e43702e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:40.685489 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b9e9bb54-61a4-4e90-bc90-fe596e43702e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:40.686611 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b9e9bb54-61a4-4e90-bc90-fe596e43702e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:40.746297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1448/2853] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:40.754025 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e02b58-6979-4870-b0f8-295497cb47e2 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:40.754309 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e02b58-6979-4870-b0f8-295497cb47e2 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:40.754612 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e02b58-6979-4870-b0f8-295497cb47e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:40.774996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-e1e02b58-6979-4870-b0f8-295497cb47e2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:40.776205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-e1e02b58-6979-4870-b0f8-295497cb47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:40.784620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1406/2854] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:40.789050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9bb54-61a4-4e90-bc90-fe596e43702e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:40.799054 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9bb54-61a4-4e90-bc90-fe596e43702e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:40.803558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e76b5b-7a30-44ca-b511-746ee9072909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:40.804177 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76b5b-7a30-44ca-b511-746ee9072909 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:40.804455 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76b5b-7a30-44ca-b511-746ee9072909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:40.804723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76b5b-7a30-44ca-b511-746ee9072909 admin admin] PATH_INFO: `/v3/domains` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:40.805350 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e76b5b-7a30-44ca-b511-746ee9072909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:40:40.805646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e76b5b-7a30-44ca-b511-746ee9072909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:40.807223 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e76b5b-7a30-44ca-b511-746ee9072909 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:40.819006 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1449/2855] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:40:40.823149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e02b58-6979-4870-b0f8-295497cb47e2 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:40.833529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e02b58-6979-4870-b0f8-295497cb47e2 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:40.838090 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886bac7-d2fb-41cc-aaf6-561e1f2ca9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:40.838679 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886bac7-d2fb-41cc-aaf6-561e1f2ca9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:40.838949 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886bac7-d2fb-41cc-aaf6-561e1f2ca9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:40.839218 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886bac7-d2fb-41cc-aaf6-561e1f2ca9f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:40.839845 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886bac7-d2fb-41cc-aaf6-561e1f2ca9f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:40.841786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886bac7-d2fb-41cc-aaf6-561e1f2ca9f0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:40.870032 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1407/2856] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:40:40 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:40.874206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e76b5b-7a30-44ca-b511-746ee9072909 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:40.885062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e76b5b-7a30-44ca-b511-746ee9072909 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:40.941225 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f828da-571f-48c8-8c7c-54b62fbbb70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:40.941729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f828da-571f-48c8-8c7c-54b62fbbb70f admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:40.942005 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f828da-571f-48c8-8c7c-54b62fbbb70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:40.942277 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f828da-571f-48c8-8c7c-54b62fbbb70f admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:40.942899 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f828da-571f-48c8-8c7c-54b62fbbb70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:40.945536 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f828da-571f-48c8-8c7c-54b62fbbb70f admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:40.966878 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1450/2857] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:40:40 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:40.971522 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886bac7-d2fb-41cc-aaf6-561e1f2ca9f0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:40.981799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886bac7-d2fb-41cc-aaf6-561e1f2ca9f0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:40.986433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10622dea-01a6-452e-8172-0604e7b49d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:40.987019 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10622dea-01a6-452e-8172-0604e7b49d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:40.987298 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10622dea-01a6-452e-8172-0604e7b49d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:40.987571 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10622dea-01a6-452e-8172-0604e7b49d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:40.988234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10622dea-01a6-452e-8172-0604e7b49d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:40.989898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10622dea-01a6-452e-8172-0604e7b49d1a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:40.999576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1408/2858] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:41.004789 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f828da-571f-48c8-8c7c-54b62fbbb70f admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:41.014781 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f828da-571f-48c8-8c7c-54b62fbbb70f admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:41.020059 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe74275-342d-40a4-bc8d-8d20c9984eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:41.020641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74275-342d-40a4-bc8d-8d20c9984eec admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:41.020916 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74275-342d-40a4-bc8d-8d20c9984eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:41.021185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe74275-342d-40a4-bc8d-8d20c9984eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:41.021809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe74275-342d-40a4-bc8d-8d20c9984eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:41.023376 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe74275-342d-40a4-bc8d-8d20c9984eec admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:41.024624 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:41.038486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1451/2859] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:41.039661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10622dea-01a6-452e-8172-0604e7b49d1a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:41.049860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10622dea-01a6-452e-8172-0604e7b49d1a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:41.054399 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c53b4-3440-4ead-abc7-4c3d0670fe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:41.055051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c53b4-3440-4ead-abc7-4c3d0670fe3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:41.055330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c53b4-3440-4ead-abc7-4c3d0670fe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:41.055602 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c53b4-3440-4ead-abc7-4c3d0670fe3a admin admin] PATH_INFO: `/v3/projects/ef172f1029f54db6a66d4e0394049e8b/users/9afb97949c9342ba8ade26e660e7aea6/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:41.070563 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c53b4-3440-4ead-abc7-4c3d0670fe3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef172f1029f54db6a66d4e0394049e8b, user_id=9afb97949c9342ba8ade26e660e7aea6, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:41.073229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c53b4-3440-4ead-abc7-4c3d0670fe3a admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:41.086128 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1409/2860] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:40:41 2022] PUT /identity/v3/projects/ef172f1029f54db6a66d4e0394049e8b/users/9afb97949c9342ba8ade26e660e7aea6/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:41.096706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6c354-f5dd-42a3-988d-ff74d159af6e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:41.097009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6c354-f5dd-42a3-988d-ff74d159af6e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:41.097281 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6c354-f5dd-42a3-988d-ff74d159af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:41.124266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-bcc6c354-f5dd-42a3-988d-ff74d159af6e None None] MFA Rules not processed for user `9afb97949c9342ba8ade26e660e7aea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:41.126231 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-bcc6c354-f5dd-42a3-988d-ff74d159af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:41.188129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1452/2861] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:41.193038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c53b4-3440-4ead-abc7-4c3d0670fe3a admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:41.256462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c53b4-3440-4ead-abc7-4c3d0670fe3a admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:41.261047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc0b4c-5905-4dbc-abf4-9b2a12fa20e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:41.261637 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc0b4c-5905-4dbc-abf4-9b2a12fa20e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:41.261918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc0b4c-5905-4dbc-abf4-9b2a12fa20e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:41.262189 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc0b4c-5905-4dbc-abf4-9b2a12fa20e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:41.263067 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc0b4c-5905-4dbc-abf4-9b2a12fa20e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:41.264968 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc0b4c-5905-4dbc-abf4-9b2a12fa20e0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:41.290015 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1410/2862] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:40:41 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:41.294132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6c354-f5dd-42a3-988d-ff74d159af6e None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:41.305643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6c354-f5dd-42a3-988d-ff74d159af6e None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:41.361189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c287fde-3fc0-42fa-93d9-36ef2fabba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:41.361788 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c287fde-3fc0-42fa-93d9-36ef2fabba62 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:41.362067 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c287fde-3fc0-42fa-93d9-36ef2fabba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:41.362340 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c287fde-3fc0-42fa-93d9-36ef2fabba62 admin admin] PATH_INFO: `/v3/users` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:41.362954 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c287fde-3fc0-42fa-93d9-36ef2fabba62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:41.364899 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c287fde-3fc0-42fa-93d9-36ef2fabba62 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:41.386717 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1453/2863] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:40:41 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:41.391080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc0b4c-5905-4dbc-abf4-9b2a12fa20e0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:41.401224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc0b4c-5905-4dbc-abf4-9b2a12fa20e0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:41.405745 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a69a9d-9041-4e52-8703-f815663760c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:41.406377 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a69a9d-9041-4e52-8703-f815663760c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:41.406856 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a69a9d-9041-4e52-8703-f815663760c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:41.407274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a69a9d-9041-4e52-8703-f815663760c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:41.407926 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a69a9d-9041-4e52-8703-f815663760c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:41.409513 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a69a9d-9041-4e52-8703-f815663760c7 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:41.420813 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1411/2864] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:41.425466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c287fde-3fc0-42fa-93d9-36ef2fabba62 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:41.435283 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c287fde-3fc0-42fa-93d9-36ef2fabba62 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:41.440687 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e356b-22b4-4b3d-a403-f22c78dbca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:41.441321 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e356b-22b4-4b3d-a403-f22c78dbca41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:41.441599 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e356b-22b4-4b3d-a403-f22c78dbca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:41.441871 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e356b-22b4-4b3d-a403-f22c78dbca41 admin admin] PATH_INFO: `/v3/projects/9a9cc723689a4a6ab87c251f2b94d5b8/users/3d3035a5ec2a45bf94b8b35b065d7291/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:41.457491 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e356b-22b4-4b3d-a403-f22c78dbca41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9cc723689a4a6ab87c251f2b94d5b8, user_id=3d3035a5ec2a45bf94b8b35b065d7291, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:41.460062 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e356b-22b4-4b3d-a403-f22c78dbca41 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:41.473081 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1454/2865] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:40:41 2022] PUT /identity/v3/projects/9a9cc723689a4a6ab87c251f2b94d5b8/users/3d3035a5ec2a45bf94b8b35b065d7291/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:41.476996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a69a9d-9041-4e52-8703-f815663760c7 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:41.487418 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a69a9d-9041-4e52-8703-f815663760c7 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:41.498906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:41.546759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329dde0-f03d-4545-beda-336254dc63b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:41.547862 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329dde0-f03d-4545-beda-336254dc63b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:41.548164 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329dde0-f03d-4545-beda-336254dc63b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:41.548430 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329dde0-f03d-4545-beda-336254dc63b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:41.549077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329dde0-f03d-4545-beda-336254dc63b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:41.550650 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329dde0-f03d-4545-beda-336254dc63b4 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:41.560065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1412/2866] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:41.564805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e356b-22b4-4b3d-a403-f22c78dbca41 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:41.574709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e356b-22b4-4b3d-a403-f22c78dbca41 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:41.579612 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29c308-c2f1-4a24-8396-e2581a176021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:41.580275 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c308-c2f1-4a24-8396-e2581a176021 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:41.580549 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c308-c2f1-4a24-8396-e2581a176021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:41.580818 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c308-c2f1-4a24-8396-e2581a176021 admin admin] PATH_INFO: `/v3/projects/9a9cc723689a4a6ab87c251f2b94d5b8/users/3d3035a5ec2a45bf94b8b35b065d7291/roles/4494ba66c3f649febc69511a47e27b67` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:41.582700 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29c308-c2f1-4a24-8396-e2581a176021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9cc723689a4a6ab87c251f2b94d5b8, user_id=3d3035a5ec2a45bf94b8b35b065d7291, role_id=4494ba66c3f649febc69511a47e27b67)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:41.585322 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29c308-c2f1-4a24-8396-e2581a176021 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:41.596136 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1455/2867] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:40:41 2022] PUT /identity/v3/projects/9a9cc723689a4a6ab87c251f2b94d5b8/users/3d3035a5ec2a45bf94b8b35b065d7291/roles/4494ba66c3f649febc69511a47e27b67 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:41.661332 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1dc5e-cc5f-4188-80ac-96084b9f3ea3 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:41.661916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1dc5e-cc5f-4188-80ac-96084b9f3ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:41.661916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1dc5e-cc5f-4188-80ac-96084b9f3ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:41.689597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-56b1dc5e-cc5f-4188-80ac-96084b9f3ea3 None None] MFA Rules not processed for user `3d3035a5ec2a45bf94b8b35b065d7291`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:41.691238 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-56b1dc5e-cc5f-4188-80ac-96084b9f3ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:41.759081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1413/2868] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:41.770152 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29c308-c2f1-4a24-8396-e2581a176021 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:41.771959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ea29c308-c2f1-4a24-8396-e2581a176021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:41.813754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:41.830997 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29c308-c2f1-4a24-8396-e2581a176021 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:41.834127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dc019-efba-4305-8d3e-72c1cc49abee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:41.834724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dc019-efba-4305-8d3e-72c1cc49abee service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:41.834995 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dc019-efba-4305-8d3e-72c1cc49abee service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:41.835262 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dc019-efba-4305-8d3e-72c1cc49abee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:41.844840 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dc019-efba-4305-8d3e-72c1cc49abee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:41.846248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dc019-efba-4305-8d3e-72c1cc49abee service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:41.855808 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1456/2869] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:41.990761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1dc5e-cc5f-4188-80ac-96084b9f3ea3 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:42.051811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1dc5e-cc5f-4188-80ac-96084b9f3ea3 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:42.056217 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:42.056829 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:42.057110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:42.057398 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] PATH_INFO: `/v3/users/9afb97949c9342ba8ade26e660e7aea6` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:42.058476 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afb97949c9342ba8ade26e660e7aea6)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:42.060393 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:42.100651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:42.107674 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afb97949c9342ba8ade26e660e7aea6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.114979 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afb97949c9342ba8ade26e660e7aea6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.115576 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afb97949c9342ba8ade26e660e7aea6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.116182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afb97949c9342ba8ade26e660e7aea6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.123024 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afb97949c9342ba8ade26e660e7aea6'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.140274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1414/2870] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:40:41 2022] DELETE /identity/v3/users/9afb97949c9342ba8ade26e660e7aea6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:42.145537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fddc2d-72b2-45f8-84cb-ee19145e5e07 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:42.145814 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fddc2d-72b2-45f8-84cb-ee19145e5e07 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:42.146079 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fddc2d-72b2-45f8-84cb-ee19145e5e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:42.165028 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-32fddc2d-72b2-45f8-84cb-ee19145e5e07 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:42.166206 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-32fddc2d-72b2-45f8-84cb-ee19145e5e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:42.223113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1457/2871] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:42.232987 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:42.234896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:42.291707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d7ab-2de2-4d94-9e12-11d20c7b4f30 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:42.295374 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d3b26-96ab-42dc-8b0d-2ffbcbc6405d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:42.296065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d3b26-96ab-42dc-8b0d-2ffbcbc6405d service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:42.296347 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d3b26-96ab-42dc-8b0d-2ffbcbc6405d service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:42.296620 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d3b26-96ab-42dc-8b0d-2ffbcbc6405d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:42.306577 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d3b26-96ab-42dc-8b0d-2ffbcbc6405d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:42.307960 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d3b26-96ab-42dc-8b0d-2ffbcbc6405d service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:42.318226 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1415/2872] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:42.584338 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fddc2d-72b2-45f8-84cb-ee19145e5e07 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:42.585803 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-32fddc2d-72b2-45f8-84cb-ee19145e5e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:42.599228 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fddc2d-72b2-45f8-84cb-ee19145e5e07 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:42.603973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:42.604778 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:42.605121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:42.605467 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] PATH_INFO: `/v3/projects/ef172f1029f54db6a66d4e0394049e8b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:42.606724 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef172f1029f54db6a66d4e0394049e8b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:42.608920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:42.657067 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef172f1029f54db6a66d4e0394049e8b', 'request_id': 'req-3ccdd393-3e56-4ff9-8431-c17de7cfd928'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.663351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef172f1029f54db6a66d4e0394049e8b', 'request_id': 'req-3ccdd393-3e56-4ff9-8431-c17de7cfd928'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.670696 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef172f1029f54db6a66d4e0394049e8b', 'request_id': 'req-3ccdd393-3e56-4ff9-8431-c17de7cfd928'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.681775 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] The token cache is being invalidate because project ef172f1029f54db6a66d4e0394049e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:40:42.682056 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.682662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.684141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1458/2873] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:40:42 2022] DELETE /identity/v3/projects/ef172f1029f54db6a66d4e0394049e8b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:42.688996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d3b26-96ab-42dc-8b0d-2ffbcbc6405d service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:42.698497 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d3b26-96ab-42dc-8b0d-2ffbcbc6405d service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:42.755727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832ecb2-1ed7-4c99-b037-67c89f2d36e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:42.756366 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832ecb2-1ed7-4c99-b037-67c89f2d36e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:42.756647 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832ecb2-1ed7-4c99-b037-67c89f2d36e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:42.756915 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832ecb2-1ed7-4c99-b037-67c89f2d36e0 admin admin] PATH_INFO: `/v3/users/3d3035a5ec2a45bf94b8b35b065d7291` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:42.758002 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832ecb2-1ed7-4c99-b037-67c89f2d36e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3035a5ec2a45bf94b8b35b065d7291)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:42.759921 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832ecb2-1ed7-4c99-b037-67c89f2d36e0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:42.805738 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1832ecb2-1ed7-4c99-b037-67c89f2d36e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3035a5ec2a45bf94b8b35b065d7291'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.814009 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1832ecb2-1ed7-4c99-b037-67c89f2d36e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3035a5ec2a45bf94b8b35b065d7291'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.814638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1832ecb2-1ed7-4c99-b037-67c89f2d36e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3035a5ec2a45bf94b8b35b065d7291'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.815253 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1832ecb2-1ed7-4c99-b037-67c89f2d36e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3035a5ec2a45bf94b8b35b065d7291'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.820589 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:42.823041 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-1832ecb2-1ed7-4c99-b037-67c89f2d36e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3035a5ec2a45bf94b8b35b065d7291'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:42.846202 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1416/2874] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:40:42 2022] DELETE /identity/v3/users/3d3035a5ec2a45bf94b8b35b065d7291 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:43.123205 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:43.124694 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:43.138589 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdd393-3e56-4ff9-8431-c17de7cfd928 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:43.194547 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:43.195168 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:43.195441 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:43.195736 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] PATH_INFO: `/v3/projects/9a9cc723689a4a6ab87c251f2b94d5b8` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:43.196869 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9cc723689a4a6ab87c251f2b94d5b8)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:43.198723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:43.205644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:43.245402 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9cc723689a4a6ab87c251f2b94d5b8', 'request_id': 'req-ea9c0ed0-091d-45a1-a6c6-375f3816583e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:43.251989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9cc723689a4a6ab87c251f2b94d5b8', 'request_id': 'req-ea9c0ed0-091d-45a1-a6c6-375f3816583e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:43.259247 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9cc723689a4a6ab87c251f2b94d5b8', 'request_id': 'req-ea9c0ed0-091d-45a1-a6c6-375f3816583e'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:43.270454 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] The token cache is being invalidate because project 9a9cc723689a4a6ab87c251f2b94d5b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:40:43.270765 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:43.271384 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-ea9c0ed0-091d-45a1-a6c6-375f3816583e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:43.272872 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1459/2875] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:40:43 2022] DELETE /identity/v3/projects/9a9cc723689a4a6ab87c251f2b94d5b8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:43.277632 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02b408-740f-4484-b50a-be2cf1ae4435 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:43.277912 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02b408-740f-4484-b50a-be2cf1ae4435 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:43.278182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02b408-740f-4484-b50a-be2cf1ae4435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:43.297385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1b02b408-740f-4484-b50a-be2cf1ae4435 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:43.298619 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1b02b408-740f-4484-b50a-be2cf1ae4435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:43.357044 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1417/2876] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:43.364637 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0d17e-1fe4-4f1e-871f-33e6765fbab5 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:43.364920 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0d17e-1fe4-4f1e-871f-33e6765fbab5 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:43.365193 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0d17e-1fe4-4f1e-871f-33e6765fbab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:43.385196 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9aa0d17e-1fe4-4f1e-871f-33e6765fbab5 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:43.386413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9aa0d17e-1fe4-4f1e-871f-33e6765fbab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:43.396915 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1460/2877] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:43.401105 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02b408-740f-4484-b50a-be2cf1ae4435 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:43.410957 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02b408-740f-4484-b50a-be2cf1ae4435 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:43.416038 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61427705-41fe-4a44-8004-795f43550500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:43.416633 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61427705-41fe-4a44-8004-795f43550500 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:43.416914 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61427705-41fe-4a44-8004-795f43550500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:43.417190 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61427705-41fe-4a44-8004-795f43550500 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:43.417864 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61427705-41fe-4a44-8004-795f43550500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:40:43.418173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61427705-41fe-4a44-8004-795f43550500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:43.419830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61427705-41fe-4a44-8004-795f43550500 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:43.431781 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1418/2878] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:40:43.436093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0d17e-1fe4-4f1e-871f-33e6765fbab5 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:43.445989 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0d17e-1fe4-4f1e-871f-33e6765fbab5 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:43.450604 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d274f9-12fe-43c1-83f3-2b1440bad72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:43.451183 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d274f9-12fe-43c1-83f3-2b1440bad72b admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:43.451452 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d274f9-12fe-43c1-83f3-2b1440bad72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:43.451716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d274f9-12fe-43c1-83f3-2b1440bad72b admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:43.452374 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d274f9-12fe-43c1-83f3-2b1440bad72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:43.454651 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d274f9-12fe-43c1-83f3-2b1440bad72b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:43.480502 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1461/2879] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:40:43 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:43.485259 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61427705-41fe-4a44-8004-795f43550500 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:43.495131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61427705-41fe-4a44-8004-795f43550500 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:43.550782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40570b75-a019-44a4-8923-5a06c2543d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:43.551375 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570b75-a019-44a4-8923-5a06c2543d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:43.551653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570b75-a019-44a4-8923-5a06c2543d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:43.551955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570b75-a019-44a4-8923-5a06c2543d40 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:43.552677 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40570b75-a019-44a4-8923-5a06c2543d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:43.554579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40570b75-a019-44a4-8923-5a06c2543d40 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:43.575750 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1419/2880] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:40:43 2022] POST /identity/v3/users => generated 280 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:43.580001 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d274f9-12fe-43c1-83f3-2b1440bad72b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:43.590290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d274f9-12fe-43c1-83f3-2b1440bad72b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:43.595310 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d49991-ca91-4047-a044-b13548408021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:43.595944 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d49991-ca91-4047-a044-b13548408021 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:43.596227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d49991-ca91-4047-a044-b13548408021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:43.596522 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d49991-ca91-4047-a044-b13548408021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:43.597147 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d49991-ca91-4047-a044-b13548408021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:43.598738 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d49991-ca91-4047-a044-b13548408021 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:43.608529 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1462/2881] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:43.612905 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40570b75-a019-44a4-8923-5a06c2543d40 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:43.622954 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40570b75-a019-44a4-8923-5a06c2543d40 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:43.627768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3ab52-68de-48cb-86da-1caf813b2ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:43.628381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ab52-68de-48cb-86da-1caf813b2ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:43.628663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ab52-68de-48cb-86da-1caf813b2ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:43.628940 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ab52-68de-48cb-86da-1caf813b2ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:43.629572 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3ab52-68de-48cb-86da-1caf813b2ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:43.631156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3ab52-68de-48cb-86da-1caf813b2ec9 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:43.643454 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1420/2882] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:43.647463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d49991-ca91-4047-a044-b13548408021 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:43.657927 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d49991-ca91-4047-a044-b13548408021 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:43.662525 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ca4db-45af-4437-bd62-613742db6a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:43.663160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ca4db-45af-4437-bd62-613742db6a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:43.663439 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ca4db-45af-4437-bd62-613742db6a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:43.663714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ca4db-45af-4437-bd62-613742db6a10 admin admin] PATH_INFO: `/v3/projects/b6950880bd644e1d904b2da16eb1bbef/users/8690e357cc0c4567aeb99f84ec5854ac/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:43.678404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ca4db-45af-4437-bd62-613742db6a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6950880bd644e1d904b2da16eb1bbef, user_id=8690e357cc0c4567aeb99f84ec5854ac, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:43.681094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ca4db-45af-4437-bd62-613742db6a10 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:43.694090 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1463/2883] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:40:43 2022] PUT /identity/v3/projects/b6950880bd644e1d904b2da16eb1bbef/users/8690e357cc0c4567aeb99f84ec5854ac/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:43.704681 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99754674-1d28-4aa6-8f45-0c73b06ea073 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:43.705182 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99754674-1d28-4aa6-8f45-0c73b06ea073 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:43.705306 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99754674-1d28-4aa6-8f45-0c73b06ea073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:43.733161 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-99754674-1d28-4aa6-8f45-0c73b06ea073 None None] MFA Rules not processed for user `8690e357cc0c4567aeb99f84ec5854ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:43.734370 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-99754674-1d28-4aa6-8f45-0c73b06ea073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:43.766811 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:43.800480 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1421/2884] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:43.836317 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ca4db-45af-4437-bd62-613742db6a10 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:43.838044 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-327ca4db-45af-4437-bd62-613742db6a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:43.894986 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ca4db-45af-4437-bd62-613742db6a10 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:43.898644 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e598ef-309f-44f7-9622-98663e08a76e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:43.899241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e598ef-309f-44f7-9622-98663e08a76e service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:43.899519 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e598ef-309f-44f7-9622-98663e08a76e service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:43.899797 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e598ef-309f-44f7-9622-98663e08a76e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:43.908534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e598ef-309f-44f7-9622-98663e08a76e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:43.909958 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e598ef-309f-44f7-9622-98663e08a76e service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:43.918636 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1464/2885] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:43.934474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99754674-1d28-4aa6-8f45-0c73b06ea073 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:43.998302 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99754674-1d28-4aa6-8f45-0c73b06ea073 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:44.003177 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:44.003789 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:44.004149 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:44.004434 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] PATH_INFO: `/v3/users/8690e357cc0c4567aeb99f84ec5854ac` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:44.005550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8690e357cc0c4567aeb99f84ec5854ac)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:44.007553 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:44.052276 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8690e357cc0c4567aeb99f84ec5854ac'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:44.059419 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8690e357cc0c4567aeb99f84ec5854ac'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:44.060077 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8690e357cc0c4567aeb99f84ec5854ac'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:44.060693 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8690e357cc0c4567aeb99f84ec5854ac'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:44.067595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8690e357cc0c4567aeb99f84ec5854ac'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:44.084330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1422/2886] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:40:43 2022] DELETE /identity/v3/users/8690e357cc0c4567aeb99f84ec5854ac => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:44.088865 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1558e-97e4-479a-b147-bb26062901c2 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:44.089154 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1558e-97e4-479a-b147-bb26062901c2 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:44.089432 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1558e-97e4-479a-b147-bb26062901c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:44.110210 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-31a1558e-97e4-479a-b147-bb26062901c2 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:44.111448 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-31a1558e-97e4-479a-b147-bb26062901c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:44.139076 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:44.171121 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1465/2887] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:44.181364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:44.182760 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:44.241141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300a43c-56fc-4d57-95be-6cd810e05a77 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:44.244848 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475b801-a69f-45e7-b1d0-8418cd5afd71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:44.245441 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475b801-a69f-45e7-b1d0-8418cd5afd71 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:44.245719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475b801-a69f-45e7-b1d0-8418cd5afd71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:44.245992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475b801-a69f-45e7-b1d0-8418cd5afd71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:44.252937 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:44.255400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475b801-a69f-45e7-b1d0-8418cd5afd71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:44.257755 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475b801-a69f-45e7-b1d0-8418cd5afd71 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:44.268847 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1423/2888] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:44.535866 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1558e-97e4-479a-b147-bb26062901c2 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:44.537320 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-31a1558e-97e4-479a-b147-bb26062901c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:44.551541 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1558e-97e4-479a-b147-bb26062901c2 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:44.556463 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:44.557194 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:44.557478 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:44.557747 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] PATH_INFO: `/v3/projects/b6950880bd644e1d904b2da16eb1bbef` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:44.559019 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6950880bd644e1d904b2da16eb1bbef)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:44.560851 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:44.608635 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6950880bd644e1d904b2da16eb1bbef', 'request_id': 'req-9d427aaf-29fe-43e7-917a-2c386beecdbb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:44.615534 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6950880bd644e1d904b2da16eb1bbef', 'request_id': 'req-9d427aaf-29fe-43e7-917a-2c386beecdbb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:44.622560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6950880bd644e1d904b2da16eb1bbef', 'request_id': 'req-9d427aaf-29fe-43e7-917a-2c386beecdbb'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:44.633178 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] The token cache is being invalidate because project b6950880bd644e1d904b2da16eb1bbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:40:44.633576 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:44.634214 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-9d427aaf-29fe-43e7-917a-2c386beecdbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:44.635715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1466/2889] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:40:44 2022] DELETE /identity/v3/projects/b6950880bd644e1d904b2da16eb1bbef => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:44.641116 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de23768-361a-4452-a6e7-f8790e281221 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:44.641474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de23768-361a-4452-a6e7-f8790e281221 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:44.641820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de23768-361a-4452-a6e7-f8790e281221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:44.661875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1de23768-361a-4452-a6e7-f8790e281221 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:44.663081 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1de23768-361a-4452-a6e7-f8790e281221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:44.722668 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1424/2890] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:44.731532 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd64c-5a84-485a-9f61-e6fceb620dc8 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:44.731811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd64c-5a84-485a-9f61-e6fceb620dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:44.732127 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd64c-5a84-485a-9f61-e6fceb620dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:44.752291 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ca6bd64c-5a84-485a-9f61-e6fceb620dc8 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:44.753485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ca6bd64c-5a84-485a-9f61-e6fceb620dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:44.761298 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1467/2891] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:44.765782 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de23768-361a-4452-a6e7-f8790e281221 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:44.775541 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de23768-361a-4452-a6e7-f8790e281221 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:44.780096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dcb0e-f32e-4a36-a359-d58d13b1c062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:44.780684 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dcb0e-f32e-4a36-a359-d58d13b1c062 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:44.780975 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dcb0e-f32e-4a36-a359-d58d13b1c062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:44.781229 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dcb0e-f32e-4a36-a359-d58d13b1c062 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:44.782477 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dcb0e-f32e-4a36-a359-d58d13b1c062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:40:44.782776 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dcb0e-f32e-4a36-a359-d58d13b1c062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:44.784385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dcb0e-f32e-4a36-a359-d58d13b1c062 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:44.795514 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1425/2892] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:40:44.800282 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bd64c-5a84-485a-9f61-e6fceb620dc8 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:44.809337 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bd64c-5a84-485a-9f61-e6fceb620dc8 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:44.814132 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742bc95-a73c-438c-8768-a77b65345009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:44.814708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742bc95-a73c-438c-8768-a77b65345009 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:44.814983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742bc95-a73c-438c-8768-a77b65345009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:44.815256 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742bc95-a73c-438c-8768-a77b65345009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:44.815937 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742bc95-a73c-438c-8768-a77b65345009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:44.817809 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742bc95-a73c-438c-8768-a77b65345009 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:44.846886 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1468/2893] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:40:44 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:40:44.851096 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dcb0e-f32e-4a36-a359-d58d13b1c062 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:44.861906 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dcb0e-f32e-4a36-a359-d58d13b1c062 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:44.917043 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929049-402d-4874-b125-64e6a0fc0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:44.917638 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929049-402d-4874-b125-64e6a0fc0b3b admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:44.917916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929049-402d-4874-b125-64e6a0fc0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:44.918187 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929049-402d-4874-b125-64e6a0fc0b3b admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:44.918814 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2929049-402d-4874-b125-64e6a0fc0b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:44.920773 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2929049-402d-4874-b125-64e6a0fc0b3b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:44.941531 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1426/2894] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:40:44 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:44.945666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742bc95-a73c-438c-8768-a77b65345009 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:44.956403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742bc95-a73c-438c-8768-a77b65345009 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:44.960972 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cc688-7a34-486c-9f7d-68907d450e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:44.961557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cc688-7a34-486c-9f7d-68907d450e17 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:44.961834 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cc688-7a34-486c-9f7d-68907d450e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:44.962105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cc688-7a34-486c-9f7d-68907d450e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:44.962733 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cc688-7a34-486c-9f7d-68907d450e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:44.964356 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cc688-7a34-486c-9f7d-68907d450e17 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:44.974709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1469/2895] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:44.978472 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929049-402d-4874-b125-64e6a0fc0b3b admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:44.988802 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929049-402d-4874-b125-64e6a0fc0b3b admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:44.993411 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992da5e6-b07c-4a7f-ac2e-1df3a168b107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:44.993996 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992da5e6-b07c-4a7f-ac2e-1df3a168b107 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:44.994277 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992da5e6-b07c-4a7f-ac2e-1df3a168b107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:44.994550 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992da5e6-b07c-4a7f-ac2e-1df3a168b107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:44.995184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992da5e6-b07c-4a7f-ac2e-1df3a168b107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:44.996803 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992da5e6-b07c-4a7f-ac2e-1df3a168b107 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:45.007274 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1427/2896] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:40:45.011409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cc688-7a34-486c-9f7d-68907d450e17 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:45.022622 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cc688-7a34-486c-9f7d-68907d450e17 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:45.027103 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ff573-f386-40e5-8775-62ee5cf54eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:45.027731 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ff573-f386-40e5-8775-62ee5cf54eba admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:45.028094 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ff573-f386-40e5-8775-62ee5cf54eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:45.028403 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ff573-f386-40e5-8775-62ee5cf54eba admin admin] PATH_INFO: `/v3/projects/149a8369cf224fbe9b31525ff7a70406/users/d2b95024ca104805876f94a1d830e20b/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:45.044336 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ff573-f386-40e5-8775-62ee5cf54eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=149a8369cf224fbe9b31525ff7a70406, user_id=d2b95024ca104805876f94a1d830e20b, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:45.046961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ff573-f386-40e5-8775-62ee5cf54eba admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:45.059456 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1470/2897] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:40:45 2022] PUT /identity/v3/projects/149a8369cf224fbe9b31525ff7a70406/users/d2b95024ca104805876f94a1d830e20b/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:45.070153 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302515e6-ffde-44c1-9449-9e16ac908221 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:45.070439 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302515e6-ffde-44c1-9449-9e16ac908221 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:45.070718 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302515e6-ffde-44c1-9449-9e16ac908221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:45.099350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-302515e6-ffde-44c1-9449-9e16ac908221 None None] MFA Rules not processed for user `d2b95024ca104805876f94a1d830e20b`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:45.100582 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-302515e6-ffde-44c1-9449-9e16ac908221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:45.146595 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:45.164093 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1428/2898] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:45.175093 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ff573-f386-40e5-8775-62ee5cf54eba admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:45.176898 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ca3ff573-f386-40e5-8775-62ee5cf54eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:45.232620 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ff573-f386-40e5-8775-62ee5cf54eba admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:45.236290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5162a1-a3d8-4c1c-9eb7-a032b58cf444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:45.236881 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5162a1-a3d8-4c1c-9eb7-a032b58cf444 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:45.237156 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5162a1-a3d8-4c1c-9eb7-a032b58cf444 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:45.237427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5162a1-a3d8-4c1c-9eb7-a032b58cf444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:45.243550 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:45.245969 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5162a1-a3d8-4c1c-9eb7-a032b58cf444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:45.247959 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5162a1-a3d8-4c1c-9eb7-a032b58cf444 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:45.257581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1471/2899] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:55.161282 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=4 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:55.256404 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:58.958786 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302515e6-ffde-44c1-9449-9e16ac908221 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:59.021883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302515e6-ffde-44c1-9449-9e16ac908221 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:59.026357 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:59.026972 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:59.027255 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:59.027549 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] PATH_INFO: `/v3/users/d2b95024ca104805876f94a1d830e20b` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:59.028687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b95024ca104805876f94a1d830e20b)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:59.030579 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:59.075382 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b95024ca104805876f94a1d830e20b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:59.083321 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b95024ca104805876f94a1d830e20b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:59.083970 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b95024ca104805876f94a1d830e20b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:59.084584 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b95024ca104805876f94a1d830e20b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:59.091299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b95024ca104805876f94a1d830e20b'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:59.107875 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1429/2900] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:40:58 2022] DELETE /identity/v3/users/d2b95024ca104805876f94a1d830e20b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:59.112424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cc042-a25e-4455-9cd2-6823d2c9358a None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:59.112909 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cc042-a25e-4455-9cd2-6823d2c9358a None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:59.113050 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cc042-a25e-4455-9cd2-6823d2c9358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:59.132185 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-470cc042-a25e-4455-9cd2-6823d2c9358a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:59.133381 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-470cc042-a25e-4455-9cd2-6823d2c9358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:59.192071 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1472/2901] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:40:59.201719 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:59.203117 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:59.260092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a211cca-2dd5-4ee1-8395-99effb526f20 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:59.264132 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed08ac1-62e0-4900-8910-d7f66fedeea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:59.264733 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed08ac1-62e0-4900-8910-d7f66fedeea8 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:59.265008 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed08ac1-62e0-4900-8910-d7f66fedeea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:59.265278 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed08ac1-62e0-4900-8910-d7f66fedeea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:59.274346 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed08ac1-62e0-4900-8910-d7f66fedeea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:59.275761 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed08ac1-62e0-4900-8910-d7f66fedeea8 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:59.285107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1430/2902] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:40:59.551208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cc042-a25e-4455-9cd2-6823d2c9358a None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:59.552737 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-470cc042-a25e-4455-9cd2-6823d2c9358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:59.568504 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cc042-a25e-4455-9cd2-6823d2c9358a None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:59.573318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:59.574165 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:59.574443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:59.574897 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] PATH_INFO: `/v3/projects/149a8369cf224fbe9b31525ff7a70406` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:59.576227 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=149a8369cf224fbe9b31525ff7a70406)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:59.578105 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:59.630515 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149a8369cf224fbe9b31525ff7a70406', 'request_id': 'req-8ca9ecfb-a184-4168-ac8f-19765aa1d591'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:59.637267 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149a8369cf224fbe9b31525ff7a70406', 'request_id': 'req-8ca9ecfb-a184-4168-ac8f-19765aa1d591'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:59.644517 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149a8369cf224fbe9b31525ff7a70406', 'request_id': 'req-8ca9ecfb-a184-4168-ac8f-19765aa1d591'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:59.654617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] The token cache is being invalidate because project 149a8369cf224fbe9b31525ff7a70406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:40:59.654900 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:59.655537 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-8ca9ecfb-a184-4168-ac8f-19765aa1d591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:40:59.657047 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1473/2903] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:40:59 2022] DELETE /identity/v3/projects/149a8369cf224fbe9b31525ff7a70406 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:40:59.662406 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dab50-a149-4b61-8999-0d2266a5111a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:59.662691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dab50-a149-4b61-8999-0d2266a5111a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:59.662998 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dab50-a149-4b61-8999-0d2266a5111a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:59.682661 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-ed0dab50-a149-4b61-8999-0d2266a5111a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:59.683860 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ed0dab50-a149-4b61-8999-0d2266a5111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:59.700330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:40:59.743758 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1431/2904] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:59.751413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d7520-e818-4088-b18e-d9a6620908df None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:59.751719 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d7520-e818-4088-b18e-d9a6620908df None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:59.752049 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d7520-e818-4088-b18e-d9a6620908df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:59.771844 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-b68d7520-e818-4088-b18e-d9a6620908df None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:40:59.773057 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-b68d7520-e818-4088-b18e-d9a6620908df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:40:59.780763 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1474/2905] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:40:59.785685 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dab50-a149-4b61-8999-0d2266a5111a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:59.795107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dab50-a149-4b61-8999-0d2266a5111a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:59.800543 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d90fe7-2fb5-4db2-9649-69548c245fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:59.801131 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90fe7-2fb5-4db2-9649-69548c245fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:59.801402 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90fe7-2fb5-4db2-9649-69548c245fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:59.801671 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90fe7-2fb5-4db2-9649-69548c245fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:59.802305 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d90fe7-2fb5-4db2-9649-69548c245fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:40:59.802603 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d90fe7-2fb5-4db2-9649-69548c245fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:59.804208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d90fe7-2fb5-4db2-9649-69548c245fb0 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:59.815772 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1432/2906] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 06:40:59.820046 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d7520-e818-4088-b18e-d9a6620908df None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:59.829383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d7520-e818-4088-b18e-d9a6620908df None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:59.834431 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c0b80-a911-4fae-b9dc-ecb8edea4731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:59.835034 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c0b80-a911-4fae-b9dc-ecb8edea4731 admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:59.835308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c0b80-a911-4fae-b9dc-ecb8edea4731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:59.835577 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c0b80-a911-4fae-b9dc-ecb8edea4731 admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:59.836243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c0b80-a911-4fae-b9dc-ecb8edea4731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:59.838130 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c0b80-a911-4fae-b9dc-ecb8edea4731 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:59.867030 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1475/2907] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:40:59 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:40:59.871219 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d90fe7-2fb5-4db2-9649-69548c245fb0 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:59.881611 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d90fe7-2fb5-4db2-9649-69548c245fb0 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:59.936691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfcfe2-3107-4de4-a99a-3f0f3ac6bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:59.937280 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfcfe2-3107-4de4-a99a-3f0f3ac6bd2c admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:59.937555 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfcfe2-3107-4de4-a99a-3f0f3ac6bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:59.937822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfcfe2-3107-4de4-a99a-3f0f3ac6bd2c admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:59.938428 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfcfe2-3107-4de4-a99a-3f0f3ac6bd2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:59.940768 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfcfe2-3107-4de4-a99a-3f0f3ac6bd2c admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:59.961872 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1433/2908] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:40:59 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:40:59.965991 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c0b80-a911-4fae-b9dc-ecb8edea4731 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:40:59.977035 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c0b80-a911-4fae-b9dc-ecb8edea4731 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:40:59.981708 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e16974-557a-4098-ab7c-18c3b0316330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:40:59.982297 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16974-557a-4098-ab7c-18c3b0316330 admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:40:59.982578 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16974-557a-4098-ab7c-18c3b0316330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:40:59.982854 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16974-557a-4098-ab7c-18c3b0316330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:40:59.983485 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e16974-557a-4098-ab7c-18c3b0316330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:40:59.985115 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e16974-557a-4098-ab7c-18c3b0316330 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:40:59.995535 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1476/2909] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:41:00.001001 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfcfe2-3107-4de4-a99a-3f0f3ac6bd2c admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:00.011815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfcfe2-3107-4de4-a99a-3f0f3ac6bd2c admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:00.016647 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2639c70-9d0d-483f-ad80-066299b13251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:00.017222 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639c70-9d0d-483f-ad80-066299b13251 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:00.017517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639c70-9d0d-483f-ad80-066299b13251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:00.017820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639c70-9d0d-483f-ad80-066299b13251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:00.018732 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2639c70-9d0d-483f-ad80-066299b13251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:00.020342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2639c70-9d0d-483f-ad80-066299b13251 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:00.030617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1434/2910] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:41:00.034723 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e16974-557a-4098-ab7c-18c3b0316330 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:00.044512 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e16974-557a-4098-ab7c-18c3b0316330 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:00.049603 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a914c-eee1-4155-9798-9a1e9c4573b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:00.050308 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a914c-eee1-4155-9798-9a1e9c4573b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:00.050580 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a914c-eee1-4155-9798-9a1e9c4573b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:00.050850 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a914c-eee1-4155-9798-9a1e9c4573b7 admin admin] PATH_INFO: `/v3/projects/fbe112d7d1614b8fb5b4ca0bd78ea961/users/c4f0aa1e2dfb4e8faae02b9b1fcf5208/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:00.066342 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a914c-eee1-4155-9798-9a1e9c4573b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe112d7d1614b8fb5b4ca0bd78ea961, user_id=c4f0aa1e2dfb4e8faae02b9b1fcf5208, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:00.068981 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a914c-eee1-4155-9798-9a1e9c4573b7 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:00.081476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1477/2911] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:41:00 2022] PUT /identity/v3/projects/fbe112d7d1614b8fb5b4ca0bd78ea961/users/c4f0aa1e2dfb4e8faae02b9b1fcf5208/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:41:00.091400 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61134ff4-2205-4ed2-b0e0-0a6fb14aa31f None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:00.091690 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61134ff4-2205-4ed2-b0e0-0a6fb14aa31f None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:00.091997 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61134ff4-2205-4ed2-b0e0-0a6fb14aa31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:00.119992 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-61134ff4-2205-4ed2-b0e0-0a6fb14aa31f None None] MFA Rules not processed for user `c4f0aa1e2dfb4e8faae02b9b1fcf5208`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:00.121204 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-61134ff4-2205-4ed2-b0e0-0a6fb14aa31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:00.186994 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1435/2912] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:41:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:41:00.198236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a914c-eee1-4155-9798-9a1e9c4573b7 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:00.199926 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ec0a914c-eee1-4155-9798-9a1e9c4573b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:00.222860 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:41:00.260513 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a914c-eee1-4155-9798-9a1e9c4573b7 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:00.264383 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c6f47-cf40-4f78-b5a0-ab09878cb6f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:00.264973 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6f47-cf40-4f78-b5a0-ab09878cb6f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:00.265250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6f47-cf40-4f78-b5a0-ab09878cb6f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:00.265520 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c6f47-cf40-4f78-b5a0-ab09878cb6f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:00.274176 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c6f47-cf40-4f78-b5a0-ab09878cb6f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:00.275633 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c6f47-cf40-4f78-b5a0-ab09878cb6f7 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:00.284476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1478/2913] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:03.301815 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61134ff4-2205-4ed2-b0e0-0a6fb14aa31f None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:03.321080 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:41:03.365003 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61134ff4-2205-4ed2-b0e0-0a6fb14aa31f None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:03.369539 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:03.370154 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:03.370432 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:03.370707 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] PATH_INFO: `/v3/users/c4f0aa1e2dfb4e8faae02b9b1fcf5208` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:03.371822 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f0aa1e2dfb4e8faae02b9b1fcf5208)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:03.373754 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:03.419956 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f0aa1e2dfb4e8faae02b9b1fcf5208'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:41:03.427452 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f0aa1e2dfb4e8faae02b9b1fcf5208'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:41:03.428234 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f0aa1e2dfb4e8faae02b9b1fcf5208'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:41:03.428844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f0aa1e2dfb4e8faae02b9b1fcf5208'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:41:03.436057 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f0aa1e2dfb4e8faae02b9b1fcf5208'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:41:03.459831 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1436/2914] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:41:03 2022] DELETE /identity/v3/users/c4f0aa1e2dfb4e8faae02b9b1fcf5208 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:41:03.464304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f14083-247f-466f-8624-009a948033a4 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:03.464819 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f14083-247f-466f-8624-009a948033a4 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:03.464939 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f14083-247f-466f-8624-009a948033a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:03.484107 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-08f14083-247f-466f-8624-009a948033a4 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:03.485311 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-08f14083-247f-466f-8624-009a948033a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:03.542983 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1479/2915] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:41:03.553216 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:03.554646 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:03.610750 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ffc41-fe62-4d4a-afd6-928a34d00b01 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:03.615329 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b423a44-e1b7-4d46-8577-1fba3919554e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:03.615946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b423a44-e1b7-4d46-8577-1fba3919554e service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:03.616228 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b423a44-e1b7-4d46-8577-1fba3919554e service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:03.616501 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b423a44-e1b7-4d46-8577-1fba3919554e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:03.625435 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b423a44-e1b7-4d46-8577-1fba3919554e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:03.626849 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b423a44-e1b7-4d46-8577-1fba3919554e service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:03.636206 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1437/2916] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:03.912008 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f14083-247f-466f-8624-009a948033a4 None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:03.913480 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-08f14083-247f-466f-8624-009a948033a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:03.926293 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f14083-247f-466f-8624-009a948033a4 None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:03.931073 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:03.931805 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:03.932129 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:03.932405 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] PATH_INFO: `/v3/projects/fbe112d7d1614b8fb5b4ca0bd78ea961` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:03.933673 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe112d7d1614b8fb5b4ca0bd78ea961)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:03.935660 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:03.981565 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe112d7d1614b8fb5b4ca0bd78ea961', 'request_id': 'req-1de825f3-47a0-4d95-9012-ebd3af78ca3d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:41:03.987588 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe112d7d1614b8fb5b4ca0bd78ea961', 'request_id': 'req-1de825f3-47a0-4d95-9012-ebd3af78ca3d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:41:03.994774 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe112d7d1614b8fb5b4ca0bd78ea961', 'request_id': 'req-1de825f3-47a0-4d95-9012-ebd3af78ca3d'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:41:04.005124 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] The token cache is being invalidate because project fbe112d7d1614b8fb5b4ca0bd78ea961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:41:04.005408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:41:04.006021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-1de825f3-47a0-4d95-9012-ebd3af78ca3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:41:04.007481 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1480/2917] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:41:03 2022] DELETE /identity/v3/projects/fbe112d7d1614b8fb5b4ca0bd78ea961 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:41:04.012338 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d908c-acaa-450b-9735-00252f78e83a None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:04.012621 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d908c-acaa-450b-9735-00252f78e83a None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:04.012897 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d908c-acaa-450b-9735-00252f78e83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:04.034878 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-aa7d908c-acaa-450b-9735-00252f78e83a None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:04.036101 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aa7d908c-acaa-450b-9735-00252f78e83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:04.068780 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:41:04.095621 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1438/2918] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:41:04.103709 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32b005-d998-4f26-9699-ee9dbe31914f None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:04.104029 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32b005-d998-4f26-9699-ee9dbe31914f None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:04.104304 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32b005-d998-4f26-9699-ee9dbe31914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:04.123413 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-6a32b005-d998-4f26-9699-ee9dbe31914f None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:04.124646 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6a32b005-d998-4f26-9699-ee9dbe31914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:04.133032 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1481/2919] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:41:04.137051 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d908c-acaa-450b-9735-00252f78e83a None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:04.147258 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d908c-acaa-450b-9735-00252f78e83a None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:04.151737 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d29133-aa52-4346-b2ef-775ff3132ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:04.152350 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29133-aa52-4346-b2ef-775ff3132ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:04.152623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29133-aa52-4346-b2ef-775ff3132ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:04.152898 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29133-aa52-4346-b2ef-775ff3132ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:04.153524 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d29133-aa52-4346-b2ef-775ff3132ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 06:41:04.153817 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d29133-aa52-4346-b2ef-775ff3132ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:04.155378 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d29133-aa52-4346-b2ef-775ff3132ae5 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:04.166820 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1439/2920] 10.222.0.16 () {58 vars in 1153 bytes} [Sun Sep 18 06:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 06:41:04.171160 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32b005-d998-4f26-9699-ee9dbe31914f None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:04.180296 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32b005-d998-4f26-9699-ee9dbe31914f None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:04.184893 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e261cf-87b7-4740-bad0-74eeb0c42f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:04.185477 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e261cf-87b7-4740-bad0-74eeb0c42f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:04.185754 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e261cf-87b7-4740-bad0-74eeb0c42f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:04.186026 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e261cf-87b7-4740-bad0-74eeb0c42f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:04.186639 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e261cf-87b7-4740-bad0-74eeb0c42f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:04.189236 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e261cf-87b7-4740-bad0-74eeb0c42f3c admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:04.218482 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1482/2921] 10.222.0.16 () {60 vars in 1153 bytes} [Sun Sep 18 06:41:04 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 06:41:04.222744 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d29133-aa52-4346-b2ef-775ff3132ae5 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:04.232636 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d29133-aa52-4346-b2ef-775ff3132ae5 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:04.288120 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5f432-b9c3-4e65-9b9c-dcd45c21d725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:04.288714 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5f432-b9c3-4e65-9b9c-dcd45c21d725 admin admin] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:04.288995 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5f432-b9c3-4e65-9b9c-dcd45c21d725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:04.289265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5f432-b9c3-4e65-9b9c-dcd45c21d725 admin admin] PATH_INFO: `/v3/users` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:04.289891 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5f432-b9c3-4e65-9b9c-dcd45c21d725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:04.291798 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5f432-b9c3-4e65-9b9c-dcd45c21d725 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:04.311893 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1440/2922] 10.222.0.16 () {60 vars in 1144 bytes} [Sun Sep 18 06:41:04 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 06:41:04.316666 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e261cf-87b7-4740-bad0-74eeb0c42f3c admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:04.326828 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e261cf-87b7-4740-bad0-74eeb0c42f3c admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:04.332045 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512278b7-dcae-4b58-bc13-3bf200f8964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:04.332628 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512278b7-dcae-4b58-bc13-3bf200f8964b admin admin] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:04.332931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512278b7-dcae-4b58-bc13-3bf200f8964b admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:04.333238 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512278b7-dcae-4b58-bc13-3bf200f8964b admin admin] PATH_INFO: `/v3/roles` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:04.333868 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512278b7-dcae-4b58-bc13-3bf200f8964b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:04.335460 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512278b7-dcae-4b58-bc13-3bf200f8964b admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:04.345305 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1483/2923] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 06:41:04.349385 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5f432-b9c3-4e65-9b9c-dcd45c21d725 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:04.359167 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5f432-b9c3-4e65-9b9c-dcd45c21d725 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:04.363806 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39968a50-d88f-4085-adca-0481493dfe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:04.364421 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968a50-d88f-4085-adca-0481493dfe7b admin admin] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:04.364697 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968a50-d88f-4085-adca-0481493dfe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:04.364969 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39968a50-d88f-4085-adca-0481493dfe7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:04.365597 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39968a50-d88f-4085-adca-0481493dfe7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:04.367173 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39968a50-d88f-4085-adca-0481493dfe7b admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:04.378050 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1441/2924] 10.222.0.16 () {58 vars in 1122 bytes} [Sun Sep 18 06:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 06:41:04.382083 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512278b7-dcae-4b58-bc13-3bf200f8964b admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:04.392240 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512278b7-dcae-4b58-bc13-3bf200f8964b admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:04.397409 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6285-5eb5-4a42-96bd-117c799ec692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:04.398051 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6285-5eb5-4a42-96bd-117c799ec692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:04.398332 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6285-5eb5-4a42-96bd-117c799ec692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:04.398608 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6285-5eb5-4a42-96bd-117c799ec692 admin admin] PATH_INFO: `/v3/projects/3c0ee5ced9cb44bb9cc81717d383494b/users/152a222b81d04e829c2cd9d4a5068661/roles/3009ebffeb104922b00cd072c83920c0` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:04.400786 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:41:04.415021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6285-5eb5-4a42-96bd-117c799ec692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c0ee5ced9cb44bb9cc81717d383494b, user_id=152a222b81d04e829c2cd9d4a5068661, role_id=3009ebffeb104922b00cd072c83920c0)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:04.417706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6285-5eb5-4a42-96bd-117c799ec692 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:04.430557 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1484/2925] 10.222.0.16 () {60 vars in 1483 bytes} [Sun Sep 18 06:41:04 2022] PUT /identity/v3/projects/3c0ee5ced9cb44bb9cc81717d383494b/users/152a222b81d04e829c2cd9d4a5068661/roles/3009ebffeb104922b00cd072c83920c0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:41:04.435623 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf9e69-47c9-412f-b960-711c929ff105 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:04.435950 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf9e69-47c9-412f-b960-711c929ff105 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:04.436307 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf9e69-47c9-412f-b960-711c929ff105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:04.455336 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-1eaf9e69-47c9-412f-b960-711c929ff105 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:04.456598 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1eaf9e69-47c9-412f-b960-711c929ff105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:04.515265 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1442/2926] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:41:04.524998 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6285-5eb5-4a42-96bd-117c799ec692 admin admin] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:04.526743 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-952c6285-5eb5-4a42-96bd-117c799ec692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:04.583290 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6285-5eb5-4a42-96bd-117c799ec692 admin admin] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:04.586832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7e71c-7079-40a4-a90a-4732c46a153d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:04.587420 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e71c-7079-40a4-a90a-4732c46a153d service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:04.587698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e71c-7079-40a4-a90a-4732c46a153d service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:04.588000 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e71c-7079-40a4-a90a-4732c46a153d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:04.596836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7e71c-7079-40a4-a90a-4732c46a153d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:04.598245 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7e71c-7079-40a4-a90a-4732c46a153d service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:04.607423 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1485/2927] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:05.254916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f324d-9ed7-40c5-bec9-b6d33ca77911 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:05.254916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f324d-9ed7-40c5-bec9-b6d33ca77911 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:05.254916 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f324d-9ed7-40c5-bec9-b6d33ca77911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:05.280687 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-fe3f324d-9ed7-40c5-bec9-b6d33ca77911 None None] MFA Rules not processed for user `152a222b81d04e829c2cd9d4a5068661`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:05.281896 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-fe3f324d-9ed7-40c5-bec9-b6d33ca77911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:05.317517 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:41:05.353727 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1443/2928] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:41:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:41:05.364659 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7e71c-7079-40a4-a90a-4732c46a153d service neutron] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:05.366009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9dc7e71c-7079-40a4-a90a-4732c46a153d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:05.423993 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7e71c-7079-40a4-a90a-4732c46a153d service neutron] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:05.427824 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff4a1d-6ff5-4c86-8964-2007dab4b2d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bb483203d3b4210a53a317443206d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:05.428465 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4a1d-6ff5-4c86-8964-2007dab4b2d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:05.428742 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4a1d-6ff5-4c86-8964-2007dab4b2d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:05.429014 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4a1d-6ff5-4c86-8964-2007dab4b2d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:05.437546 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff4a1d-6ff5-4c86-8964-2007dab4b2d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:05.438971 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff4a1d-6ff5-4c86-8964-2007dab4b2d5 service cinder] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:05.448175 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1486/2929] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:06.817310 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5158a4-80aa-4696-b93d-d753209a517e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:06.817830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5158a4-80aa-4696-b93d-d753209a517e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:06.817830 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5158a4-80aa-4696-b93d-d753209a517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:06.836604 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-6e5158a4-80aa-4696-b93d-d753209a517e None None] MFA Rules not processed for user `152a222b81d04e829c2cd9d4a5068661`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:06.837799 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6e5158a4-80aa-4696-b93d-d753209a517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:06.844625 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1444/2930] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:41:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:41:06.883607 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff4a1d-6ff5-4c86-8964-2007dab4b2d5 service cinder] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:06.885012 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-6dff4a1d-6ff5-4c86-8964-2007dab4b2d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:06.961309 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff4a1d-6ff5-4c86-8964-2007dab4b2d5 service cinder] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:06.971099 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebd713-9da4-4b1a-a6eb-71a1e4827a1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c498b5857f42f2ab84423f8f4ea11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:06.971980 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebd713-9da4-4b1a-a6eb-71a1e4827a1e service glance] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:06.972266 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebd713-9da4-4b1a-a6eb-71a1e4827a1e service glance] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:06.972538 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebd713-9da4-4b1a-a6eb-71a1e4827a1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:06.974261 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-28ebd713-9da4-4b1a-a6eb-71a1e4827a1e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:06.996241 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:41:07.045564 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebd713-9da4-4b1a-a6eb-71a1e4827a1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:07.047043 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebd713-9da4-4b1a-a6eb-71a1e4827a1e service glance] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:07.058728 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1487/2931] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:07.261342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5158a4-80aa-4696-b93d-d753209a517e None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:07.262805 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-6e5158a4-80aa-4696-b93d-d753209a517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:07.274911 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5158a4-80aa-4696-b93d-d753209a517e None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:07.278426 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcef4c-95f6-4dbd-95e8-96c5535de7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:07.279012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcef4c-95f6-4dbd-95e8-96c5535de7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:07.279288 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcef4c-95f6-4dbd-95e8-96c5535de7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:07.279562 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcef4c-95f6-4dbd-95e8-96c5535de7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:07.281233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-87bcef4c-95f6-4dbd-95e8-96c5535de7b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:07.290923 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcef4c-95f6-4dbd-95e8-96c5535de7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:07.292371 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcef4c-95f6-4dbd-95e8-96c5535de7b6 service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:07.300858 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1445/2932] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:07.642276 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebd713-9da4-4b1a-a6eb-71a1e4827a1e service glance] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:07.653126 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebd713-9da4-4b1a-a6eb-71a1e4827a1e service glance] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:07.656961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52004231-ac61-411c-b26d-4edba9a85e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:07.657556 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52004231-ac61-411c-b26d-4edba9a85e0b service neutron] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:07.657963 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52004231-ac61-411c-b26d-4edba9a85e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:07.658243 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52004231-ac61-411c-b26d-4edba9a85e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:07.660810 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-52004231-ac61-411c-b26d-4edba9a85e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:07.674641 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52004231-ac61-411c-b26d-4edba9a85e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:07.676389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52004231-ac61-411c-b26d-4edba9a85e0b service neutron] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:07.687437 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1488/2933] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:41:09.377139 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcef4c-95f6-4dbd-95e8-96c5535de7b6 service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:09.386358 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcef4c-95f6-4dbd-95e8-96c5535de7b6 service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:09.390466 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2123ce-7dee-43e9-b74e-cad89c1495bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78e909fc894ddd9b35ead5fe68b898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:09.391061 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2123ce-7dee-43e9-b74e-cad89c1495bf service neutron] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:09.391342 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2123ce-7dee-43e9-b74e-cad89c1495bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:09.391617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2123ce-7dee-43e9-b74e-cad89c1495bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:09.394107 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a2123ce-7dee-43e9-b74e-cad89c1495bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:09.404493 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2123ce-7dee-43e9-b74e-cad89c1495bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:09.405883 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2123ce-7dee-43e9-b74e-cad89c1495bf service neutron] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:09.413844 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1446/2934] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:17.682476 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=29 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:41:19.410287 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=26 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:41:38.551698 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7359a-31b2-4ef4-a4c0-794248baf57d None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:38.552341 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7359a-31b2-4ef4-a4c0-794248baf57d None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:38.552341 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7359a-31b2-4ef4-a4c0-794248baf57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:38.573715 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-ebe7359a-31b2-4ef4-a4c0-794248baf57d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:38.574913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-ebe7359a-31b2-4ef4-a4c0-794248baf57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:38.582643 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1489/2935] 10.222.0.33 () {58 vars in 1016 bytes} [Sun Sep 18 06:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:41:38.610433 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2123ce-7dee-43e9-b74e-cad89c1495bf service neutron] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:38.612111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-2a2123ce-7dee-43e9-b74e-cad89c1495bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:38.628680 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2123ce-7dee-43e9-b74e-cad89c1495bf service neutron] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:38.634936 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28415f-0e74-4b48-a5f9-71a6920efe4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:38.635519 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28415f-0e74-4b48-a5f9-71a6920efe4d service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:38.635791 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28415f-0e74-4b48-a5f9-71a6920efe4d service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:38.636087 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28415f-0e74-4b48-a5f9-71a6920efe4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:38.644349 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28415f-0e74-4b48-a5f9-71a6920efe4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:38.645895 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28415f-0e74-4b48-a5f9-71a6920efe4d service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:38.655381 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1447/2936] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:41.615287 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dbf9a-2c8c-4e41-bfa0-efa1350f2473 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:41.615816 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dbf9a-2c8c-4e41-bfa0-efa1350f2473 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:41.615816 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dbf9a-2c8c-4e41-bfa0-efa1350f2473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:41.635191 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-9f7dbf9a-2c8c-4e41-bfa0-efa1350f2473 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:41.636424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-9f7dbf9a-2c8c-4e41-bfa0-efa1350f2473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:41.644443 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1490/2937] 10.222.0.33 () {58 vars in 1016 bytes} [Sun Sep 18 06:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:41:41.665330 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28415f-0e74-4b48-a5f9-71a6920efe4d service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:41.666691 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-1c28415f-0e74-4b48-a5f9-71a6920efe4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:41.681969 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28415f-0e74-4b48-a5f9-71a6920efe4d service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:41.687386 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad2000-c391-4a82-92a6-92c0a155a7f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:41.688022 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad2000-c391-4a82-92a6-92c0a155a7f1 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:41.688300 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad2000-c391-4a82-92a6-92c0a155a7f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:41.688573 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad2000-c391-4a82-92a6-92c0a155a7f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:41.697410 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad2000-c391-4a82-92a6-92c0a155a7f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:41.699705 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad2000-c391-4a82-92a6-92c0a155a7f1 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:41.709600 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1448/2938] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:44.862929 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94078-b9c6-4f3a-a456-41eb86a6db07 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:44.863424 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94078-b9c6-4f3a-a456-41eb86a6db07 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:44.863560 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94078-b9c6-4f3a-a456-41eb86a6db07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:44.883208 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-cdc94078-b9c6-4f3a-a456-41eb86a6db07 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:44.884427 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-cdc94078-b9c6-4f3a-a456-41eb86a6db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:44.892446 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1491/2939] 10.222.0.33 () {58 vars in 1016 bytes} [Sun Sep 18 06:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 06:41:44.912795 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad2000-c391-4a82-92a6-92c0a155a7f1 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:44.924172 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad2000-c391-4a82-92a6-92c0a155a7f1 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:44.929948 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9528-fb24-4a80-a8be-6c1978a57454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:44.930521 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9528-fb24-4a80-a8be-6c1978a57454 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:44.930796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9528-fb24-4a80-a8be-6c1978a57454 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:44.931066 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9528-fb24-4a80-a8be-6c1978a57454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:44.938918 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c9528-fb24-4a80-a8be-6c1978a57454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:44.940536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c9528-fb24-4a80-a8be-6c1978a57454 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:44.950388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1449/2940] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:48.994325 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f87f57-acc9-4353-9cc0-a82bbb21291e None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:48.994852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f87f57-acc9-4353-9cc0-a82bbb21291e None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:48.994852 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f87f57-acc9-4353-9cc0-a82bbb21291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:49.014025 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-90f87f57-acc9-4353-9cc0-a82bbb21291e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:49.015229 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-90f87f57-acc9-4353-9cc0-a82bbb21291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:49.024246 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1492/2941] 10.222.0.33 () {58 vars in 1016 bytes} [Sun Sep 18 06:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:41:49.045660 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9528-fb24-4a80-a8be-6c1978a57454 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:49.057152 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9528-fb24-4a80-a8be-6c1978a57454 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:49.062535 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6bca-865e-4b4f-b3d3-4c59972cf40c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:49.063111 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6bca-865e-4b4f-b3d3-4c59972cf40c service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:49.063383 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6bca-865e-4b4f-b3d3-4c59972cf40c service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:49.063651 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6bca-865e-4b4f-b3d3-4c59972cf40c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:49.071870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea6bca-865e-4b4f-b3d3-4c59972cf40c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:49.073846 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea6bca-865e-4b4f-b3d3-4c59972cf40c service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:49.083014 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1450/2942] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:53.172857 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ef3e1-ec91-46c8-ba37-820b9cf99c11 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:53.173369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ef3e1-ec91-46c8-ba37-820b9cf99c11 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:53.173475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ef3e1-ec91-46c8-ba37-820b9cf99c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:53.194011 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-2e7ef3e1-ec91-46c8-ba37-820b9cf99c11 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:53.195250 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-2e7ef3e1-ec91-46c8-ba37-820b9cf99c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:53.203627 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1493/2943] 10.222.0.33 () {58 vars in 1016 bytes} [Sun Sep 18 06:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:41:53.238870 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6bca-865e-4b4f-b3d3-4c59972cf40c service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:53.250800 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6bca-865e-4b4f-b3d3-4c59972cf40c service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:53.256317 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2ec73-b056-4398-a0bd-aa1b44286d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:53.256903 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ec73-b056-4398-a0bd-aa1b44286d11 service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:53.257184 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ec73-b056-4398-a0bd-aa1b44286d11 service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:53.257462 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ec73-b056-4398-a0bd-aa1b44286d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:53.265529 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2ec73-b056-4398-a0bd-aa1b44286d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:53.267355 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2ec73-b056-4398-a0bd-aa1b44286d11 service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:53.276819 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1451/2944] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:41:56.343192 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4dbba-490d-4b04-a739-c8dbfd789f89 None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:56.343691 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4dbba-490d-4b04-a739-c8dbfd789f89 None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:56.343793 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4dbba-490d-4b04-a739-c8dbfd789f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:56.362961 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-66d4dbba-490d-4b04-a739-c8dbfd789f89 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:41:56.364216 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-66d4dbba-490d-4b04-a739-c8dbfd789f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:41:56.372031 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1494/2945] 10.222.0.33 () {58 vars in 1016 bytes} [Sun Sep 18 06:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:41:56.397233 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2ec73-b056-4398-a0bd-aa1b44286d11 service nova] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:41:56.408962 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2ec73-b056-4398-a0bd-aa1b44286d11 service nova] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:41:56.414470 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fc7d1-659b-40ae-a73f-d0e3dfa6f9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:41:56.415078 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fc7d1-659b-40ae-a73f-d0e3dfa6f9dc service nova] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:41:56.415730 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fc7d1-659b-40ae-a73f-d0e3dfa6f9dc service nova] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:41:56.415955 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fc7d1-659b-40ae-a73f-d0e3dfa6f9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:41:56.423986 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fc7d1-659b-40ae-a73f-d0e3dfa6f9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:41:56.425546 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fc7d1-659b-40ae-a73f-d0e3dfa6f9dc service nova] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:41:56.434980 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1452/2946] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 06:42:06.357833 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=18 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:42:06.430629 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=36 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:42:11.466466 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80459-4866-46b2-b61f-be29242ffdcb None None] REQUEST_METHOD: `POST` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:11.466974 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80459-4866-46b2-b61f-be29242ffdcb None None] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:11.467078 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80459-4866-46b2-b61f-be29242ffdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:11.486380 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.auth.core [None req-def80459-4866-46b2-b61f-be29242ffdcb None None] MFA Rules not processed for user `152a222b81d04e829c2cd9d4a5068661`. Rule list: `[]` (Enabled: `True`). {{(pid=81384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:42:11.487581 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-def80459-4866-46b2-b61f-be29242ffdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:42:11.494542 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1495/2947] 10.222.0.16 () {58 vars in 958 bytes} [Sun Sep 18 06:42:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:42:21.481118 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=3 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:42:25.336403 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4b2ef-ff43-4119-b78b-e027c02ec34e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:25.336946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4b2ef-ff43-4119-b78b-e027c02ec34e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:25.336946 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4b2ef-ff43-4119-b78b-e027c02ec34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:25.357082 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-c7f4b2ef-ff43-4119-b78b-e027c02ec34e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:42:25.358341 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-c7f4b2ef-ff43-4119-b78b-e027c02ec34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:42:25.366088 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1453/2948] 10.222.0.33 () {58 vars in 1016 bytes} [Sun Sep 18 06:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:42:25.386875 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def80459-4866-46b2-b61f-be29242ffdcb None None] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:42:25.401255 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def80459-4866-46b2-b61f-be29242ffdcb None None] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:42:25.406702 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874215b0-f60c-4f3e-9291-61dd78339dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:42:25.407292 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874215b0-f60c-4f3e-9291-61dd78339dac service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:25.407566 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874215b0-f60c-4f3e-9291-61dd78339dac service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:25.407832 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874215b0-f60c-4f3e-9291-61dd78339dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:25.415787 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874215b0-f60c-4f3e-9291-61dd78339dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:42:25.417387 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874215b0-f60c-4f3e-9291-61dd78339dac service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:42:25.426583 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1496/2949] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:42:28.616673 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd657a-9de8-4f55-97da-514ad6df6b50 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:28.617205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd657a-9de8-4f55-97da-514ad6df6b50 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:28.617205 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd657a-9de8-4f55-97da-514ad6df6b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:28.637578 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-7dcd657a-9de8-4f55-97da-514ad6df6b50 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:42:28.638767 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-7dcd657a-9de8-4f55-97da-514ad6df6b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:42:28.646715 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1454/2950] 10.222.0.33 () {58 vars in 1016 bytes} [Sun Sep 18 06:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:42:28.666189 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874215b0-f60c-4f3e-9291-61dd78339dac service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:42:28.677302 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874215b0-f60c-4f3e-9291-61dd78339dac service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:42:28.683716 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3506c8-d93a-4019-9bf2-dc4f787ef9ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:42:28.684369 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3506c8-d93a-4019-9bf2-dc4f787ef9ee service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:28.684645 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3506c8-d93a-4019-9bf2-dc4f787ef9ee service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:28.684913 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3506c8-d93a-4019-9bf2-dc4f787ef9ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:28.693111 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3506c8-d93a-4019-9bf2-dc4f787ef9ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:42:28.694662 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3506c8-d93a-4019-9bf2-dc4f787ef9ee service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:42:28.705486 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1497/2951] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:42:31.686060 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317c9f-3292-425e-928d-69636f74877e None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:31.686566 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317c9f-3292-425e-928d-69636f74877e None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:31.686667 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317c9f-3292-425e-928d-69636f74877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:31.706534 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-d9317c9f-3292-425e-928d-69636f74877e None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:42:31.707721 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d9317c9f-3292-425e-928d-69636f74877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:42:31.715533 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1455/2952] 10.222.0.33 () {58 vars in 1016 bytes} [Sun Sep 18 06:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:42:31.737650 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3506c8-d93a-4019-9bf2-dc4f787ef9ee service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:42:31.749526 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3506c8-d93a-4019-9bf2-dc4f787ef9ee service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:42:31.754896 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85e14-97b4-4871-85e4-150225653c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:42:31.755527 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85e14-97b4-4871-85e4-150225653c98 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:31.755800 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85e14-97b4-4871-85e4-150225653c98 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:31.756109 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85e14-97b4-4871-85e4-150225653c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:31.764931 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85e14-97b4-4871-85e4-150225653c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:42:31.766487 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85e14-97b4-4871-85e4-150225653c98 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:42:31.776072 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1498/2953] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:42:34.879446 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3262-89e9-4cd0-a55b-e27075cd208d None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:34.879982 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3262-89e9-4cd0-a55b-e27075cd208d None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:34.880095 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3262-89e9-4cd0-a55b-e27075cd208d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:34.901156 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-060c3262-89e9-4cd0-a55b-e27075cd208d None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:42:34.902388 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-060c3262-89e9-4cd0-a55b-e27075cd208d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:42:34.910379 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1456/2954] 10.222.0.33 () {58 vars in 1016 bytes} [Sun Sep 18 06:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:42:34.931212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85e14-97b4-4871-85e4-150225653c98 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:42:34.943075 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85e14-97b4-4871-85e4-150225653c98 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:42:34.949248 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dc69f-8046-4d1a-8af9-4454e52d37c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:42:34.949836 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dc69f-8046-4d1a-8af9-4454e52d37c4 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:34.950116 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dc69f-8046-4d1a-8af9-4454e52d37c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:34.950389 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dc69f-8046-4d1a-8af9-4454e52d37c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:34.958318 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dc69f-8046-4d1a-8af9-4454e52d37c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:42:34.959888 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dc69f-8046-4d1a-8af9-4454e52d37c4 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:42:34.969316 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1499/2955] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:42:39.059807 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41d84a-6201-4d5a-9a3b-f462dd799042 None None] REQUEST_METHOD: `POST` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:39.060364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41d84a-6201-4d5a-9a3b-f462dd799042 None None] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:39.060474 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41d84a-6201-4d5a-9a3b-f462dd799042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:39.080260 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.auth.core [None req-9d41d84a-6201-4d5a-9a3b-f462dd799042 None None] MFA Rules not processed for user `1346a82e96a54c0884b956d4511e0c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 06:42:39.081461 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9d41d84a-6201-4d5a-9a3b-f462dd799042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:42:39.089826 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1457/2956] 10.222.0.33 () {58 vars in 1016 bytes} [Sun Sep 18 06:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 06:42:39.111811 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dc69f-8046-4d1a-8af9-4454e52d37c4 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:42:39.123141 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dc69f-8046-4d1a-8af9-4454e52d37c4 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:42:39.128706 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcd256-8292-43d4-817c-03a8eb1f2035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b5585d29bcb4b03a1902fbf113f48e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:42:39.129286 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcd256-8292-43d4-817c-03a8eb1f2035 service nova] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:39.129558 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcd256-8292-43d4-817c-03a8eb1f2035 service nova] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:39.129825 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcd256-8292-43d4-817c-03a8eb1f2035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:39.138496 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcd256-8292-43d4-817c-03a8eb1f2035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:42:39.140091 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcd256-8292-43d4-817c-03a8eb1f2035 service nova] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:42:39.149475 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1500/2957] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:42:48.535065 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41d84a-6201-4d5a-9a3b-f462dd799042 None None] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:42:48.537384 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-9d41d84a-6201-4d5a-9a3b-f462dd799042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:42:48.541599 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=16 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:42:48.697425 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41d84a-6201-4d5a-9a3b-f462dd799042 None None] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:42:48.704967 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4f4fc-5805-4b18-b0d4-284ae79739e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:42:48.705965 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4f4fc-5805-4b18-b0d4-284ae79739e6 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:42:48.706244 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4f4fc-5805-4b18-b0d4-284ae79739e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:42:48.706515 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4f4fc-5805-4b18-b0d4-284ae79739e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:42:48.708261 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-aea4f4fc-5805-4b18-b0d4-284ae79739e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:42:48.720012 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4f4fc-5805-4b18-b0d4-284ae79739e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:42:48.721723 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4f4fc-5805-4b18-b0d4-284ae79739e6 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:42:48.732006 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1458/2958] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:42:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:42:49.145351 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=30 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:42:58.727208 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=62 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:43:09.096212 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcd256-8292-43d4-817c-03a8eb1f2035 service nova] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:43:09.137962 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcd256-8292-43d4-817c-03a8eb1f2035 service nova] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:43:09.146284 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dce7d1-36e9-4411-a756-47e2f1566150 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:43:09.147009 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dce7d1-36e9-4411-a756-47e2f1566150 service placement] REQUEST_METHOD: `GET` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:43:09.147202 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dce7d1-36e9-4411-a756-47e2f1566150 service placement] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:43:09.147439 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dce7d1-36e9-4411-a756-47e2f1566150 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:43:09.150815 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.fernet_utils [None req-95dce7d1-36e9-4411-a756-47e2f1566150 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:43:09.159641 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4f4fc-5805-4b18-b0d4-284ae79739e6 service placement] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:43:09.164892 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dce7d1-36e9-4411-a756-47e2f1566150 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:43:09.166494 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dce7d1-36e9-4411-a756-47e2f1566150 service placement] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:43:09.170110 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4f4fc-5805-4b18-b0d4-284ae79739e6 service placement] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:43:09.175200 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:43:09.175920 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:43:09.176275 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:43:09.176617 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] PATH_INFO: `/v3/users/152a222b81d04e829c2cd9d4a5068661` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:43:09.177667 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1501/2959] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:43:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:43:09.185364 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152a222b81d04e829c2cd9d4a5068661)` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:43:09.188137 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:43:09.241414 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152a222b81d04e829c2cd9d4a5068661'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:43:09.249176 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152a222b81d04e829c2cd9d4a5068661'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:43:09.249796 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152a222b81d04e829c2cd9d4a5068661'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:43:09.250448 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152a222b81d04e829c2cd9d4a5068661'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:43:09.257293 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.notifications [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152a222b81d04e829c2cd9d4a5068661'} {{(pid=81385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:43:09.275224 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1459/2960] 10.222.0.16 () {58 vars in 1224 bytes} [Sun Sep 18 06:43:09 2022] DELETE /identity/v3/users/152a222b81d04e829c2cd9d4a5068661 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 06:43:09.447714 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dce7d1-36e9-4411-a756-47e2f1566150 service placement] Authenticating user token {{(pid=81384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:43:09.459408 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dce7d1-36e9-4411-a756-47e2f1566150 service placement] Validating token access rules against request {{(pid=81384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:43:09.516106 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1346a82e96a54c0884b956d4511e0c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6b33098764a2dacc62af886817c55', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:43:09.516729 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:43:09.517002 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:43:09.517272 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] PATH_INFO: `/v3/projects/3c0ee5ced9cb44bb9cc81717d383494b` {{(pid=81384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:43:09.518379 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c0ee5ced9cb44bb9cc81717d383494b)` {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:43:09.520617 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] RBAC: Authorization granted {{(pid=81384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:43:09.567021 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c0ee5ced9cb44bb9cc81717d383494b', 'request_id': 'req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:43:09.573068 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c0ee5ced9cb44bb9cc81717d383494b', 'request_id': 'req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:43:09.580113 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c0ee5ced9cb44bb9cc81717d383494b', 'request_id': 'req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040'} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:43:09.591249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] The token cache is being invalidate because project 3c0ee5ced9cb44bb9cc81717d383494b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 06:43:09.591249 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:43:09.591571 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG keystone.notifications [None req-eb36bbae-9d5a-4b22-a2f2-b9fc618cb040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 06:43:09.593259 dv-cinder-855359-3-smb devstack@keystone.service[81384]: [pid: 81384|app: 0|req: 1502/2961] 10.222.0.16 () {58 vars in 1233 bytes} [Sun Sep 18 06:43:09 2022] DELETE /identity/v3/projects/3c0ee5ced9cb44bb9cc81717d383494b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 06:43:19.271759 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:43:19.587490 dv-cinder-855359-3-smb devstack@keystone.service[81384]: DEBUG dbcounter [-] [81384] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 06:47:56.595210 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] Authenticating user token {{(pid=81385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 06:47:56.596663 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:47:56.665670 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0743c30-f50e-476f-b1b3-7006d28f0f12 admin admin] Validating token access rules against request {{(pid=81385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 06:47:56.724141 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35dd7f-11b7-4c65-8241-615b20caefe3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '320a1c60b5b6461c8e2e2b6ec74ce78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b23310cf87d443fa8ff3dab6c84ad33d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 06:47:56.724770 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35dd7f-11b7-4c65-8241-615b20caefe3 service placement] REQUEST_METHOD: `GET` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 06:47:56.725047 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35dd7f-11b7-4c65-8241-615b20caefe3 service placement] SCRIPT_NAME: `/identity` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 06:47:56.725323 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35dd7f-11b7-4c65-8241-615b20caefe3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 06:47:56.727029 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.fernet_utils [None req-ab35dd7f-11b7-4c65-8241-615b20caefe3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 06:47:56.738092 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35dd7f-11b7-4c65-8241-615b20caefe3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 06:47:56.739653 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35dd7f-11b7-4c65-8241-615b20caefe3 service placement] RBAC: Authorization granted {{(pid=81385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 06:47:56.749536 dv-cinder-855359-3-smb devstack@keystone.service[81385]: [pid: 81385|app: 0|req: 1460/2962] 10.222.0.16 () {60 vars in 1365 bytes} [Sun Sep 18 06:47:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 06:48:06.745299 dv-cinder-855359-3-smb devstack@keystone.service[81385]: DEBUG dbcounter [-] [81385] Writing DB stats keystone:SELECT=58 {{(pid=81385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}